-- Logs begin at Tue 2022-07-26 14:05:02 UTC, end at Tue 2022-07-26 15:39:17 UTC. -- Jul 26 14:53:48.385554 dv-cinder-851032-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 26 14:53:48.398309 dv-cinder-851032-1-smb devstack@keystone.service[80477]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 26 14:53:48.401489 dv-cinder-851032-1-smb devstack@keystone.service[80477]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 14:53:48 2022] *** Jul 26 14:53:48.401489 dv-cinder-851032-1-smb devstack@keystone.service[80477]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 14:53:48.401489 dv-cinder-851032-1-smb devstack@keystone.service[80477]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 14:53:48.401489 dv-cinder-851032-1-smb devstack@keystone.service[80477]: nodename: dv-cinder-851032-1-smb Jul 26 14:53:48.401489 dv-cinder-851032-1-smb devstack@keystone.service[80477]: machine: x86_64 Jul 26 14:53:48.401489 dv-cinder-851032-1-smb devstack@keystone.service[80477]: clock source: unix Jul 26 14:53:48.401489 dv-cinder-851032-1-smb devstack@keystone.service[80477]: pcre jit disabled Jul 26 14:53:48.401489 dv-cinder-851032-1-smb devstack@keystone.service[80477]: detected number of CPU cores: 4 Jul 26 14:53:48.401489 dv-cinder-851032-1-smb devstack@keystone.service[80477]: current working directory: / Jul 26 14:53:48.401489 dv-cinder-851032-1-smb devstack@keystone.service[80477]: detected binary path: /usr/bin/uwsgi-core Jul 26 14:53:48.401489 dv-cinder-851032-1-smb devstack@keystone.service[80477]: your processes number limit is 47680 Jul 26 14:53:48.408465 dv-cinder-851032-1-smb devstack@keystone.service[80477]: your memory page size is 4096 bytes Jul 26 14:53:48.408465 dv-cinder-851032-1-smb devstack@keystone.service[80477]: detected max file descriptor number: 2048 Jul 26 14:53:48.408465 dv-cinder-851032-1-smb devstack@keystone.service[80477]: lock engine: pthread robust mutexes Jul 26 14:53:48.408465 dv-cinder-851032-1-smb devstack@keystone.service[80477]: thunder lock: enabled Jul 26 14:53:48.408465 dv-cinder-851032-1-smb devstack@keystone.service[80477]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 26 14:53:48.408465 dv-cinder-851032-1-smb devstack@keystone.service[80477]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 14:53:48.445311 dv-cinder-851032-1-smb devstack@keystone.service[80477]: Python main interpreter initialized at 0x55b7578069c0 Jul 26 14:53:48.445311 dv-cinder-851032-1-smb devstack@keystone.service[80477]: python threads support enabled Jul 26 14:53:48.445311 dv-cinder-851032-1-smb devstack@keystone.service[80477]: your server socket listen backlog is limited to 100 connections Jul 26 14:53:48.445311 dv-cinder-851032-1-smb devstack@keystone.service[80477]: your mercy for graceful operations on workers is 90 seconds Jul 26 14:53:48.445775 dv-cinder-851032-1-smb devstack@keystone.service[80477]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 14:53:48.445775 dv-cinder-851032-1-smb devstack@keystone.service[80477]: *** Operational MODE: preforking *** Jul 26 14:53:48.446075 dv-cinder-851032-1-smb devstack@keystone.service[80477]: *** uWSGI is running in multiple interpreter mode *** Jul 26 14:53:48.446075 dv-cinder-851032-1-smb devstack@keystone.service[80477]: spawned uWSGI master process (pid: 80477) Jul 26 14:53:48.446383 dv-cinder-851032-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 26 14:53:48.447471 dv-cinder-851032-1-smb devstack@keystone.service[80477]: spawned uWSGI worker 1 (pid: 80488, cores: 1) Jul 26 14:53:48.447471 dv-cinder-851032-1-smb devstack@keystone.service[80477]: spawned uWSGI worker 2 (pid: 80489, cores: 1) Jul 26 14:53:48.447471 dv-cinder-851032-1-smb devstack@keystone.service[80477]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 14:53:54.920129 dv-cinder-851032-1-smb devstack@keystone.service[80489]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:53:54.920129 dv-cinder-851032-1-smb devstack@keystone.service[80489]: from cryptography.utils import int_from_bytes Jul 26 14:53:54.921393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:53:54.921393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: from cryptography.utils import int_from_bytes Jul 26 14:53:54.980488 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 14:53:54.980488 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 14:53:54.981846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] command line args: [] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 14:53:54.981846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 14:53:54.981846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ================================================================================ {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 14:53:54.981846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] admin_token = **** {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.981846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] config_dir = [] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.982440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.982440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] config_source = [] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.982440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] debug = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.982763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.983256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.983256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.983634 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.983634 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.983998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] list_limit = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.983998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] log_config_append = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.984341 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.984341 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] log_dir = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.984707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] log_file = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.984707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.985077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.985077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.985413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.985610 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.985795 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.985971 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.986144 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.986415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.986629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.986852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.987088 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.987339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.987587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.987864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.988399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.98/identity {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.988561 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] publish_errors = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.988796 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.989030 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.989236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.989445 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.989683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.989917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] standard_threads = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.990148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.990411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.990591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.990751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] use_journal = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.990932 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] use_json = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.991105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] use_stderr = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.991281 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] use_syslog = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.991515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:54.991773 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.992013 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.992373 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.992629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.992883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.993123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.993373 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.993608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.993858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.994108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.994376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.994616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.994867 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.995103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.995352 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.995601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.996358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.996711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.997641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.997641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.997641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.997641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.998124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.998124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.998483 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.998656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.998892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.999125 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.999362 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.999616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:54.999892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.000125 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.000358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.000605 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.000866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.001083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.001330 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.001563 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.001801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.002038 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.002267 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.002535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.002769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.003003 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.003245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.003495 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.003729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.004129 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.004373 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.004615 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.004852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.005102 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.005338 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.005579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.005817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.006056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.006291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.006554 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.006785 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.007035 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.007272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.007511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.007740 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.008003 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.008239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.008510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.008829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.009071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.009347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.009587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.009948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.010275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.010546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.010788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.011025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.011281 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.011951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.011951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.012940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.012940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.012940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.012940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.012940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.013590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.013590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.013837 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.013966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.014184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.014488 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.014791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.015051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.015292 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.015528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.015762 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.015996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.016233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.016551 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.016805 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.017048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.017479 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.017877 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.018309 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.018614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.018864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.019162 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] auth.external = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.019403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.019703 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.019941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.020176 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] auth.password = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.020409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] auth.token = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.020655 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.020890 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.022818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.023147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.023428 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.023701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.023956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.024204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] credential.caching = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.024472 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.026058 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.026058 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.026058 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.026058 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.026058 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.026810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.026810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.026810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.028829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.028829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.028829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.028829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.028829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.029708 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.029708 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] federation.caching = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.029909 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.030068 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.030412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.030686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.031005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.031336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.031604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.031850 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.032115 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.032357 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.032614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.032855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity.caching = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.033174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.033481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.033731 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.033974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.034230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.034481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.034728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.034985 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.035322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.035565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.035806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.036044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.036294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.036548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.036799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.037058 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.037309 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.037586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.037827 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.038070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.038404 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.038626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.038864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.039103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.039349 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.039592 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.039845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.040180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.040605 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.040925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.041236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.041495 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.041748 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.042122 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.042268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.042458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.042789 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.043346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.044120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.044120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.044120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.044484 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.044736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.044980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.045217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.045473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.045725 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.045964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.046206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.046469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.046707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.046953 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.047217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.047488 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.047741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.047990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.048245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.048483 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.048712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.048952 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.049188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.049430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.049734 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.050102 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.050509 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.050804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.051153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.051406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.051644 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.051902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.052139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.052382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.052621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.052923 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.053106 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.053430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.053675 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.053935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.054169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.054443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.054688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.054925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.055164 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.055412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.055656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.055889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.056127 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.056371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] resource.caching = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.056624 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.056873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.057109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.057354 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.057653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.057908 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.058210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.059353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.060204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.060204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] role.caching = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.060204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] role.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.060570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.060570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.060823 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.061045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.061295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.061545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.061795 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.062043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.062296 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.062554 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.062809 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.063114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.063366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.063616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.064138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.064377 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.064629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.064883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.065132 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.065386 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.065622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.065882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.066138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.066400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.066635 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.066926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.067094 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.067350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.067606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.067858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.068102 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.068341 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.068765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.068941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] token.caching = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.069303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.069728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.070023 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.070288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.070662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.071023 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.071277 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.071636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.071893 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.072137 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.072384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.072627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.072876 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.073129 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.073365 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.073610 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.074174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.075203 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.connection = **** {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.075203 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.075203 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.075203 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.075203 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.075856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.075856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.075856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.076233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.076488 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.076728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.076973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.077213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.077570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.077815 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.078068 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.078302 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.078577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.078816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.078979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 14:53:55.205274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.205489 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.205651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.215512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.248090 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.248369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.312268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.368158 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.368405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.444547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:53:55.444547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: from cryptography.utils import int_from_bytes Jul 26 14:53:55.445258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:53:55.445258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: from cryptography.utils import int_from_bytes Jul 26 14:53:55.455103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.455428 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.455585 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.455747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.455946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.456161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.483372 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.483720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.484009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.484243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.484468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.484686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.484901 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.500162 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.508481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 14:53:55.508739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 14:53:55.509002 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] command line args: [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 14:53:55.509350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 14:53:55.509595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ================================================================================ {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 14:53:55.509927 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] admin_token = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.510241 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] config_dir = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.510575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.510881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] config_source = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.511137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] debug = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.511462 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.511858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.512145 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.512477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.512802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.513105 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] list_limit = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.513356 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] log_config_append = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.513622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.513760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.513896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.514030 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] log_dir = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.514160 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.514291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] log_file = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.514454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.514584 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.514704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.514850 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.515041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.515173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.515469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.516017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.516017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.516274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.516701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.517160 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.517610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.518033 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.518477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.518800 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.519128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.519453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.519810 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.520500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.98/identity {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.520780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] publish_errors = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.521190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.521504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.521758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.522089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.522438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.522764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] standard_threads = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.523070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.523386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.523629 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.523878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] use_journal = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.524179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] use_json = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.524470 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] use_stderr = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.524719 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] use_syslog = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.525026 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:53:55.525365 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.525845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.526081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.526444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.526787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.527657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.528010 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.528341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.528810 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.529265 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.529680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.530094 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.530565 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.531019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.531492 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.531963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.532389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.532849 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.533318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.533767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.534215 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.534729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.535212 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.535706 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.535828 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.536039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 14:53:55.536166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.536387 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.536563 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.536690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 14:53:55.536850 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.536971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.537116 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.537373 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.537500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.537614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.537839 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.538315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.538825 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.539152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.539528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.540022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.540490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.541053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.541418 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.541852 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.542311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.543308 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.543705 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.544040 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.544405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.544758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.545167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.546312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.546312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.546312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.546780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.546884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.547165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.547533 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.547835 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.548000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.548182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.548371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.548589 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.548772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.548941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.549112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.549419 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.549817 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.550199 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.550643 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.551036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.551434 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.551866 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.552357 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.552628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.552876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.553213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.553385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.553729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.553919 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.554169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.554436 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.554827 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.555158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.555402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.555666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.556011 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.556154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.556394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.556793 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.557217 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.558141 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.558141 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.558547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.559560 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.559700 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.559873 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.559989 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.560104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.560229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.560346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.560457 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.560573 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.560759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.560993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.561165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.561403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.561564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.561839 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.561980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.562220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.562351 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.562675 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.562769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.563079 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.563225 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.563479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.563904 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.564315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.564723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.565114 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.565549 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.565956 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.566215 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.566529 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.566792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.567062 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] auth.external = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.567304 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.567616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.567861 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.568354 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] auth.password = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.568780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] auth.token = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.569224 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.569669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.570090 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.570542 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.571033 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.571516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.571790 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.572048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] credential.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.572313 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.572582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.572913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.573336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.573726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.574025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.575064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.575064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.575064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.575293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.575519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.575780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.576203 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.576647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.577116 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.577571 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.578012 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.578199 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.578504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.578762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.579037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.579285 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.579554 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.579824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.580113 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.580427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.580694 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.580950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.581211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.581469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.581716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.581962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.582219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.582488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.582739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.583103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.583307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.583550 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.583795 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.584037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.584533 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.584797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.585066 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.585318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.585572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.585853 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.586100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.586346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.586629 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.587013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.587354 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.587601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.587967 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.588220 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.588545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.588792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.589054 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.589311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.590078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.590650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.590650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.590650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.590650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.591700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.591856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.592253 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.592650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.592963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.593083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.593384 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.593854 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.594319 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.594799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.594926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.595122 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.595235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.595667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.596104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.596525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.596968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.597393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.597815 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.601293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.601293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.601293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.601293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.601293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.601293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.601293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.601990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.601990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.602099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.602199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.602286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.602505 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.602732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.603167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.603641 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.604106 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.604578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.605033 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.606266 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.606266 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.607107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.607619 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.608079 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.608535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.612362 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.612362 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.612362 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.612941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.612941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.613234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.613234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.613234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.613234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.613234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.613234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.613234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.614049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.614049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.614278 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.614676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.615102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.615518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.615926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.617594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.617594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.618124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.618257 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.618332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.618463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.618542 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.618606 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.618689 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.618768 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.618830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.618892 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.618952 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.619172 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] role.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.619377 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.619564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.620040 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] role.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.620040 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.620556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.621309 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.621708 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.622054 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.622504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.623060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.623371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.623741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.624086 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.624436 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.624784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.625129 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.625502 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.626131 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.626581 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.626942 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.627306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.627654 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.627999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.628344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.628763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.629117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.629487 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.629823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.630159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.630540 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.630899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.631257 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.631628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.631971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.632307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.632648 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.632985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.633325 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.633675 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.634011 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.634575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.634835 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.635194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.635542 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.635884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.636236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.636626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.637088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.637627 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.637898 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.638126 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.638426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.638671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.639003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.639284 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.connection = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.639544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.639807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.640048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.640299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.640468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.640567 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.640787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.640963 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.641101 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.641260 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.641518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.641758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.642021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.642257 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.642572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.642822 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.643070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.643305 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.643549 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.643819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:53:55.644042 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 14:53:55.648903 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.652807 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.653114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.660212 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.666635 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.671526 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.672018 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.672476 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.672934 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.673389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.673837 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.684219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.684575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.684897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.697066 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.698435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.698885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.699841 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.700265 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.709887 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.711440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.711713 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.714495 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.714781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.715085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.715488 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.715774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.723672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.723954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.727316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.727615 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.727896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.728288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.728685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.728967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.729264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.746521 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.749900 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.752933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.754563 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.756238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.756523 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.756805 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.765409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.766986 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.770818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.771280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.771567 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.771791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.779788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.781582 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.781956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.782475 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.793676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.794152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.794426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.794706 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.795128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.795546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.795981 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.796427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.796826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.797243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.797663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.798070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.798495 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.798775 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.833465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.833862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.849951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b7578069c0 pid: 80489 (default app) Jul 26 14:53:55.853794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5e6c0-cd5f-4257-899a-6a2832af4cdf None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:55.854110 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5e6c0-cd5f-4257-899a-6a2832af4cdf None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:55.854324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5e6c0-cd5f-4257-899a-6a2832af4cdf None None] PATH_INFO: `/v3` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:55.859485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1/1] 10.222.0.98 () {50 vars in 791 bytes} [Tue Jul 26 14:53:55 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:53:55.896414 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.896764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.897081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.897396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.897707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.898079 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.917278 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.918513 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.918513 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.918513 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.918954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.918954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.919422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.931745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.937525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.937898 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.938279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.938690 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.938928 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.939135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.939373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:53:55.954039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.954321 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 14:53:55.954822 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.955158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 14:53:55.955831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.955992 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.956341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.956631 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.971496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.971794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.972135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.972505 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.986236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.994917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:55.995455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.996484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.996971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.997968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.997968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.998344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.999692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.999692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:55.999692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.000145 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.045340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.048066 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.054752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.066248 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.071268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.072144 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.083636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.084529 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.092160 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.092445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.092864 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.093181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.093527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.093811 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.094089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.094514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.112644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.112930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.117088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.120660 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.121991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.126979 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.130749 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.134479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.134795 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.135142 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.135535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.135930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.136320 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.153665 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.154042 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.154247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.154504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.161960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.163642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.163918 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.167410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.168379 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.168911 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.169441 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.169917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.187051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.187345 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.187664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.187962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.188237 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.188601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.188977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.206523 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.210098 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.214193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.219468 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.222284 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.222688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.223160 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.235677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.238418 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.243583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.244049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.244490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.244926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.259425 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.259806 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.260262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.268081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:53:56.268461 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.268820 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.269167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.269517 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.269866 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.270235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.270662 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.271306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.271794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.272175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.272633 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.273145 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.273614 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:53:56.315666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x55b7578069c0 pid: 80488 (default app) Jul 26 14:54:06.667984 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce8814-9905-4556-aa2c-ecc6b4105998 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:06.668589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce8814-9905-4556-aa2c-ecc6b4105998 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:06.668589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce8814-9905-4556-aa2c-ecc6b4105998 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:06.670050 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 2/2] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:54:06.680120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec8487-1292-4a01-8d64-38e82c31fcc8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:06.681081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec8487-1292-4a01-8d64-38e82c31fcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:06.681081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec8487-1292-4a01-8d64-38e82c31fcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:06.777540 dv-cinder-851032-1-smb devstack@keystone.service[80488]: INFO dbcounter [None req-66ec8487-1292-4a01-8d64-38e82c31fcc8 None None] Registered counter for database keystone Jul 26 14:54:06.805913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG oslo_db.sqlalchemy.engines [None req-66ec8487-1292-4a01-8d64-38e82c31fcc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:54:06.823001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writer thread running {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:54:07.023648 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG passlib.handlers.bcrypt [None req-66ec8487-1292-4a01-8d64-38e82c31fcc8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80488) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 14:54:07.024183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG passlib.handlers.bcrypt [None req-66ec8487-1292-4a01-8d64-38e82c31fcc8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80488) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 14:54:07.087574 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-66ec8487-1292-4a01-8d64-38e82c31fcc8 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:07.089276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-66ec8487-1292-4a01-8d64-38e82c31fcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:07.262281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1/3] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 587 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 26 14:54:07.415058 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce8814-9905-4556-aa2c-ecc6b4105998 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:07.503843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: INFO dbcounter [None req-ecce8814-9905-4556-aa2c-ecc6b4105998 None None] Registered counter for database keystone Jul 26 14:54:07.532958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG oslo_db.sqlalchemy.engines [None req-ecce8814-9905-4556-aa2c-ecc6b4105998 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80489) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:54:07.543710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writer thread running {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:54:07.703837 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce8814-9905-4556-aa2c-ecc6b4105998 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:07.709605 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4c6f7-527e-43ba-881e-5a5a1248a495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:07.710389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4c6f7-527e-43ba-881e-5a5a1248a495 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:07.710740 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4c6f7-527e-43ba-881e-5a5a1248a495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:07.711066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4c6f7-527e-43ba-881e-5a5a1248a495 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:07.721834 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4c6f7-527e-43ba-881e-5a5a1248a495 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:07.776641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: WARNING keystone.common.rbac_enforcer.enforcer [None req-82f4c6f7-527e-43ba-881e-5a5a1248a495 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 14:54:07.777160 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4c6f7-527e-43ba-881e-5a5a1248a495 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:07.792327 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 3/4] 10.222.0.98 () {58 vars in 1324 bytes} [Tue Jul 26 14:54:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 14:54:07.798728 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec8487-1292-4a01-8d64-38e82c31fcc8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:07.817097 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec8487-1292-4a01-8d64-38e82c31fcc8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:07.822560 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25404fc-8176-47d1-bdcb-ed2bd48c8205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:07.823902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25404fc-8176-47d1-bdcb-ed2bd48c8205 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:07.824202 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25404fc-8176-47d1-bdcb-ed2bd48c8205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:07.824486 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25404fc-8176-47d1-bdcb-ed2bd48c8205 admin admin] PATH_INFO: `/v3/projects/eae5d7650fd54c5a8c95f42eefe32a57` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:07.826230 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25404fc-8176-47d1-bdcb-ed2bd48c8205 admin admin] RBAC: Authorizing `identity:get_project(project_id=eae5d7650fd54c5a8c95f42eefe32a57)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:07.883868 dv-cinder-851032-1-smb devstack@keystone.service[80488]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e25404fc-8176-47d1-bdcb-ed2bd48c8205 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 14:54:07.884277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25404fc-8176-47d1-bdcb-ed2bd48c8205 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:07.890330 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 2/5] 10.222.0.98 () {56 vars in 1207 bytes} [Tue Jul 26 14:54:07 2022] GET /identity/v3/projects/eae5d7650fd54c5a8c95f42eefe32a57 => generated 344 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:10.192002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d036-b6e9-47a9-87a0-ec1a30a3bfdc None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:10.192629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d036-b6e9-47a9-87a0-ec1a30a3bfdc None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:10.192629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d036-b6e9-47a9-87a0-ec1a30a3bfdc None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:10.196883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 4/6] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:10.203539 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c40a2-e8a2-437e-bed0-c09a06cf04cf None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:10.204127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c40a2-e8a2-437e-bed0-c09a06cf04cf None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:10.204127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c40a2-e8a2-437e-bed0-c09a06cf04cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:10.227668 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b01c40a2-e8a2-437e-bed0-c09a06cf04cf None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:10.229777 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b01c40a2-e8a2-437e-bed0-c09a06cf04cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:10.238773 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 3/7] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 26 14:54:10.262870 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5d036-b6e9-47a9-87a0-ec1a30a3bfdc None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:10.276817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5d036-b6e9-47a9-87a0-ec1a30a3bfdc None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:10.281950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc3786-3048-4185-a95d-d7407d67fedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:10.282647 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc3786-3048-4185-a95d-d7407d67fedc admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:10.282937 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc3786-3048-4185-a95d-d7407d67fedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:10.283219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc3786-3048-4185-a95d-d7407d67fedc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:10.293559 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc3786-3048-4185-a95d-d7407d67fedc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:10.295558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc3786-3048-4185-a95d-d7407d67fedc admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:10.306145 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 5/8] 10.222.0.98 () {58 vars in 1324 bytes} [Tue Jul 26 14:54:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 14:54:10.313276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c40a2-e8a2-437e-bed0-c09a06cf04cf None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:10.324123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c40a2-e8a2-437e-bed0-c09a06cf04cf None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:10.329268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61caf8-a5e7-4118-bafb-809f92c033a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:10.330000 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61caf8-a5e7-4118-bafb-809f92c033a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:10.330332 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61caf8-a5e7-4118-bafb-809f92c033a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:10.330759 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61caf8-a5e7-4118-bafb-809f92c033a3 admin admin] PATH_INFO: `/v3/users/ab0ce7c38c274718a8fd45c535922c16` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:10.332337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61caf8-a5e7-4118-bafb-809f92c033a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=ab0ce7c38c274718a8fd45c535922c16)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:10.334586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61caf8-a5e7-4118-bafb-809f92c033a3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:10.336366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 4/9] 10.222.0.98 () {56 vars in 1198 bytes} [Tue Jul 26 14:54:10 2022] GET /identity/v3/users/ab0ce7c38c274718a8fd45c535922c16 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:54:12.715638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e10586-464b-4bb2-8881-cd6a5a028b34 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:12.716435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e10586-464b-4bb2-8881-cd6a5a028b34 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:12.716435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e10586-464b-4bb2-8881-cd6a5a028b34 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:12.717894 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 6/10] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:12.725381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346462b-9cf0-4b5c-a72a-aa86718fe350 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:12.725952 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346462b-9cf0-4b5c-a72a-aa86718fe350 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:12.726351 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346462b-9cf0-4b5c-a72a-aa86718fe350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:12.760655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f346462b-9cf0-4b5c-a72a-aa86718fe350 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:12.762771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f346462b-9cf0-4b5c-a72a-aa86718fe350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:12.815958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64eb4c8-eef9-4be9-a13c-906e4ef63481 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:12.816426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64eb4c8-eef9-4be9-a13c-906e4ef63481 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:12.816896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64eb4c8-eef9-4be9-a13c-906e4ef63481 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:12.818376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 7/11] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:54:12.825947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8b36d-462a-4310-9750-8bc9dde6d247 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:12.826234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8b36d-462a-4310-9750-8bc9dde6d247 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:12.826549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8b36d-462a-4310-9750-8bc9dde6d247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:12.876034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG passlib.handlers.bcrypt [None req-e0a8b36d-462a-4310-9750-8bc9dde6d247 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80489) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 14:54:12.876576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG passlib.handlers.bcrypt [None req-e0a8b36d-462a-4310-9750-8bc9dde6d247 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80489) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 14:54:12.894668 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 5/12] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:12.920969 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346462b-9cf0-4b5c-a72a-aa86718fe350 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:12.924443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-e0a8b36d-462a-4310-9750-8bc9dde6d247 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:12.926343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e0a8b36d-462a-4310-9750-8bc9dde6d247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:12.958061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:13.072924 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 8/13] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:54:13.100229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8b36d-462a-4310-9750-8bc9dde6d247 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:13.106162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346462b-9cf0-4b5c-a72a-aa86718fe350 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:13.166233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8d1c4-69dd-4f1e-932f-dd33a851f40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:13.167447 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8d1c4-69dd-4f1e-932f-dd33a851f40c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:13.168014 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8d1c4-69dd-4f1e-932f-dd33a851f40c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:13.168575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8d1c4-69dd-4f1e-932f-dd33a851f40c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:13.191065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8d1c4-69dd-4f1e-932f-dd33a851f40c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-74b8d1c4-69dd-4f1e-932f-dd33a851f40c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:13.208964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:13.211426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:13.212821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:13.212821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:13.212821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:13.212821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:13.212821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:13.212821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:13.212821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:13.212821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:13.212821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:13.212821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:13.212821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:54:13.212821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:54:13.212821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 6/14] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:54:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:54:13.221383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8d1c4-69dd-4f1e-932f-dd33a851f40c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:13.236854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8b36d-462a-4310-9750-8bc9dde6d247 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:13.240691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:13.307759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989654f-5f22-4eb2-a5e1-3d59fe3cffaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:13.309278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989654f-5f22-4eb2-a5e1-3d59fe3cffaa None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:13.309766 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989654f-5f22-4eb2-a5e1-3d59fe3cffaa None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:13.310278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989654f-5f22-4eb2-a5e1-3d59fe3cffaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:13.333871 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:13.358701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8d1c4-69dd-4f1e-932f-dd33a851f40c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:13.404642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590a968-2e5f-47ee-a1d4-45f7828ecfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:13.405387 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590a968-2e5f-47ee-a1d4-45f7828ecfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:13.405674 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590a968-2e5f-47ee-a1d4-45f7828ecfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:13.405948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590a968-2e5f-47ee-a1d4-45f7828ecfa7 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:13.406793 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590a968-2e5f-47ee-a1d4-45f7828ecfa7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:13.407075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590a968-2e5f-47ee-a1d4-45f7828ecfa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:13.408572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590a968-2e5f-47ee-a1d4-45f7828ecfa7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:13.425083 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 7/15] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:54:13.436078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590a968-2e5f-47ee-a1d4-45f7828ecfa7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:13.445473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989654f-5f22-4eb2-a5e1-3d59fe3cffaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:13.447963 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989654f-5f22-4eb2-a5e1-3d59fe3cffaa None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:13.611819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 9/16] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:54:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:13.621196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989654f-5f22-4eb2-a5e1-3d59fe3cffaa None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:13.624890 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:13.714970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590a968-2e5f-47ee-a1d4-45f7828ecfa7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:13.767368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fd034-46eb-4809-8314-aed57daf1f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:13.769437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fd034-46eb-4809-8314-aed57daf1f27 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:13.769437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fd034-46eb-4809-8314-aed57daf1f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:13.769437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fd034-46eb-4809-8314-aed57daf1f27 None admin] PATH_INFO: `/v3/users/ab0ce7c38c274718a8fd45c535922c16` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:13.770095 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fd034-46eb-4809-8314-aed57daf1f27 None admin] RBAC: Authorizing `identity:get_user(user_id=ab0ce7c38c274718a8fd45c535922c16)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:13.771673 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fd034-46eb-4809-8314-aed57daf1f27 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:13.773588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 8/17] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:13 2022] GET /identity/v3/users/ab0ce7c38c274718a8fd45c535922c16 => generated 247 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:54:13.780747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989654f-5f22-4eb2-a5e1-3d59fe3cffaa None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:13.783252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fd034-46eb-4809-8314-aed57daf1f27 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:13.803757 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:13.865302 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc7e00-07ee-449d-a5c4-c4cea4128537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:13.866530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc7e00-07ee-449d-a5c4-c4cea4128537 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:13.867122 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc7e00-07ee-449d-a5c4-c4cea4128537 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:13.867550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc7e00-07ee-449d-a5c4-c4cea4128537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:13.907051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc7e00-07ee-449d-a5c4-c4cea4128537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:13.910057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc7e00-07ee-449d-a5c4-c4cea4128537 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:13.947548 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fd034-46eb-4809-8314-aed57daf1f27 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:13.949061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-ebbc7e00-07ee-449d-a5c4-c4cea4128537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:54:13.949061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:13.949061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:13.949061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:13.949061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:13.949061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:13.949061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:13.949061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:13.949061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:13.949061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:13.949061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:13.949061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:13.949061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:54:13.949061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:54:13.949061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:13.950148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:13.951023 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:54:13.951023 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:54:13.951023 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:54:13.951023 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:54:13.951802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 10/18] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:54:13.961893 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc7e00-07ee-449d-a5c4-c4cea4128537 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:14.007551 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7d676-70ea-47db-b3d4-27d580809864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:14.008767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7d676-70ea-47db-b3d4-27d580809864 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:14.009129 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7d676-70ea-47db-b3d4-27d580809864 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:14.009599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7d676-70ea-47db-b3d4-27d580809864 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:14.012008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7d676-70ea-47db-b3d4-27d580809864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:14.014965 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7d676-70ea-47db-b3d4-27d580809864 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:14.018631 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 9/19] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:54:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:54:14.030907 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7d676-70ea-47db-b3d4-27d580809864 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:14.044600 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:14.123481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc7e00-07ee-449d-a5c4-c4cea4128537 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:14.170230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a013f62-7b78-40c3-812d-f0cc37f0d578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:14.171069 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a013f62-7b78-40c3-812d-f0cc37f0d578 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:14.171419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a013f62-7b78-40c3-812d-f0cc37f0d578 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:14.171816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a013f62-7b78-40c3-812d-f0cc37f0d578 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:14.172929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a013f62-7b78-40c3-812d-f0cc37f0d578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:14.173383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a013f62-7b78-40c3-812d-f0cc37f0d578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:14.175569 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a013f62-7b78-40c3-812d-f0cc37f0d578 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:14.198027 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:14.205279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 11/20] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:14.244779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7d676-70ea-47db-b3d4-27d580809864 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:14.317637 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cd1e0-84d7-4a43-903f-a885e5c957e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:14.318329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cd1e0-84d7-4a43-903f-a885e5c957e5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:14.318658 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cd1e0-84d7-4a43-903f-a885e5c957e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:14.318937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cd1e0-84d7-4a43-903f-a885e5c957e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:14.319819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cd1e0-84d7-4a43-903f-a885e5c957e5 None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.domain.id=default, user.id=ab0ce7c38c274718a8fd45c535922c16) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:14.320128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cd1e0-84d7-4a43-903f-a885e5c957e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:14.321685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cd1e0-84d7-4a43-903f-a885e5c957e5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:14.332830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 10/21] 10.222.0.98 () {56 vars in 1322 bytes} [Tue Jul 26 14:54:14 2022] GET /identity/v3/role_assignments?user.id=ab0ce7c38c274718a8fd45c535922c16&scope.domain.id=default&role.id=17054492864541709fda49dbf677a7a2 => generated 233 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:54:18.299832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a6102-b44b-4f07-b005-c45a5889c6e3 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:18.300390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a6102-b44b-4f07-b005-c45a5889c6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:18.300795 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a6102-b44b-4f07-b005-c45a5889c6e3 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:18.303651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 12/22] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:18.319850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805fbc-e422-467a-a887-9244b7bd6382 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:18.320390 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805fbc-e422-467a-a887-9244b7bd6382 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:18.320893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805fbc-e422-467a-a887-9244b7bd6382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:18.366776 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ad805fbc-e422-467a-a887-9244b7bd6382 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:18.369077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ad805fbc-e422-467a-a887-9244b7bd6382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:18.461741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b459e-5820-4a3f-b931-522776b2dd06 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:18.462282 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b459e-5820-4a3f-b931-522776b2dd06 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:18.462810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b459e-5820-4a3f-b931-522776b2dd06 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:18.465641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 13/23] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:54:18.487379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59f0e3-79fc-4c31-ba1b-2e4d4a714ec1 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:18.487890 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59f0e3-79fc-4c31-ba1b-2e4d4a714ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:18.488389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59f0e3-79fc-4c31-ba1b-2e4d4a714ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:18.564007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-9c59f0e3-79fc-4c31-ba1b-2e4d4a714ec1 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:18.566120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-9c59f0e3-79fc-4c31-ba1b-2e4d4a714ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:18.653991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 11/24] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:54:18.727045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad805fbc-e422-467a-a887-9244b7bd6382 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:18.825900 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 14/25] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:54:18.943011 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59f0e3-79fc-4c31-ba1b-2e4d4a714ec1 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:18.973469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:19.077603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad805fbc-e422-467a-a887-9244b7bd6382 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:19.101726 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:19.214203 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0404a92-3505-4b0a-8bbc-fcb766c87c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:19.215661 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0404a92-3505-4b0a-8bbc-fcb766c87c2a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:19.216403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0404a92-3505-4b0a-8bbc-fcb766c87c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:19.217852 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0404a92-3505-4b0a-8bbc-fcb766c87c2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:19.257954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0404a92-3505-4b0a-8bbc-fcb766c87c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:19.262566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0404a92-3505-4b0a-8bbc-fcb766c87c2a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:19.299294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59f0e3-79fc-4c31-ba1b-2e4d4a714ec1 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:19.331395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-d0404a92-3505-4b0a-8bbc-fcb766c87c2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:54:19.331395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:19.331395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:19.331395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:19.331395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:19.331395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:19.331395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:19.331395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:19.331395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:19.331395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:19.331395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:19.331395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:19.331395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:54:19.331395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:54:19.331395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:19.333700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:19.336900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:54:19.336900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:54:19.336900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:54:19.336900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:54:19.336900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 12/26] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 608 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:19.336900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cb736-b746-4d6d-9439-97dd84eb60d9 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:19.336900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cb736-b746-4d6d-9439-97dd84eb60d9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:19.338807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cb736-b746-4d6d-9439-97dd84eb60d9 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:19.345780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 13/27] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:19.350284 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cb736-b746-4d6d-9439-97dd84eb60d9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:19.445939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac84b71-2729-40d7-8928-22af8a61894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:19.449105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac84b71-2729-40d7-8928-22af8a61894f None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:19.451788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac84b71-2729-40d7-8928-22af8a61894f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:19.452541 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac84b71-2729-40d7-8928-22af8a61894f None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:19.454491 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac84b71-2729-40d7-8928-22af8a61894f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:19.460266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac84b71-2729-40d7-8928-22af8a61894f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:19.658981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cb736-b746-4d6d-9439-97dd84eb60d9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:19.718592 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:19.735953 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e972917-4831-4d1a-a36c-de382a6a0ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:19.737040 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972917-4831-4d1a-a36c-de382a6a0ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:19.737528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972917-4831-4d1a-a36c-de382a6a0ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:19.738252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972917-4831-4d1a-a36c-de382a6a0ae6 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:19.739913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e972917-4831-4d1a-a36c-de382a6a0ae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:19.740671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e972917-4831-4d1a-a36c-de382a6a0ae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:19.743778 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e972917-4831-4d1a-a36c-de382a6a0ae6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:19.782229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 14/28] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:19.785109 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45523edf-10a6-4141-a6c9-34e01adc0601 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:19.785920 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45523edf-10a6-4141-a6c9-34e01adc0601 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:19.786685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45523edf-10a6-4141-a6c9-34e01adc0601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:19.821575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-45523edf-10a6-4141-a6c9-34e01adc0601 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:19.824428 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-45523edf-10a6-4141-a6c9-34e01adc0601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:19.885291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 15/29] 10.222.0.98 () {60 vars in 1131 bytes} [Tue Jul 26 14:54:18 2022] POST /identity/v3/roles => generated 219 bytes in 943 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:54:19.888390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50979a-4051-4002-ad4f-23dbe6121a45 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:19.889607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50979a-4051-4002-ad4f-23dbe6121a45 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:19.890645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50979a-4051-4002-ad4f-23dbe6121a45 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:19.894448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 16/30] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:19.896816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50979a-4051-4002-ad4f-23dbe6121a45 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:19.987018 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 15/31] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:19.989951 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cf8d2-f10e-41f6-84ba-59beba6c1d2e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:19.991151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cf8d2-f10e-41f6-84ba-59beba6c1d2e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:19.991883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cf8d2-f10e-41f6-84ba-59beba6c1d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:20.029892 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d88cf8d2-f10e-41f6-84ba-59beba6c1d2e None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:20.032963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d88cf8d2-f10e-41f6-84ba-59beba6c1d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:20.157340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50979a-4051-4002-ad4f-23dbe6121a45 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:20.169402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:20.187209 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 16/32] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:20.189447 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cf8d2-f10e-41f6-84ba-59beba6c1d2e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:20.234745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d0a9b-225c-4ad7-a93b-71a3d8b2650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:20.235790 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d0a9b-225c-4ad7-a93b-71a3d8b2650e None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:20.236302 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d0a9b-225c-4ad7-a93b-71a3d8b2650e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:20.236874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d0a9b-225c-4ad7-a93b-71a3d8b2650e None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:20.239960 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d0a9b-225c-4ad7-a93b-71a3d8b2650e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:20.242832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d0a9b-225c-4ad7-a93b-71a3d8b2650e None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:20.310050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:20.385365 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cf8d2-f10e-41f6-84ba-59beba6c1d2e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:20.430131 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9793373-8c7a-4bfc-bdcb-62a92f3ea124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:20.431462 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9793373-8c7a-4bfc-bdcb-62a92f3ea124 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:20.431743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9793373-8c7a-4bfc-bdcb-62a92f3ea124 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:20.432023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9793373-8c7a-4bfc-bdcb-62a92f3ea124 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:20.445572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9793373-8c7a-4bfc-bdcb-62a92f3ea124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-b9793373-8c7a-4bfc-bdcb-62a92f3ea124 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:20.451110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:20.459603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:20.461271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:20.461271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:20.461271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:20.461271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:20.461271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:20.461271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:20.461271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:20.461271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:20.461271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:20.461271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:20.461271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:54:20.461271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:54:20.461271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 17/33] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:54:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:20.461271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339d62f-3eb9-4a24-9e51-8ba24f282f5b None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:20.464636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339d62f-3eb9-4a24-9e51-8ba24f282f5b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:20.464636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339d62f-3eb9-4a24-9e51-8ba24f282f5b None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:20.464636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 18/34] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:20.464636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657853b7-8f3d-46a1-ac3e-67ad49feff7f None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:20.464636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657853b7-8f3d-46a1-ac3e-67ad49feff7f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:20.464636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657853b7-8f3d-46a1-ac3e-67ad49feff7f None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:20.464636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 19/35] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:20.465642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657853b7-8f3d-46a1-ac3e-67ad49feff7f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:20.501213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 17/36] 10.222.0.98 () {60 vars in 1141 bytes} [Tue Jul 26 14:54:19 2022] POST /identity/v3/projects => generated 301 bytes in 606 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:54:20.502930 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d0a9b-225c-4ad7-a93b-71a3d8b2650e None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:20.637191 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657853b7-8f3d-46a1-ac3e-67ad49feff7f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:20.648116 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:20.688899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcc140-a311-4caf-9c07-e6d1f427d8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:20.689750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcc140-a311-4caf-9c07-e6d1f427d8e3 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:20.690701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcc140-a311-4caf-9c07-e6d1f427d8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:20.691132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcc140-a311-4caf-9c07-e6d1f427d8e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:20.692434 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcc140-a311-4caf-9c07-e6d1f427d8e3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:20.694452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcc140-a311-4caf-9c07-e6d1f427d8e3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:20.731606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d0a9b-225c-4ad7-a93b-71a3d8b2650e None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:20.786803 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9ba13-363c-4846-9029-bc1339490566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:20.786803 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9ba13-363c-4846-9029-bc1339490566 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:20.786803 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9ba13-363c-4846-9029-bc1339490566 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:20.786803 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9ba13-363c-4846-9029-bc1339490566 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:20.787379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9ba13-363c-4846-9029-bc1339490566 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:20.787379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9ba13-363c-4846-9029-bc1339490566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:20.787379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9ba13-363c-4846-9029-bc1339490566 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:20.800816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 18/37] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:20.802150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d13c7-7fa1-4ab9-9c44-4fdf6d7185bd None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:20.802497 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d13c7-7fa1-4ab9-9c44-4fdf6d7185bd None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:20.802857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d13c7-7fa1-4ab9-9c44-4fdf6d7185bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:20.826650 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-ad6d13c7-7fa1-4ab9-9c44-4fdf6d7185bd None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:20.828401 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ad6d13c7-7fa1-4ab9-9c44-4fdf6d7185bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:20.849026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:20.942639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 20/38] 10.222.0.98 () {60 vars in 1131 bytes} [Tue Jul 26 14:54:20 2022] POST /identity/v3/roles => generated 225 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:54:20.942639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238123f-639b-416c-b5ec-d6ef99ee45e2 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:20.942639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238123f-639b-416c-b5ec-d6ef99ee45e2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:20.942639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238123f-639b-416c-b5ec-d6ef99ee45e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:20.943228 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 19/39] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:20.943228 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d13c7-7fa1-4ab9-9c44-4fdf6d7185bd None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:20.965044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3238123f-639b-416c-b5ec-d6ef99ee45e2 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:20.966759 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3238123f-639b-416c-b5ec-d6ef99ee45e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:21.073153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 21/40] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:21.075463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238123f-639b-416c-b5ec-d6ef99ee45e2 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:21.127734 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d13c7-7fa1-4ab9-9c44-4fdf6d7185bd None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:21.205565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebf9ee-4656-42ea-8d84-4840b36b1b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:21.206662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebf9ee-4656-42ea-8d84-4840b36b1b2a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:21.207157 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebf9ee-4656-42ea-8d84-4840b36b1b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:21.207650 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebf9ee-4656-42ea-8d84-4840b36b1b2a None admin] PATH_INFO: `/v3/users/ab0ce7c38c274718a8fd45c535922c16` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:21.210795 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebf9ee-4656-42ea-8d84-4840b36b1b2a None admin] RBAC: Authorizing `identity:get_user(user_id=ab0ce7c38c274718a8fd45c535922c16)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:21.214517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebf9ee-4656-42ea-8d84-4840b36b1b2a None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:21.217672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 20/41] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:20 2022] GET /identity/v3/users/ab0ce7c38c274718a8fd45c535922c16 => generated 247 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:21.219165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebf9ee-4656-42ea-8d84-4840b36b1b2a None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:21.251719 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:21.270609 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:21.280970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238123f-639b-416c-b5ec-d6ef99ee45e2 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:21.326011 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c3eba-5404-432b-a95f-2ed123067fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:21.327429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c3eba-5404-432b-a95f-2ed123067fb3 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:21.327877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c3eba-5404-432b-a95f-2ed123067fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:21.328162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c3eba-5404-432b-a95f-2ed123067fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:21.328927 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c3eba-5404-432b-a95f-2ed123067fb3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:21.330601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c3eba-5404-432b-a95f-2ed123067fb3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:21.419453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 22/42] 10.222.0.98 () {60 vars in 1131 bytes} [Tue Jul 26 14:54:21 2022] POST /identity/v3/roles => generated 223 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:54:21.420442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebf9ee-4656-42ea-8d84-4840b36b1b2a None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:21.420887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c3eba-5404-432b-a95f-2ed123067fb3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:21.493248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff278988-f81b-44d8-83d1-8e4334f0afc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:21.494491 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff278988-f81b-44d8-83d1-8e4334f0afc5 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:21.495013 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff278988-f81b-44d8-83d1-8e4334f0afc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:21.495543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff278988-f81b-44d8-83d1-8e4334f0afc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:21.497944 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff278988-f81b-44d8-83d1-8e4334f0afc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:21.500875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff278988-f81b-44d8-83d1-8e4334f0afc5 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:21.510939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 21/43] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:54:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:21.516425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff278988-f81b-44d8-83d1-8e4334f0afc5 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:21.626792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c3eba-5404-432b-a95f-2ed123067fb3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:21.668320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:21.699463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ad942-6794-4809-a4a7-9ed09b4673f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:21.699463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ad942-6794-4809-a4a7-9ed09b4673f4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:21.699463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ad942-6794-4809-a4a7-9ed09b4673f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:21.699808 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ad942-6794-4809-a4a7-9ed09b4673f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:21.704341 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff278988-f81b-44d8-83d1-8e4334f0afc5 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:21.704603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ad942-6794-4809-a4a7-9ed09b4673f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:21.704603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ad942-6794-4809-a4a7-9ed09b4673f4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:21.705571 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 23/44] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:54:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:21.714575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ad942-6794-4809-a4a7-9ed09b4673f4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:21.764806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d05fa-1a64-4019-a6be-72ab2e104612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:21.766205 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d05fa-1a64-4019-a6be-72ab2e104612 None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:21.768130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d05fa-1a64-4019-a6be-72ab2e104612 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:21.768636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d05fa-1a64-4019-a6be-72ab2e104612 None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:21.769924 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d05fa-1a64-4019-a6be-72ab2e104612 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:21.772595 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d05fa-1a64-4019-a6be-72ab2e104612 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:21.778788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:21.879051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 22/45] 10.222.0.98 () {60 vars in 1141 bytes} [Tue Jul 26 14:54:21 2022] POST /identity/v3/projects => generated 312 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:54:21.947707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ad942-6794-4809-a4a7-9ed09b4673f4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:22.027500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f3260-1bce-421a-80c1-3208dea9c0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:22.028754 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f3260-1bce-421a-80c1-3208dea9c0ed None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:22.029256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f3260-1bce-421a-80c1-3208dea9c0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:22.029823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f3260-1bce-421a-80c1-3208dea9c0ed None admin] PATH_INFO: `/v3/domains/default/users/ab0ce7c38c274718a8fd45c535922c16/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:22.033694 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f3260-1bce-421a-80c1-3208dea9c0ed None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ab0ce7c38c274718a8fd45c535922c16, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:22.036821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f3260-1bce-421a-80c1-3208dea9c0ed None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:22.147194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 24/46] 10.222.0.98 () {58 vars in 1361 bytes} [Tue Jul 26 14:54:21 2022] PUT /identity/v3/domains/default/users/ab0ce7c38c274718a8fd45c535922c16/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:54:24.347078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8de75-e2ad-4cd8-8709-33852ba62792 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:24.347646 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8de75-e2ad-4cd8-8709-33852ba62792 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:24.348082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8de75-e2ad-4cd8-8709-33852ba62792 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:24.350948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 23/47] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:24.358201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878267a-635c-418b-a208-c734b34085c9 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:24.359020 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878267a-635c-418b-a208-c734b34085c9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:24.359165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878267a-635c-418b-a208-c734b34085c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:24.381252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8878267a-635c-418b-a208-c734b34085c9 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:24.383074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8878267a-635c-418b-a208-c734b34085c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:24.460439 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2551bbe-3651-4529-ba1d-618f4c25daba None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:24.460894 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2551bbe-3651-4529-ba1d-618f4c25daba None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:24.461334 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2551bbe-3651-4529-ba1d-618f4c25daba None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:24.463802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 24/48] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:24.469906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357b61c-5a25-4785-a204-67e2c25dac9e None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:24.470216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357b61c-5a25-4785-a204-67e2c25dac9e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:24.470582 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357b61c-5a25-4785-a204-67e2c25dac9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:24.480313 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 25/49] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:54:24.490936 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d357b61c-5a25-4785-a204-67e2c25dac9e None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:24.492306 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d357b61c-5a25-4785-a204-67e2c25dac9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:24.510314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878267a-635c-418b-a208-c734b34085c9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:24.540456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:24.593583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 25/50] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:54:24.633526 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357b61c-5a25-4785-a204-67e2c25dac9e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:24.688656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878267a-635c-418b-a208-c734b34085c9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:24.729360 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:24.738421 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2e268-4815-4a17-9594-4209a012747c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:24.739544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2e268-4815-4a17-9594-4209a012747c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:24.740045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2e268-4815-4a17-9594-4209a012747c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:24.740524 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2e268-4815-4a17-9594-4209a012747c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:24.743677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2e268-4815-4a17-9594-4209a012747c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:24.746133 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2e268-4815-4a17-9594-4209a012747c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:24.757501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 26/51] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:54:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:54:24.759429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2e268-4815-4a17-9594-4209a012747c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:24.789364 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357b61c-5a25-4785-a204-67e2c25dac9e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:24.837160 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e60ba-5dd7-481f-b4a7-51526b850944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:24.837856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e60ba-5dd7-481f-b4a7-51526b850944 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:24.838144 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e60ba-5dd7-481f-b4a7-51526b850944 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:24.838452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e60ba-5dd7-481f-b4a7-51526b850944 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:24.852610 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e60ba-5dd7-481f-b4a7-51526b850944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-fc4e60ba-5dd7-481f-b4a7-51526b850944 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:24.859717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:24.864607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:24.866079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:24.866079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:24.866079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:24.866079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:24.866079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:24.866079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:24.866079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:24.866079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:24.866079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:24.866079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:24.866079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:54:24.866079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:54:24.866079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 26/52] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:54:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:54:24.869921 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e60ba-5dd7-481f-b4a7-51526b850944 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:24.888244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:24.910837 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2e268-4815-4a17-9594-4209a012747c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:24.958891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38bf77-63fe-46a2-b93a-3632d3d75f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:24.959967 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38bf77-63fe-46a2-b93a-3632d3d75f3b None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:24.960468 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38bf77-63fe-46a2-b93a-3632d3d75f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:24.960959 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38bf77-63fe-46a2-b93a-3632d3d75f3b None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:24.963397 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38bf77-63fe-46a2-b93a-3632d3d75f3b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:24.966132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38bf77-63fe-46a2-b93a-3632d3d75f3b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:25.004415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e60ba-5dd7-481f-b4a7-51526b850944 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:25.040245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:25.048927 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc94f2-e81f-4ab3-84f1-5bb14ea6fb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:25.049648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc94f2-e81f-4ab3-84f1-5bb14ea6fb9f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:25.049924 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc94f2-e81f-4ab3-84f1-5bb14ea6fb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:25.050209 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc94f2-e81f-4ab3-84f1-5bb14ea6fb9f None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:25.051021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc94f2-e81f-4ab3-84f1-5bb14ea6fb9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:25.051340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc94f2-e81f-4ab3-84f1-5bb14ea6fb9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:25.052799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc94f2-e81f-4ab3-84f1-5bb14ea6fb9f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:25.064540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 27/53] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:25.071813 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc94f2-e81f-4ab3-84f1-5bb14ea6fb9f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:25.111905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 27/54] 10.222.0.98 () {60 vars in 1140 bytes} [Tue Jul 26 14:54:24 2022] POST /identity/v3/projects => generated 298 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:54:25.230906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc94f2-e81f-4ab3-84f1-5bb14ea6fb9f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:25.282344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1401e1a-ff40-4947-a9db-9f8705c4f8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:25.283243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1401e1a-ff40-4947-a9db-9f8705c4f8aa None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:25.283617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1401e1a-ff40-4947-a9db-9f8705c4f8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:25.284056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1401e1a-ff40-4947-a9db-9f8705c4f8aa None admin] PATH_INFO: `/v3/users/ab0ce7c38c274718a8fd45c535922c16` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:25.285864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1401e1a-ff40-4947-a9db-9f8705c4f8aa None admin] RBAC: Authorizing `identity:get_user(user_id=ab0ce7c38c274718a8fd45c535922c16)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:25.288201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1401e1a-ff40-4947-a9db-9f8705c4f8aa None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:25.291394 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 28/55] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:25 2022] GET /identity/v3/users/ab0ce7c38c274718a8fd45c535922c16 => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:54:25.299013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38bf77-63fe-46a2-b93a-3632d3d75f3b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:25.444697 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38bf77-63fe-46a2-b93a-3632d3d75f3b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:25.500031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f4cc6-194e-4320-8155-94122e5a6ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:25.500831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f4cc6-194e-4320-8155-94122e5a6ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:25.501236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f4cc6-194e-4320-8155-94122e5a6ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:25.501621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f4cc6-194e-4320-8155-94122e5a6ba5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:25.503085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f4cc6-194e-4320-8155-94122e5a6ba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:25.504664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f4cc6-194e-4320-8155-94122e5a6ba5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:25.506503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 28/56] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:54:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:25.517575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1401e1a-ff40-4947-a9db-9f8705c4f8aa None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:25.607578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:25.681824 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1401e1a-ff40-4947-a9db-9f8705c4f8aa None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:25.744617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6762e08-d6a2-489e-a124-07f790d6d808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:25.745288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6762e08-d6a2-489e-a124-07f790d6d808 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:25.745582 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6762e08-d6a2-489e-a124-07f790d6d808 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:25.745925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6762e08-d6a2-489e-a124-07f790d6d808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:25.746816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6762e08-d6a2-489e-a124-07f790d6d808 None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.domain.id=default, user.id=ab0ce7c38c274718a8fd45c535922c16) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:25.747197 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6762e08-d6a2-489e-a124-07f790d6d808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:25.749108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6762e08-d6a2-489e-a124-07f790d6d808 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:25.761023 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 29/57] 10.222.0.98 () {56 vars in 1322 bytes} [Tue Jul 26 14:54:25 2022] GET /identity/v3/role_assignments?user.id=ab0ce7c38c274718a8fd45c535922c16&scope.domain.id=default&role.id=17054492864541709fda49dbf677a7a2 => generated 530 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:27.360207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380f395-a6fc-4d9f-864a-ae22df8ed1d8 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:27.360755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380f395-a6fc-4d9f-864a-ae22df8ed1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:27.360755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380f395-a6fc-4d9f-864a-ae22df8ed1d8 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:27.362196 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 29/58] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:54:27.369111 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cd68c-ade0-4dff-9489-625521026d94 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:27.369685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cd68c-ade0-4dff-9489-625521026d94 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:27.369794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cd68c-ade0-4dff-9489-625521026d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:27.392148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-2c7cd68c-ade0-4dff-9489-625521026d94 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:27.393511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2c7cd68c-ade0-4dff-9489-625521026d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:27.478831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 30/59] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:27.505439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380f395-a6fc-4d9f-864a-ae22df8ed1d8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:27.511925 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:27.631479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380f395-a6fc-4d9f-864a-ae22df8ed1d8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:27.670684 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ab833-cb5f-41ac-baeb-6fd6135054d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:27.671357 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab833-cb5f-41ac-baeb-6fd6135054d7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:27.671644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab833-cb5f-41ac-baeb-6fd6135054d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:27.671925 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab833-cb5f-41ac-baeb-6fd6135054d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:27.673189 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ab833-cb5f-41ac-baeb-6fd6135054d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:27.674734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ab833-cb5f-41ac-baeb-6fd6135054d7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:27.676478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 30/60] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:54:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:54:27.683784 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cd68c-ade0-4dff-9489-625521026d94 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:27.751375 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:27.807014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cd68c-ade0-4dff-9489-625521026d94 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:27.850000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d53af4-f71f-461d-919d-cba8510f2d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:27.850916 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d53af4-f71f-461d-919d-cba8510f2d9d None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:27.851249 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d53af4-f71f-461d-919d-cba8510f2d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:27.851534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d53af4-f71f-461d-919d-cba8510f2d9d None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:27.852900 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d53af4-f71f-461d-919d-cba8510f2d9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:27.854539 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d53af4-f71f-461d-919d-cba8510f2d9d None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:27.966870 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 31/61] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:54:27 2022] POST /identity/v3/users => generated 275 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:54:31.474576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50bd66-9dc0-4601-a94a-1b8d91a04932 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:31.475681 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50bd66-9dc0-4601-a94a-1b8d91a04932 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:31.476427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50bd66-9dc0-4601-a94a-1b8d91a04932 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:31.478997 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 31/62] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:31.484641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d599f-45a7-4571-b174-9856963b7ccc None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:31.485656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d599f-45a7-4571-b174-9856963b7ccc None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:31.486159 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d599f-45a7-4571-b174-9856963b7ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:31.516962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-852d599f-45a7-4571-b174-9856963b7ccc None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:31.518448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-852d599f-45a7-4571-b174-9856963b7ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:31.648888 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 32/63] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:31.659017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e044b-373f-4d40-86be-8bbd719e0fa3 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:31.659652 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e044b-373f-4d40-86be-8bbd719e0fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:31.660139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e044b-373f-4d40-86be-8bbd719e0fa3 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:31.661786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 32/64] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:31.668263 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d53c3-bd62-4fce-806b-b9801e8adc16 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:31.668561 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d53c3-bd62-4fce-806b-b9801e8adc16 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:31.668852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d53c3-bd62-4fce-806b-b9801e8adc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:31.673684 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e044b-373f-4d40-86be-8bbd719e0fa3 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:31.703930 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-866d53c3-bd62-4fce-806b-b9801e8adc16 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:31.705567 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-866d53c3-bd62-4fce-806b-b9801e8adc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:31.771532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:31.834756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:31.856173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 33/65] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:31.888443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e044b-373f-4d40-86be-8bbd719e0fa3 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:31.911627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d53c3-bd62-4fce-806b-b9801e8adc16 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:31.973203 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75b0bb-0746-400c-aab0-67808f9d9fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:31.974752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75b0bb-0746-400c-aab0-67808f9d9fde None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:31.975530 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75b0bb-0746-400c-aab0-67808f9d9fde None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:31.976290 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75b0bb-0746-400c-aab0-67808f9d9fde None admin] PATH_INFO: `/v3/roles/member` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:32.005796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75b0bb-0746-400c-aab0-67808f9d9fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-5f75b0bb-0746-400c-aab0-67808f9d9fde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:32.025053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:32.026047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:32.026843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:32.026843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:32.026843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:32.026843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:32.026843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:32.026843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:32.026843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:32.026843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:32.026843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:32.026843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:32.026843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:54:32.026843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:54:32.035832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 33/66] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:32.045398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75b0bb-0746-400c-aab0-67808f9d9fde None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:32.076121 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d53c3-bd62-4fce-806b-b9801e8adc16 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:32.140602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188987d-6985-4a48-b5af-dc0466edc004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:32.141278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188987d-6985-4a48-b5af-dc0466edc004 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:32.141561 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188987d-6985-4a48-b5af-dc0466edc004 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:32.141836 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188987d-6985-4a48-b5af-dc0466edc004 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:32.162710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188987d-6985-4a48-b5af-dc0466edc004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-b188987d-6985-4a48-b5af-dc0466edc004 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:32.180256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:32.181698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:32.182940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:32.182940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:32.182940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:32.182940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:32.182940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:32.182940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:32.182940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:32.182940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:32.182940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:32.182940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:32.182940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:54:32.182940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:54:32.182940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 34/67] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:54:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:32.195673 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188987d-6985-4a48-b5af-dc0466edc004 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:32.259193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:32.321963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75b0bb-0746-400c-aab0-67808f9d9fde None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:32.339687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188987d-6985-4a48-b5af-dc0466edc004 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:32.381896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd48cf6-0d88-4e57-965f-e74b16de9abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:32.383208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:32.383442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd48cf6-0d88-4e57-965f-e74b16de9abd None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:32.383777 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd48cf6-0d88-4e57-965f-e74b16de9abd None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:32.384166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd48cf6-0d88-4e57-965f-e74b16de9abd None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:32.385188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd48cf6-0d88-4e57-965f-e74b16de9abd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:32.385310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd48cf6-0d88-4e57-965f-e74b16de9abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:32.386903 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd48cf6-0d88-4e57-965f-e74b16de9abd None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:32.391274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefba8b-bd04-4365-8fc4-b4be15cc138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:32.397019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefba8b-bd04-4365-8fc4-b4be15cc138c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:32.397019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefba8b-bd04-4365-8fc4-b4be15cc138c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:32.397019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefba8b-bd04-4365-8fc4-b4be15cc138c None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:32.397019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefba8b-bd04-4365-8fc4-b4be15cc138c None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:32.397019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefba8b-bd04-4365-8fc4-b4be15cc138c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:32.397019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefba8b-bd04-4365-8fc4-b4be15cc138c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:32.397698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 35/68] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:32.398770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4288699-589a-40d7-9b67-ede695c72d0f None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:32.399064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4288699-589a-40d7-9b67-ede695c72d0f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:32.399347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4288699-589a-40d7-9b67-ede695c72d0f None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:32.401163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 36/69] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:32.412591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4f5cf-8ca7-4b48-a2dc-c102dfd28924 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:32.413114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4f5cf-8ca7-4b48-a2dc-c102dfd28924 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:32.413620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4f5cf-8ca7-4b48-a2dc-c102dfd28924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:32.415022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 34/70] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:54:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:32.416424 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefba8b-bd04-4365-8fc4-b4be15cc138c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:32.449405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-6ac4f5cf-8ca7-4b48-a2dc-c102dfd28924 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:32.451267 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6ac4f5cf-8ca7-4b48-a2dc-c102dfd28924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:32.583100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 37/71] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:32.584058 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4f5cf-8ca7-4b48-a2dc-c102dfd28924 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:32.611463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefba8b-bd04-4365-8fc4-b4be15cc138c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:32.617970 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:32.676668 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25387a-120b-4186-a4a0-b11bc7df1d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:32.677414 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25387a-120b-4186-a4a0-b11bc7df1d12 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:32.677700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25387a-120b-4186-a4a0-b11bc7df1d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:32.678128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25387a-120b-4186-a4a0-b11bc7df1d12 None admin] PATH_INFO: `/v3/users/ab0ce7c38c274718a8fd45c535922c16` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:32.680773 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25387a-120b-4186-a4a0-b11bc7df1d12 None admin] RBAC: Authorizing `identity:get_user(user_id=ab0ce7c38c274718a8fd45c535922c16)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:32.682504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25387a-120b-4186-a4a0-b11bc7df1d12 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:32.684378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 35/72] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:32 2022] GET /identity/v3/users/ab0ce7c38c274718a8fd45c535922c16 => generated 247 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:32.692032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b351bfd-8d57-42d8-bee9-8ece7ea04a72 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:32.692032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b351bfd-8d57-42d8-bee9-8ece7ea04a72 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:32.692032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b351bfd-8d57-42d8-bee9-8ece7ea04a72 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:32.692032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 36/73] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:32.692032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b351bfd-8d57-42d8-bee9-8ece7ea04a72 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:32.763354 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:32.763826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4f5cf-8ca7-4b48-a2dc-c102dfd28924 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:32.820897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b351bfd-8d57-42d8-bee9-8ece7ea04a72 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:32.828143 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea57350-bea2-4703-b20c-b5f1fea9c2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:32.829170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea57350-bea2-4703-b20c-b5f1fea9c2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:32.829629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea57350-bea2-4703-b20c-b5f1fea9c2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:32.830096 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea57350-bea2-4703-b20c-b5f1fea9c2e1 None admin] PATH_INFO: `/v3/users/2a32a15f2a584ef0acafa1e4cd085d71` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:32.851108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea57350-bea2-4703-b20c-b5f1fea9c2e1 None admin] RBAC: Authorizing `identity:get_user(user_id=2a32a15f2a584ef0acafa1e4cd085d71)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:32.852686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea57350-bea2-4703-b20c-b5f1fea9c2e1 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:32.854692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 38/74] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:32 2022] GET /identity/v3/users/2a32a15f2a584ef0acafa1e4cd085d71 => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:32.860802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a256ee7-4413-4946-94fa-50a7b58be17e None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:32.860802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a256ee7-4413-4946-94fa-50a7b58be17e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:32.860802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a256ee7-4413-4946-94fa-50a7b58be17e None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:32.860802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 39/75] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:32.860802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a256ee7-4413-4946-94fa-50a7b58be17e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:32.876872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ad074-41ca-47aa-93ec-82bc374b9fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:32.877701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ad074-41ca-47aa-93ec-82bc374b9fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:32.878113 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ad074-41ca-47aa-93ec-82bc374b9fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:32.878621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ad074-41ca-47aa-93ec-82bc374b9fa6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:32.898577 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ad074-41ca-47aa-93ec-82bc374b9fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-905ad074-41ca-47aa-93ec-82bc374b9fa6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:32.908464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:32.910092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:32.911626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:32.911626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:32.911626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:32.911626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:32.911626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:32.911626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:32.911626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:32.911626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:32.911626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:32.911626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:32.911626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:54:32.911626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:54:32.911626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 37/76] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:32.913022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdcb32-3b02-4cad-bb47-e53f0d2b9b54 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:32.913367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdcb32-3b02-4cad-bb47-e53f0d2b9b54 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:32.913910 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdcb32-3b02-4cad-bb47-e53f0d2b9b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:32.940338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3cfdcb32-3b02-4cad-bb47-e53f0d2b9b54 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:32.941661 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3cfdcb32-3b02-4cad-bb47-e53f0d2b9b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:32.981135 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:33.025310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a256ee7-4413-4946-94fa-50a7b58be17e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:33.031160 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 38/77] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:33.032104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdcb32-3b02-4cad-bb47-e53f0d2b9b54 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:33.082794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4341982-1501-43d1-a3ac-1ce26e7c1811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:33.083450 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4341982-1501-43d1-a3ac-1ce26e7c1811 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:33.083742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4341982-1501-43d1-a3ac-1ce26e7c1811 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:33.084025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4341982-1501-43d1-a3ac-1ce26e7c1811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:33.122721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:33.198597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4341982-1501-43d1-a3ac-1ce26e7c1811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:33.201109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4341982-1501-43d1-a3ac-1ce26e7c1811 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:33.210575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdcb32-3b02-4cad-bb47-e53f0d2b9b54 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:33.271936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84c1db-36a1-4368-a05e-f0cfc9b4f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:33.273634 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84c1db-36a1-4368-a05e-f0cfc9b4f51e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:33.274344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84c1db-36a1-4368-a05e-f0cfc9b4f51e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:33.274881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84c1db-36a1-4368-a05e-f0cfc9b4f51e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:33.321927 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:33.352343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 40/78] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:54:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:33.354113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a94d6-6493-43fb-be10-396ed63fd2a7 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:33.354642 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a94d6-6493-43fb-be10-396ed63fd2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:33.355117 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a94d6-6493-43fb-be10-396ed63fd2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:33.379530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-2b0a94d6-6493-43fb-be10-396ed63fd2a7 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:33.381505 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2b0a94d6-6493-43fb-be10-396ed63fd2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:33.393614 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84c1db-36a1-4368-a05e-f0cfc9b4f51e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:33.396026 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84c1db-36a1-4368-a05e-f0cfc9b4f51e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:33.478116 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:33.504348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 41/79] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:33.504348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a94d6-6493-43fb-be10-396ed63fd2a7 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:33.579237 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 39/80] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:54:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:33.580165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84c1db-36a1-4368-a05e-f0cfc9b4f51e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:33.650708 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a94d6-6493-43fb-be10-396ed63fd2a7 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:33.671021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:33.703843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f43508-ca7a-4828-81e6-96cc9d7e628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:33.704663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f43508-ca7a-4828-81e6-96cc9d7e628a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:33.705063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f43508-ca7a-4828-81e6-96cc9d7e628a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:33.705455 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f43508-ca7a-4828-81e6-96cc9d7e628a None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:33.706443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f43508-ca7a-4828-81e6-96cc9d7e628a None admin] RBAC: Adding query filter params (name=member) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:33.706906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f43508-ca7a-4828-81e6-96cc9d7e628a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:33.708743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f43508-ca7a-4828-81e6-96cc9d7e628a None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:33.721518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84c1db-36a1-4368-a05e-f0cfc9b4f51e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:33.728757 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 42/81] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:54:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:33.731460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f43508-ca7a-4828-81e6-96cc9d7e628a None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:33.773004 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f7e4d-5a9a-4489-9396-baa7bc7c0290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:33.774481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f7e4d-5a9a-4489-9396-baa7bc7c0290 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:33.774900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f7e4d-5a9a-4489-9396-baa7bc7c0290 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:33.775174 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f7e4d-5a9a-4489-9396-baa7bc7c0290 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:33.789455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f7e4d-5a9a-4489-9396-baa7bc7c0290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-7e3f7e4d-5a9a-4489-9396-baa7bc7c0290 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:33.794804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:33.796449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:33.798007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:33.798007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:33.798007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:33.798007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:33.798007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:33.798007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:33.798007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:33.798007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:33.798007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:33.798007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:33.798007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:54:33.798007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:54:33.798007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 40/82] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:54:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:33.798007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f7e4d-5a9a-4489-9396-baa7bc7c0290 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:33.817877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:33.891760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f43508-ca7a-4828-81e6-96cc9d7e628a None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:33.945294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff029a70-5348-490f-af9f-28b267381490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:33.945882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff029a70-5348-490f-af9f-28b267381490 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:33.946200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff029a70-5348-490f-af9f-28b267381490 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:33.946517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff029a70-5348-490f-af9f-28b267381490 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:33.947833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff029a70-5348-490f-af9f-28b267381490 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:33.949427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff029a70-5348-490f-af9f-28b267381490 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:33.951270 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 43/83] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:33 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:33.952089 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff029a70-5348-490f-af9f-28b267381490 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:33.961542 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f7e4d-5a9a-4489-9396-baa7bc7c0290 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:34.001766 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:34.031203 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868f7f9-b20c-424b-ab5f-be5056357fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:34.031879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868f7f9-b20c-424b-ab5f-be5056357fef None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:34.032167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868f7f9-b20c-424b-ab5f-be5056357fef None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:34.032446 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868f7f9-b20c-424b-ab5f-be5056357fef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:34.033695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868f7f9-b20c-424b-ab5f-be5056357fef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:34.035422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868f7f9-b20c-424b-ab5f-be5056357fef None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:34.037298 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 41/84] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:54:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:34.043465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868f7f9-b20c-424b-ab5f-be5056357fef None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:34.090184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff029a70-5348-490f-af9f-28b267381490 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:34.139154 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c076a-3f6c-44e8-8020-6e69dc008539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:34.140049 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c076a-3f6c-44e8-8020-6e69dc008539 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:34.140479 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c076a-3f6c-44e8-8020-6e69dc008539 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:34.140831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c076a-3f6c-44e8-8020-6e69dc008539 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:34.142538 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c076a-3f6c-44e8-8020-6e69dc008539 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:34.144316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c076a-3f6c-44e8-8020-6e69dc008539 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:34.146602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 44/85] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:33 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:34.147672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c076a-3f6c-44e8-8020-6e69dc008539 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:34.169165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:34.203589 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868f7f9-b20c-424b-ab5f-be5056357fef None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:34.248271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803a67a-eb0c-41a6-9940-6e7e537a77a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:34.249035 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803a67a-eb0c-41a6-9940-6e7e537a77a2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:34.249386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803a67a-eb0c-41a6-9940-6e7e537a77a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:34.249739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803a67a-eb0c-41a6-9940-6e7e537a77a2 None admin] PATH_INFO: `/v3/users/2a32a15f2a584ef0acafa1e4cd085d71` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:34.251506 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803a67a-eb0c-41a6-9940-6e7e537a77a2 None admin] RBAC: Authorizing `identity:get_user(user_id=2a32a15f2a584ef0acafa1e4cd085d71)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:34.253235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803a67a-eb0c-41a6-9940-6e7e537a77a2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:34.255208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 42/86] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:34 2022] GET /identity/v3/users/2a32a15f2a584ef0acafa1e4cd085d71 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:34.256325 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803a67a-eb0c-41a6-9940-6e7e537a77a2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:34.297348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c076a-3f6c-44e8-8020-6e69dc008539 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:34.308535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:34.345920 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ebb5b-13fe-4033-adb4-3423712efae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:34.347150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ebb5b-13fe-4033-adb4-3423712efae5 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:34.347545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ebb5b-13fe-4033-adb4-3423712efae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:34.347933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ebb5b-13fe-4033-adb4-3423712efae5 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:34.348804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ebb5b-13fe-4033-adb4-3423712efae5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:34.349207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ebb5b-13fe-4033-adb4-3423712efae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:34.350995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ebb5b-13fe-4033-adb4-3423712efae5 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:34.363831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 45/87] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:54:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:34.365309 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ebb5b-13fe-4033-adb4-3423712efae5 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:34.441369 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803a67a-eb0c-41a6-9940-6e7e537a77a2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:34.517340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b2666-cd78-4774-a6bf-e96713a8771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:34.518241 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b2666-cd78-4774-a6bf-e96713a8771d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:34.518717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b2666-cd78-4774-a6bf-e96713a8771d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:34.519123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b2666-cd78-4774-a6bf-e96713a8771d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:34.520124 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b2666-cd78-4774-a6bf-e96713a8771d None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=d8b578718bf04a31bc5b638315420654, user.id=ab0ce7c38c274718a8fd45c535922c16) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:34.520590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b2666-cd78-4774-a6bf-e96713a8771d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:34.522252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b2666-cd78-4774-a6bf-e96713a8771d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:34.522475 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ebb5b-13fe-4033-adb4-3423712efae5 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:34.530194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 43/88] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:54:34 2022] GET /identity/v3/role_assignments?user.id=ab0ce7c38c274718a8fd45c535922c16&scope.project.id=d8b578718bf04a31bc5b638315420654&role.id=17054492864541709fda49dbf677a7a2 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:34.531326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b2666-cd78-4774-a6bf-e96713a8771d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:34.550992 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:34.589630 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a5b23-5c5d-4c01-be76-fe52ceb40bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:34.590303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a5b23-5c5d-4c01-be76-fe52ceb40bdb None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:34.590658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a5b23-5c5d-4c01-be76-fe52ceb40bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:34.590950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a5b23-5c5d-4c01-be76-fe52ceb40bdb None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:34.591688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a5b23-5c5d-4c01-be76-fe52ceb40bdb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:34.593264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a5b23-5c5d-4c01-be76-fe52ceb40bdb None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:34.692513 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 46/89] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:54:34 2022] POST /identity/v3/users => generated 289 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:54:34.694076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a5b23-5c5d-4c01-be76-fe52ceb40bdb None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:34.700701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b2666-cd78-4774-a6bf-e96713a8771d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:34.768717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a6ea9-9c17-4475-b5fe-d78ce6eb6507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:34.769637 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a6ea9-9c17-4475-b5fe-d78ce6eb6507 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:34.770047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a6ea9-9c17-4475-b5fe-d78ce6eb6507 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:34.770505 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a6ea9-9c17-4475-b5fe-d78ce6eb6507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:34.772729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a6ea9-9c17-4475-b5fe-d78ce6eb6507 None admin] RBAC: Adding query filter params (role.id=7555aed6a21441208a17dedef685336f, scope.project.id=d8b578718bf04a31bc5b638315420654, user.id=2a32a15f2a584ef0acafa1e4cd085d71) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:34.775582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a6ea9-9c17-4475-b5fe-d78ce6eb6507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:34.778437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a6ea9-9c17-4475-b5fe-d78ce6eb6507 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:34.778772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:34.798402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 44/90] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:54:34 2022] GET /identity/v3/role_assignments?user.id=2a32a15f2a584ef0acafa1e4cd085d71&scope.project.id=d8b578718bf04a31bc5b638315420654&role.id=7555aed6a21441208a17dedef685336f => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:34.798402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a6ea9-9c17-4475-b5fe-d78ce6eb6507 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:34.985016 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a5b23-5c5d-4c01-be76-fe52ceb40bdb None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:35.011231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:35.063041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff0777-e56b-4e32-9c6d-f690836b2440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:35.063602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff0777-e56b-4e32-9c6d-f690836b2440 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:35.063906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff0777-e56b-4e32-9c6d-f690836b2440 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:35.064188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff0777-e56b-4e32-9c6d-f690836b2440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:35.081609 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a6ea9-9c17-4475-b5fe-d78ce6eb6507 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:35.156629 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd4425-2f98-484f-b58c-4cf17d0733e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:35.158040 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4425-2f98-484f-b58c-4cf17d0733e9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:35.158651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4425-2f98-484f-b58c-4cf17d0733e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:35.159221 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4425-2f98-484f-b58c-4cf17d0733e9 None admin] PATH_INFO: `/v3/users/2a32a15f2a584ef0acafa1e4cd085d71` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:35.161577 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd4425-2f98-484f-b58c-4cf17d0733e9 None admin] RBAC: Authorizing `identity:get_user(user_id=2a32a15f2a584ef0acafa1e4cd085d71)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:35.165321 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd4425-2f98-484f-b58c-4cf17d0733e9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:35.168108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff0777-e56b-4e32-9c6d-f690836b2440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:35.168286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 45/91] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:34 2022] GET /identity/v3/users/2a32a15f2a584ef0acafa1e4cd085d71 => generated 275 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:35.170319 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff0777-e56b-4e32-9c6d-f690836b2440 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:35.177733 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd4425-2f98-484f-b58c-4cf17d0733e9 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:35.214220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:35.321387 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 47/92] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:54:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:35.327403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff0777-e56b-4e32-9c6d-f690836b2440 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:35.412672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd4425-2f98-484f-b58c-4cf17d0733e9 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:35.495479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabd5f8-f2af-450e-b9c1-31075c1a18c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:35.503374 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabd5f8-f2af-450e-b9c1-31075c1a18c5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:35.503374 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabd5f8-f2af-450e-b9c1-31075c1a18c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:35.503374 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabd5f8-f2af-450e-b9c1-31075c1a18c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:35.533370 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:35.542247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff0777-e56b-4e32-9c6d-f690836b2440 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:35.634769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:35.691019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9b425-8991-4e5a-9818-66e973d0eb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:35.692137 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9b425-8991-4e5a-9818-66e973d0eb94 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:35.694068 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9b425-8991-4e5a-9818-66e973d0eb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:35.696169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9b425-8991-4e5a-9818-66e973d0eb94 None admin] PATH_INFO: `/v3/projects/ef6148b502084d8d8e5238b168bcf198` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:35.697433 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9b425-8991-4e5a-9818-66e973d0eb94 None admin] RBAC: Authorizing `identity:get_project(project_id=ef6148b502084d8d8e5238b168bcf198)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:35.700228 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9b425-8991-4e5a-9818-66e973d0eb94 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:35.718882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 48/93] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:35 2022] GET /identity/v3/projects/ef6148b502084d8d8e5238b168bcf198 => generated 312 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:35.722582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabd5f8-f2af-450e-b9c1-31075c1a18c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:35.725371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabd5f8-f2af-450e-b9c1-31075c1a18c5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:35.728807 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9b425-8991-4e5a-9818-66e973d0eb94 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:36.021133 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9b425-8991-4e5a-9818-66e973d0eb94 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:36.094304 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27326e-19dd-4a05-a6a6-75149f2a1da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:36.095842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27326e-19dd-4a05-a6a6-75149f2a1da4 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:36.096613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27326e-19dd-4a05-a6a6-75149f2a1da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:36.097364 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27326e-19dd-4a05-a6a6-75149f2a1da4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:36.099219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27326e-19dd-4a05-a6a6-75149f2a1da4 None admin] RBAC: Adding query filter params (role.id=7555aed6a21441208a17dedef685336f, scope.project.id=ef6148b502084d8d8e5238b168bcf198, user.id=2a32a15f2a584ef0acafa1e4cd085d71) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:36.100060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27326e-19dd-4a05-a6a6-75149f2a1da4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:36.103894 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27326e-19dd-4a05-a6a6-75149f2a1da4 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:36.115062 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 49/94] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:54:35 2022] GET /identity/v3/role_assignments?user.id=2a32a15f2a584ef0acafa1e4cd085d71&scope.project.id=ef6148b502084d8d8e5238b168bcf198&role.id=7555aed6a21441208a17dedef685336f => generated 259 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:54:36.122396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 46/95] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:54:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 944 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:54:36.127897 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27326e-19dd-4a05-a6a6-75149f2a1da4 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:36.291450 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:36.402659 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27326e-19dd-4a05-a6a6-75149f2a1da4 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:36.484464 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000add0a-d2e6-4241-b198-ff7ca436ec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:36.485614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000add0a-d2e6-4241-b198-ff7ca436ec94 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:36.486125 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000add0a-d2e6-4241-b198-ff7ca436ec94 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:36.486759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000add0a-d2e6-4241-b198-ff7ca436ec94 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:36.496108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000add0a-d2e6-4241-b198-ff7ca436ec94 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:36.499202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000add0a-d2e6-4241-b198-ff7ca436ec94 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:36.503324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 50/96] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:36 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:36.515631 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabd5f8-f2af-450e-b9c1-31075c1a18c5 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:36.608017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:36.704305 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabd5f8-f2af-450e-b9c1-31075c1a18c5 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:36.769343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095cc53-0dd7-4d0b-8ac7-2a11740c0869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:36.770002 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095cc53-0dd7-4d0b-8ac7-2a11740c0869 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:36.770296 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095cc53-0dd7-4d0b-8ac7-2a11740c0869 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:36.770607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095cc53-0dd7-4d0b-8ac7-2a11740c0869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:36.771599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095cc53-0dd7-4d0b-8ac7-2a11740c0869 None admin] RBAC: Adding query filter params (role.id=3b3abbcf8ee04f0387cfdede5812d226, scope.project.id=d8b578718bf04a31bc5b638315420654, user.id=2a32a15f2a584ef0acafa1e4cd085d71) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:36.771997 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095cc53-0dd7-4d0b-8ac7-2a11740c0869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:36.774168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095cc53-0dd7-4d0b-8ac7-2a11740c0869 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:36.787771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 47/97] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:54:36 2022] GET /identity/v3/role_assignments?user.id=2a32a15f2a584ef0acafa1e4cd085d71&scope.project.id=d8b578718bf04a31bc5b638315420654&role.id=3b3abbcf8ee04f0387cfdede5812d226 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:38.840076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5bce7-78a8-4e91-9615-d3c63a802d79 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:38.840805 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5bce7-78a8-4e91-9615-d3c63a802d79 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:38.840946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5bce7-78a8-4e91-9615-d3c63a802d79 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:38.844070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 51/98] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:38.853363 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fdcc7-daac-4d0e-9b71-8ed98d9dbec5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:38.854093 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fdcc7-daac-4d0e-9b71-8ed98d9dbec5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:38.854386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fdcc7-daac-4d0e-9b71-8ed98d9dbec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:38.896263 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-bf7fdcc7-daac-4d0e-9b71-8ed98d9dbec5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:38.899239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bf7fdcc7-daac-4d0e-9b71-8ed98d9dbec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:39.063016 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 48/99] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:39.068119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01265567-32d6-4222-a0a4-829e2b1ede28 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:39.068636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01265567-32d6-4222-a0a4-829e2b1ede28 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:39.069167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01265567-32d6-4222-a0a4-829e2b1ede28 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:39.079205 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 52/100] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:39.086651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181daf3-216d-4489-be66-046066b7330e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:39.087158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181daf3-216d-4489-be66-046066b7330e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:39.087671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181daf3-216d-4489-be66-046066b7330e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:39.132883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-0181daf3-216d-4489-be66-046066b7330e None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:39.135123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0181daf3-216d-4489-be66-046066b7330e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:39.138144 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01265567-32d6-4222-a0a4-829e2b1ede28 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:39.206685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:39.305508 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 49/101] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:39.353097 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181daf3-216d-4489-be66-046066b7330e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:39.492554 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01265567-32d6-4222-a0a4-829e2b1ede28 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:39.575853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:39.602760 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181daf3-216d-4489-be66-046066b7330e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:39.612681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b7575-63d8-467a-8731-dbd882da48b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:39.613862 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b7575-63d8-467a-8731-dbd882da48b1 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:39.614341 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b7575-63d8-467a-8731-dbd882da48b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:39.614867 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b7575-63d8-467a-8731-dbd882da48b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:39.650663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b7575-63d8-467a-8731-dbd882da48b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-af8b7575-63d8-467a-8731-dbd882da48b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:39.662220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:39.665854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:39.675578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:39.675578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:39.675578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:39.675578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:39.675578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:39.675578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:39.675578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:39.675578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:39.675578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:39.675578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:39.675578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:54:39.675578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:54:39.675578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 53/102] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 528 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:39.675578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b86b69-be4f-4932-904d-843748bfb48a None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:39.679086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b86b69-be4f-4932-904d-843748bfb48a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:39.679086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b86b69-be4f-4932-904d-843748bfb48a None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:39.679086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 54/103] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:39.682672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b86b69-be4f-4932-904d-843748bfb48a None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:39.714131 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29388124-906e-4284-970e-6e7714a64889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:39.715999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29388124-906e-4284-970e-6e7714a64889 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:39.716793 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29388124-906e-4284-970e-6e7714a64889 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:39.717684 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29388124-906e-4284-970e-6e7714a64889 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:39.740456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29388124-906e-4284-970e-6e7714a64889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-29388124-906e-4284-970e-6e7714a64889 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:39.751463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:39.753084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:39.754616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:39.754616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:39.754616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:39.754616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:39.754616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:39.754616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:39.754616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:39.754616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:39.754616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:39.754616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:39.754616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:54:39.754616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:54:39.759698 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 50/104] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:54:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:39.769499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92045781-f93b-4270-8338-a6cd656c6119 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:39.770378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92045781-f93b-4270-8338-a6cd656c6119 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:39.771150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92045781-f93b-4270-8338-a6cd656c6119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:39.815003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-92045781-f93b-4270-8338-a6cd656c6119 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:39.820680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-92045781-f93b-4270-8338-a6cd656c6119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:39.914402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:40.114502 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 51/105] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:40.115887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92045781-f93b-4270-8338-a6cd656c6119 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:40.167150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b86b69-be4f-4932-904d-843748bfb48a None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:40.327499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb443f-df65-481f-9c46-a65387d74aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:40.328570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb443f-df65-481f-9c46-a65387d74aab None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:40.334413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb443f-df65-481f-9c46-a65387d74aab None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:40.334413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb443f-df65-481f-9c46-a65387d74aab None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:40.334413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb443f-df65-481f-9c46-a65387d74aab None admin] RBAC: Adding query filter params (name=member) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:40.334413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb443f-df65-481f-9c46-a65387d74aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:40.334413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb443f-df65-481f-9c46-a65387d74aab None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:40.361204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 55/106] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:54:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 682 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:40.363260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb443f-df65-481f-9c46-a65387d74aab None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:40.465584 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92045781-f93b-4270-8338-a6cd656c6119 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:40.483919 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:40.541869 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77f581-3776-4e95-8711-688378483d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:40.542931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77f581-3776-4e95-8711-688378483d8c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:40.543312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77f581-3776-4e95-8711-688378483d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:40.543718 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77f581-3776-4e95-8711-688378483d8c None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:40.545235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77f581-3776-4e95-8711-688378483d8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:40.545805 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77f581-3776-4e95-8711-688378483d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:40.549456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77f581-3776-4e95-8711-688378483d8c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:40.567868 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 52/107] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:40.571529 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08a955-15e8-418c-96b7-096e23d400b7 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:40.572082 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08a955-15e8-418c-96b7-096e23d400b7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:40.572582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08a955-15e8-418c-96b7-096e23d400b7 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:40.576913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 53/108] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:40.579666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c30d0-2255-4947-979d-2febdee87e29 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:40.580166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c30d0-2255-4947-979d-2febdee87e29 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:40.580657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c30d0-2255-4947-979d-2febdee87e29 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:40.584828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 54/109] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:40.586936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c30d0-2255-4947-979d-2febdee87e29 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:40.628183 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb443f-df65-481f-9c46-a65387d74aab None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:40.634060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:40.723780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865b3b7-de11-44fd-8f01-b0eef1eb1536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:40.726293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865b3b7-de11-44fd-8f01-b0eef1eb1536 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:40.727242 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865b3b7-de11-44fd-8f01-b0eef1eb1536 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:40.727915 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865b3b7-de11-44fd-8f01-b0eef1eb1536 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:40.753316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865b3b7-de11-44fd-8f01-b0eef1eb1536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-6865b3b7-de11-44fd-8f01-b0eef1eb1536 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:40.764664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:40.766204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:40.778883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:40.778883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:40.778883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:40.778883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:40.778883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:40.778883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:40.778883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:40.778883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:40.778883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:40.778883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:40.778883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:54:40.778883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:54:40.778883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 56/110] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:40.778883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865b3b7-de11-44fd-8f01-b0eef1eb1536 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:40.841372 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c30d0-2255-4947-979d-2febdee87e29 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:40.895412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254ea7b-1260-4e8c-9c25-5c412a217ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:40.896282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ea7b-1260-4e8c-9c25-5c412a217ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:40.896654 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ea7b-1260-4e8c-9c25-5c412a217ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:40.896989 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ea7b-1260-4e8c-9c25-5c412a217ee4 None admin] PATH_INFO: `/v3/users/2a32a15f2a584ef0acafa1e4cd085d71` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:40.899571 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254ea7b-1260-4e8c-9c25-5c412a217ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=2a32a15f2a584ef0acafa1e4cd085d71)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:40.901323 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254ea7b-1260-4e8c-9c25-5c412a217ee4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:40.903227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 55/111] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:40 2022] GET /identity/v3/users/2a32a15f2a584ef0acafa1e4cd085d71 => generated 275 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:40.904736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a4fe6-7ef2-463e-aab6-308fcce84e45 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:40.905099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a4fe6-7ef2-463e-aab6-308fcce84e45 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:40.905424 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a4fe6-7ef2-463e-aab6-308fcce84e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:40.936140 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ca0a4fe6-7ef2-463e-aab6-308fcce84e45 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:40.938067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ca0a4fe6-7ef2-463e-aab6-308fcce84e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:40.970925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865b3b7-de11-44fd-8f01-b0eef1eb1536 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:40.982756 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:41.015382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a11a-748b-4c59-a7c4-304c4e76ed72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:41.016375 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a11a-748b-4c59-a7c4-304c4e76ed72 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:41.016648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a11a-748b-4c59-a7c4-304c4e76ed72 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:41.016926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a11a-748b-4c59-a7c4-304c4e76ed72 None admin] PATH_INFO: `/v3/users/ab0ce7c38c274718a8fd45c535922c16` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:41.018277 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8a11a-748b-4c59-a7c4-304c4e76ed72 None admin] RBAC: Authorizing `identity:get_user(user_id=ab0ce7c38c274718a8fd45c535922c16)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:41.020175 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8a11a-748b-4c59-a7c4-304c4e76ed72 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:41.021969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 57/112] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:40 2022] GET /identity/v3/users/ab0ce7c38c274718a8fd45c535922c16 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:41.023810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddfc21-ef3e-4ae6-b2b8-d6a1ee68dc2e None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:41.024099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddfc21-ef3e-4ae6-b2b8-d6a1ee68dc2e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:41.024374 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddfc21-ef3e-4ae6-b2b8-d6a1ee68dc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:41.045784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 56/113] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:41.046671 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-c3ddfc21-ef3e-4ae6-b2b8-d6a1ee68dc2e None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:41.047612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a4fe6-7ef2-463e-aab6-308fcce84e45 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:41.047974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c3ddfc21-ef3e-4ae6-b2b8-d6a1ee68dc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:41.079591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:41.132466 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 58/114] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:41.134256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23846fb4-715f-466b-852a-99d1c74872a8 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:41.134256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23846fb4-715f-466b-852a-99d1c74872a8 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:41.134601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23846fb4-715f-466b-852a-99d1c74872a8 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:41.135707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 59/115] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:41.136454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23846fb4-715f-466b-852a-99d1c74872a8 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:41.206183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a4fe6-7ef2-463e-aab6-308fcce84e45 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:41.250403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc9b57-7c1c-425d-a290-df4a73cd731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:41.251166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc9b57-7c1c-425d-a290-df4a73cd731f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:41.251524 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc9b57-7c1c-425d-a290-df4a73cd731f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:41.251859 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc9b57-7c1c-425d-a290-df4a73cd731f None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:41.252736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc9b57-7c1c-425d-a290-df4a73cd731f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:41.253233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc9b57-7c1c-425d-a290-df4a73cd731f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:41.254903 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc9b57-7c1c-425d-a290-df4a73cd731f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:41.264234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23846fb4-715f-466b-852a-99d1c74872a8 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:41.265611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 57/116] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:54:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:41.266530 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc9b57-7c1c-425d-a290-df4a73cd731f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:41.275182 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:41.313210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c3a05-cb2c-494b-822a-d420d0e07951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:41.314060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c3a05-cb2c-494b-822a-d420d0e07951 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:41.314488 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c3a05-cb2c-494b-822a-d420d0e07951 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:41.314863 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c3a05-cb2c-494b-822a-d420d0e07951 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:41.316376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c3a05-cb2c-494b-822a-d420d0e07951 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:41.319488 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c3a05-cb2c-494b-822a-d420d0e07951 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:41.321462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 60/117] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:41 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:41.323785 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c3a05-cb2c-494b-822a-d420d0e07951 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:41.375798 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:41.415418 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc9b57-7c1c-425d-a290-df4a73cd731f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:41.446347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c3a05-cb2c-494b-822a-d420d0e07951 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:41.469082 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef789534-b5e2-4448-b8f3-a2da3b670366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:41.469746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef789534-b5e2-4448-b8f3-a2da3b670366 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:41.470031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef789534-b5e2-4448-b8f3-a2da3b670366 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:41.470305 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef789534-b5e2-4448-b8f3-a2da3b670366 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:41.471580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef789534-b5e2-4448-b8f3-a2da3b670366 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:41.473223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef789534-b5e2-4448-b8f3-a2da3b670366 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:41.475258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 58/118] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:41 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:41.476357 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2446a-defe-425b-a4f5-fe6c4b520e82 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:41.476734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2446a-defe-425b-a4f5-fe6c4b520e82 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:41.477018 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2446a-defe-425b-a4f5-fe6c4b520e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:41.498207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c1f2446a-defe-425b-a4f5-fe6c4b520e82 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:41.499494 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c1f2446a-defe-425b-a4f5-fe6c4b520e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:41.509112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b1d27-7731-4004-a614-210df99a9e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:41.510128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b1d27-7731-4004-a614-210df99a9e8d None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:41.510712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b1d27-7731-4004-a614-210df99a9e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:41.511225 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b1d27-7731-4004-a614-210df99a9e8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:41.513490 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b1d27-7731-4004-a614-210df99a9e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:41.516442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b1d27-7731-4004-a614-210df99a9e8d None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:41.519636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 61/119] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:54:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:41.520930 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b1d27-7731-4004-a614-210df99a9e8d None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:41.595574 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:41.632919 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 59/120] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:41.634499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2446a-defe-425b-a4f5-fe6c4b520e82 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:41.678795 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b1d27-7731-4004-a614-210df99a9e8d None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:41.747381 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c851c0-f08c-4910-88a5-510ca28c6a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:41.748399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c851c0-f08c-4910-88a5-510ca28c6a3a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:41.748887 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c851c0-f08c-4910-88a5-510ca28c6a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:41.749359 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c851c0-f08c-4910-88a5-510ca28c6a3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:41.753162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:41.769920 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c851c0-f08c-4910-88a5-510ca28c6a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-44c851c0-f08c-4910-88a5-510ca28c6a3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:41.780948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:41.781911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:41.782702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:41.782702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:41.782702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:41.782702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:41.782702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:41.782702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:41.782702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:41.782702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:41.782702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:41.782702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:41.782702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:54:41.782702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:54:41.783345 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 62/121] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:41.784570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c851c0-f08c-4910-88a5-510ca28c6a3a None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:41.785495 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2446a-defe-425b-a4f5-fe6c4b520e82 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:41.848041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d586d-efda-4d20-a60c-2332a025773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:41.849124 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d586d-efda-4d20-a60c-2332a025773c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:41.849575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d586d-efda-4d20-a60c-2332a025773c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:41.850057 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d586d-efda-4d20-a60c-2332a025773c None admin] PATH_INFO: `/v3/users/dfeb743e6fb0437cbddf37051ef71a20` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:41.873768 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d586d-efda-4d20-a60c-2332a025773c None admin] RBAC: Authorizing `identity:get_user(user_id=dfeb743e6fb0437cbddf37051ef71a20)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:41.875870 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d586d-efda-4d20-a60c-2332a025773c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:41.878022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 60/122] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:41 2022] GET /identity/v3/users/dfeb743e6fb0437cbddf37051ef71a20 => generated 289 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:41.879479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d586d-efda-4d20-a60c-2332a025773c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:41.968318 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:41.973325 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c851c0-f08c-4910-88a5-510ca28c6a3a None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:42.029334 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07007b7a-a729-4f45-949d-ead4ee92fb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:42.030215 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07007b7a-a729-4f45-949d-ead4ee92fb85 None admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:42.030681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07007b7a-a729-4f45-949d-ead4ee92fb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:42.031055 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07007b7a-a729-4f45-949d-ead4ee92fb85 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654/users/2a32a15f2a584ef0acafa1e4cd085d71/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:42.033556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07007b7a-a729-4f45-949d-ead4ee92fb85 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8b578718bf04a31bc5b638315420654, user_id=2a32a15f2a584ef0acafa1e4cd085d71, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:42.035565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07007b7a-a729-4f45-949d-ead4ee92fb85 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:42.065357 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d586d-efda-4d20-a60c-2332a025773c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:42.116560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 63/123] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:54:41 2022] PUT /identity/v3/projects/d8b578718bf04a31bc5b638315420654/users/2a32a15f2a584ef0acafa1e4cd085d71/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:54:42.117528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07007b7a-a729-4f45-949d-ead4ee92fb85 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:42.122222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a0bb0-8b4e-48d5-bbdd-fa3b3219d7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:42.123018 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a0bb0-8b4e-48d5-bbdd-fa3b3219d7e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:42.123293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a0bb0-8b4e-48d5-bbdd-fa3b3219d7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:42.123578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a0bb0-8b4e-48d5-bbdd-fa3b3219d7e5 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654/users/ab0ce7c38c274718a8fd45c535922c16/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:42.126411 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a0bb0-8b4e-48d5-bbdd-fa3b3219d7e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8b578718bf04a31bc5b638315420654, user_id=ab0ce7c38c274718a8fd45c535922c16, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:42.128099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a0bb0-8b4e-48d5-bbdd-fa3b3219d7e5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:42.131237 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:42.268146 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 61/124] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:54:41 2022] PUT /identity/v3/projects/d8b578718bf04a31bc5b638315420654/users/ab0ce7c38c274718a8fd45c535922c16/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:54:42.270201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a0bb0-8b4e-48d5-bbdd-fa3b3219d7e5 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:42.357949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07007b7a-a729-4f45-949d-ead4ee92fb85 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:42.437207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99036dc-be6b-4a6a-8758-261419aeda7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:42.438277 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99036dc-be6b-4a6a-8758-261419aeda7c None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:42.438735 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99036dc-be6b-4a6a-8758-261419aeda7c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:42.439153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99036dc-be6b-4a6a-8758-261419aeda7c None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:42.440888 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99036dc-be6b-4a6a-8758-261419aeda7c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:42.443598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99036dc-be6b-4a6a-8758-261419aeda7c None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:42.565258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a0bb0-8b4e-48d5-bbdd-fa3b3219d7e5 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:42.589325 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 64/125] 10.222.0.98 () {60 vars in 1141 bytes} [Tue Jul 26 14:54:42 2022] POST /identity/v3/projects => generated 302 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:54:42.591110 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99036dc-be6b-4a6a-8758-261419aeda7c None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:42.623396 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:42.647775 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad304f76-57e1-4696-af9f-6bea1578e002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:42.649406 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad304f76-57e1-4696-af9f-6bea1578e002 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:42.650215 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad304f76-57e1-4696-af9f-6bea1578e002 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:42.650938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad304f76-57e1-4696-af9f-6bea1578e002 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:42.675492 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad304f76-57e1-4696-af9f-6bea1578e002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-ad304f76-57e1-4696-af9f-6bea1578e002 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:42.687545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:42.689498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:42.691127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:42.691127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:42.691127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:42.691127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:42.691127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:42.691127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:42.691127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:42.691127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:42.691127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:42.691127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:42.691127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:54:42.691127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:54:42.694889 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 62/126] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:54:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:42.696672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad304f76-57e1-4696-af9f-6bea1578e002 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:42.822591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:42.885340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99036dc-be6b-4a6a-8758-261419aeda7c None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:42.923984 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad304f76-57e1-4696-af9f-6bea1578e002 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:42.943558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f7a66-531c-4eec-9618-97419d82b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:42.945419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7a66-531c-4eec-9618-97419d82b198 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:42.945929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7a66-531c-4eec-9618-97419d82b198 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:42.947034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7a66-531c-4eec-9618-97419d82b198 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:42.947316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f7a66-531c-4eec-9618-97419d82b198 None admin] RBAC: Adding query filter params (name=member) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:42.947641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f7a66-531c-4eec-9618-97419d82b198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:42.949773 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f7a66-531c-4eec-9618-97419d82b198 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:42.963457 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 65/127] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:54:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:42.967393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f7a66-531c-4eec-9618-97419d82b198 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:43.028774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cb794-d290-4a11-871f-0f2498a1290b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:43.029915 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cb794-d290-4a11-871f-0f2498a1290b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:43.030681 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cb794-d290-4a11-871f-0f2498a1290b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:43.031041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cb794-d290-4a11-871f-0f2498a1290b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:43.150604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:43.152202 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cb794-d290-4a11-871f-0f2498a1290b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:43.154824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cb794-d290-4a11-871f-0f2498a1290b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:43.205931 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f7a66-531c-4eec-9618-97419d82b198 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:43.246729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:43.288875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039526a4-bf3c-4ad1-a558-9d6c1d7855ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:43.290628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039526a4-bf3c-4ad1-a558-9d6c1d7855ee None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:43.291485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039526a4-bf3c-4ad1-a558-9d6c1d7855ee None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:43.292261 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039526a4-bf3c-4ad1-a558-9d6c1d7855ee None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:43.293922 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039526a4-bf3c-4ad1-a558-9d6c1d7855ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:43.294867 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039526a4-bf3c-4ad1-a558-9d6c1d7855ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:43.298034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039526a4-bf3c-4ad1-a558-9d6c1d7855ee None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:43.317243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 66/128] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:54:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:43.323675 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039526a4-bf3c-4ad1-a558-9d6c1d7855ee None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:43.345731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 63/129] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:54:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:43.347930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cb794-d290-4a11-871f-0f2498a1290b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:43.550294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039526a4-bf3c-4ad1-a558-9d6c1d7855ee None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:43.599211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b93445-e5a0-45d8-ba87-272226069b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:43.601449 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b93445-e5a0-45d8-ba87-272226069b71 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:43.602273 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b93445-e5a0-45d8-ba87-272226069b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:43.603081 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b93445-e5a0-45d8-ba87-272226069b71 None admin] PATH_INFO: `/v3/users/2a32a15f2a584ef0acafa1e4cd085d71` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:43.605764 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b93445-e5a0-45d8-ba87-272226069b71 None admin] RBAC: Authorizing `identity:get_user(user_id=2a32a15f2a584ef0acafa1e4cd085d71)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:43.609227 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b93445-e5a0-45d8-ba87-272226069b71 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:43.612916 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 67/130] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:43 2022] GET /identity/v3/users/2a32a15f2a584ef0acafa1e4cd085d71 => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:43.614943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b93445-e5a0-45d8-ba87-272226069b71 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:43.622820 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:43.654170 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cb794-d290-4a11-871f-0f2498a1290b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:43.783454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7267c-9059-4d28-8a61-753fc455195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:43.784456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7267c-9059-4d28-8a61-753fc455195c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:43.784917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7267c-9059-4d28-8a61-753fc455195c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:43.785408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7267c-9059-4d28-8a61-753fc455195c None admin] PATH_INFO: `/v3/users/2a32a15f2a584ef0acafa1e4cd085d71` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:43.790147 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7267c-9059-4d28-8a61-753fc455195c None admin] RBAC: Authorizing `identity:get_user(user_id=2a32a15f2a584ef0acafa1e4cd085d71)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:43.793014 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7267c-9059-4d28-8a61-753fc455195c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:43.796435 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 64/131] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:43 2022] GET /identity/v3/users/2a32a15f2a584ef0acafa1e4cd085d71 => generated 275 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:43.797691 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7267c-9059-4d28-8a61-753fc455195c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:43.890887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:43.900508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b93445-e5a0-45d8-ba87-272226069b71 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:43.981090 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df88be-7899-4c5e-92a1-fbde8c19b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:43.982213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df88be-7899-4c5e-92a1-fbde8c19b7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:43.982951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df88be-7899-4c5e-92a1-fbde8c19b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:43.983413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df88be-7899-4c5e-92a1-fbde8c19b7b5 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:43.985974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df88be-7899-4c5e-92a1-fbde8c19b7b5 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:43.988880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df88be-7899-4c5e-92a1-fbde8c19b7b5 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:43.993117 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 68/132] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:43 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:43.994423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df88be-7899-4c5e-92a1-fbde8c19b7b5 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:44.136255 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7267c-9059-4d28-8a61-753fc455195c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:44.200499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bf47d-82f5-4ec1-abf6-845f3a617fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:44.201615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bf47d-82f5-4ec1-abf6-845f3a617fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:44.202122 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bf47d-82f5-4ec1-abf6-845f3a617fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:44.202762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bf47d-82f5-4ec1-abf6-845f3a617fb2 None admin] PATH_INFO: `/v3/projects/ef6148b502084d8d8e5238b168bcf198` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:44.206810 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bf47d-82f5-4ec1-abf6-845f3a617fb2 None admin] RBAC: Authorizing `identity:get_project(project_id=ef6148b502084d8d8e5238b168bcf198)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:44.209854 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bf47d-82f5-4ec1-abf6-845f3a617fb2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:44.212388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 65/133] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:43 2022] GET /identity/v3/projects/ef6148b502084d8d8e5238b168bcf198 => generated 312 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:44.213336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bf47d-82f5-4ec1-abf6-845f3a617fb2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:44.219029 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:44.292268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df88be-7899-4c5e-92a1-fbde8c19b7b5 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:44.348113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1fb1c-11b6-432f-ae1e-3b879407a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:44.348841 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1fb1c-11b6-432f-ae1e-3b879407a828 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:44.349369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1fb1c-11b6-432f-ae1e-3b879407a828 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:44.349692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1fb1c-11b6-432f-ae1e-3b879407a828 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:44.351765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1fb1c-11b6-432f-ae1e-3b879407a828 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:44.353351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1fb1c-11b6-432f-ae1e-3b879407a828 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:44.358987 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 69/134] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:43 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:44.360148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1fb1c-11b6-432f-ae1e-3b879407a828 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:44.487891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:44.513942 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bf47d-82f5-4ec1-abf6-845f3a617fb2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:44.568044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1fb1c-11b6-432f-ae1e-3b879407a828 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:44.635786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1484136-b610-48e4-9342-efdc5c5ddefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:44.637078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1484136-b610-48e4-9342-efdc5c5ddefc None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:44.637078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1484136-b610-48e4-9342-efdc5c5ddefc None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:44.637078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1484136-b610-48e4-9342-efdc5c5ddefc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:44.637921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1484136-b610-48e4-9342-efdc5c5ddefc None admin] RBAC: Adding query filter params (role.id=1cb1920ac8734f678410e3f1ad89de68, scope.project.id=d8b578718bf04a31bc5b638315420654, user.id=dfeb743e6fb0437cbddf37051ef71a20) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:44.638265 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1484136-b610-48e4-9342-efdc5c5ddefc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:44.640279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1484136-b610-48e4-9342-efdc5c5ddefc None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:44.655200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf737ad3-9c36-4b3a-bef6-1d344f1739fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:44.656529 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 66/135] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:54:44 2022] GET /identity/v3/role_assignments?user.id=dfeb743e6fb0437cbddf37051ef71a20&scope.project.id=d8b578718bf04a31bc5b638315420654&role.id=1cb1920ac8734f678410e3f1ad89de68 => generated 259 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:44.657273 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf737ad3-9c36-4b3a-bef6-1d344f1739fb None admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:44.658098 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf737ad3-9c36-4b3a-bef6-1d344f1739fb None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:44.659239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf737ad3-9c36-4b3a-bef6-1d344f1739fb None admin] PATH_INFO: `/v3/projects/ef6148b502084d8d8e5238b168bcf198/users/2a32a15f2a584ef0acafa1e4cd085d71/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:44.663579 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1484136-b610-48e4-9342-efdc5c5ddefc None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:44.670714 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf737ad3-9c36-4b3a-bef6-1d344f1739fb None admin] RBAC: Authorizing `identity:create_grant(project_id=ef6148b502084d8d8e5238b168bcf198, user_id=2a32a15f2a584ef0acafa1e4cd085d71, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:44.670714 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf737ad3-9c36-4b3a-bef6-1d344f1739fb None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:44.794510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:44.808664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 70/136] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:54:44 2022] PUT /identity/v3/projects/ef6148b502084d8d8e5238b168bcf198/users/2a32a15f2a584ef0acafa1e4cd085d71/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:54:44.947617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1484136-b610-48e4-9342-efdc5c5ddefc None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:45.032668 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ba851-6d92-4131-a1b7-7617fe646fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:45.033872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ba851-6d92-4131-a1b7-7617fe646fd5 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:45.034391 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ba851-6d92-4131-a1b7-7617fe646fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:45.034910 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ba851-6d92-4131-a1b7-7617fe646fd5 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654/users/2a32a15f2a584ef0acafa1e4cd085d71/roles/3b3abbcf8ee04f0387cfdede5812d226` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:45.040513 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ba851-6d92-4131-a1b7-7617fe646fd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8b578718bf04a31bc5b638315420654, user_id=2a32a15f2a584ef0acafa1e4cd085d71, role_id=3b3abbcf8ee04f0387cfdede5812d226)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:45.043329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ba851-6d92-4131-a1b7-7617fe646fd5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:45.130468 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 67/137] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:54:44 2022] PUT /identity/v3/projects/d8b578718bf04a31bc5b638315420654/users/2a32a15f2a584ef0acafa1e4cd085d71/roles/3b3abbcf8ee04f0387cfdede5812d226 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:54:46.170993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a8f54-dd0f-476d-8d5e-bd672089467b None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:46.171991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a8f54-dd0f-476d-8d5e-bd672089467b None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:46.172463 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a8f54-dd0f-476d-8d5e-bd672089467b None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:46.174850 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 71/138] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:46.183177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b324c-f50b-4a63-9a7c-163ec39a9588 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:46.184166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b324c-f50b-4a63-9a7c-163ec39a9588 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:46.184666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b324c-f50b-4a63-9a7c-163ec39a9588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:46.214590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a44b324c-f50b-4a63-9a7c-163ec39a9588 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:46.216322 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a44b324c-f50b-4a63-9a7c-163ec39a9588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:46.234930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:46.353119 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 68/139] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:46.433761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a8f54-dd0f-476d-8d5e-bd672089467b None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:46.524489 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7765a-46f0-4d8e-9fa4-9fd6653e685c None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:46.524769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7765a-46f0-4d8e-9fa4-9fd6653e685c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:46.525056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7765a-46f0-4d8e-9fa4-9fd6653e685c None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:46.526477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 69/140] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:46.535354 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917b972-931c-4e7f-8855-d41b96db1f9c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:46.535895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917b972-931c-4e7f-8855-d41b96db1f9c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:46.536426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917b972-931c-4e7f-8855-d41b96db1f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:46.594744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2917b972-931c-4e7f-8855-d41b96db1f9c None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:46.596838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2917b972-931c-4e7f-8855-d41b96db1f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:46.784746 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a8f54-dd0f-476d-8d5e-bd672089467b None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:46.859177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 70/141] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:54:46.862106 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75a44b-39e2-4f55-8e27-d84abef7a1da None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:46.863034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75a44b-39e2-4f55-8e27-d84abef7a1da None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:46.863782 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75a44b-39e2-4f55-8e27-d84abef7a1da None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:46.868335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 71/142] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:46.878566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8b9d0-c45a-4ad7-91c4-2160ae29a06a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:46.879619 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8b9d0-c45a-4ad7-91c4-2160ae29a06a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:46.882774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8b9d0-c45a-4ad7-91c4-2160ae29a06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:46.913407 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459621d-d27f-4fa6-98e6-ea5aff34e1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:46.917494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459621d-d27f-4fa6-98e6-ea5aff34e1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:46.919892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459621d-d27f-4fa6-98e6-ea5aff34e1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:46.923396 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459621d-d27f-4fa6-98e6-ea5aff34e1e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:46.947828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-53e8b9d0-c45a-4ad7-91c4-2160ae29a06a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:46.960608 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-53e8b9d0-c45a-4ad7-91c4-2160ae29a06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:46.966482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459621d-d27f-4fa6-98e6-ea5aff34e1e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-a459621d-d27f-4fa6-98e6-ea5aff34e1e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:46.983076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:46.984682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:46.986243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:46.986243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:46.986243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:46.986243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:46.986243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:46.986243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:46.986243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:46.986243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:46.986243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:46.986243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:46.986243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:54:46.986243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:54:46.986243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 72/143] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 558 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:54:46.988631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459621d-d27f-4fa6-98e6-ea5aff34e1e0 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:47.166808 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:47.220975 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 72/144] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:47.225956 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8b9d0-c45a-4ad7-91c4-2160ae29a06a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:47.242980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:47.292957 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459621d-d27f-4fa6-98e6-ea5aff34e1e0 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:47.410873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a1bd4-ea77-4bc9-8379-95243ef612d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:47.413058 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a1bd4-ea77-4bc9-8379-95243ef612d6 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:47.413761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a1bd4-ea77-4bc9-8379-95243ef612d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:47.414576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a1bd4-ea77-4bc9-8379-95243ef612d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:47.417233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a1bd4-ea77-4bc9-8379-95243ef612d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:47.420707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a1bd4-ea77-4bc9-8379-95243ef612d6 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:47.424457 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 73/145] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:54:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:47.426245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a1bd4-ea77-4bc9-8379-95243ef612d6 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:47.561396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8b9d0-c45a-4ad7-91c4-2160ae29a06a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:47.686007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b14db-f24e-4dd3-be9d-36b87c994627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:47.687810 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b14db-f24e-4dd3-be9d-36b87c994627 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:47.691815 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b14db-f24e-4dd3-be9d-36b87c994627 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:47.692555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b14db-f24e-4dd3-be9d-36b87c994627 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:47.696781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b14db-f24e-4dd3-be9d-36b87c994627 None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:47.697599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b14db-f24e-4dd3-be9d-36b87c994627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:47.700311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b14db-f24e-4dd3-be9d-36b87c994627 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:47.730252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 73/146] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:54:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 505 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:47.736087 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b14db-f24e-4dd3-be9d-36b87c994627 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:47.744954 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a1bd4-ea77-4bc9-8379-95243ef612d6 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:47.844386 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:47.873693 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c15665-2a2c-4616-b438-e7f080631b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:47.874766 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c15665-2a2c-4616-b438-e7f080631b9a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:47.875306 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c15665-2a2c-4616-b438-e7f080631b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:47.875828 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c15665-2a2c-4616-b438-e7f080631b9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:47.899703 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:47.915227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b14db-f24e-4dd3-be9d-36b87c994627 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:47.916592 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c15665-2a2c-4616-b438-e7f080631b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-89c15665-2a2c-4616-b438-e7f080631b9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:47.934411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:47.935697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:47.936525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:47.936525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:47.936525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:47.936525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:47.936525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:47.936525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:47.936525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:47.936525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:47.936525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:47.936525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:47.936525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:54:47.936525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:54:47.936525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 74/147] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:54:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 511 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:47.943111 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c15665-2a2c-4616-b438-e7f080631b9a None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:47.992707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b633297-3bd6-4583-906d-dfcb5839b768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:47.993707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b633297-3bd6-4583-906d-dfcb5839b768 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:47.994184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b633297-3bd6-4583-906d-dfcb5839b768 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:47.994693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b633297-3bd6-4583-906d-dfcb5839b768 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:47.995681 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b633297-3bd6-4583-906d-dfcb5839b768 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:47.997660 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b633297-3bd6-4583-906d-dfcb5839b768 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:48.119827 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c15665-2a2c-4616-b438-e7f080631b9a None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:48.137254 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 74/148] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:54:47 2022] POST /identity/v3/users => generated 283 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:54:48.138469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b633297-3bd6-4583-906d-dfcb5839b768 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:48.182682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96161e5f-dc50-483c-96db-6a917b83d91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:48.182682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96161e5f-dc50-483c-96db-6a917b83d91c None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:48.182682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96161e5f-dc50-483c-96db-6a917b83d91c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:48.182682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96161e5f-dc50-483c-96db-6a917b83d91c None admin] PATH_INFO: `/v3/users/2a32a15f2a584ef0acafa1e4cd085d71` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:48.183188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96161e5f-dc50-483c-96db-6a917b83d91c None admin] RBAC: Authorizing `identity:get_user(user_id=2a32a15f2a584ef0acafa1e4cd085d71)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:48.184295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96161e5f-dc50-483c-96db-6a917b83d91c None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:48.187487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 75/149] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:47 2022] GET /identity/v3/users/2a32a15f2a584ef0acafa1e4cd085d71 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:48.195766 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96161e5f-dc50-483c-96db-6a917b83d91c None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:48.382776 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:48.469195 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96161e5f-dc50-483c-96db-6a917b83d91c None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:48.492645 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b633297-3bd6-4583-906d-dfcb5839b768 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:48.523883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23de2d-074a-4598-a9d5-1c0d49903247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:48.525524 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23de2d-074a-4598-a9d5-1c0d49903247 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:48.526002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23de2d-074a-4598-a9d5-1c0d49903247 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:48.526493 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23de2d-074a-4598-a9d5-1c0d49903247 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:48.573318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:48.597532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ab1e7-bb09-472c-9639-af7dc26d2a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:48.598478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ab1e7-bb09-472c-9639-af7dc26d2a46 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:48.599161 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ab1e7-bb09-472c-9639-af7dc26d2a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:48.600268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ab1e7-bb09-472c-9639-af7dc26d2a46 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:48.601888 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ab1e7-bb09-472c-9639-af7dc26d2a46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:48.602657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ab1e7-bb09-472c-9639-af7dc26d2a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:48.605745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ab1e7-bb09-472c-9639-af7dc26d2a46 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:48.624643 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 75/150] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:48.624643 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c93d3e-e32a-4d7f-80be-1b3aa143ab00 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:48.624643 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c93d3e-e32a-4d7f-80be-1b3aa143ab00 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:48.624643 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c93d3e-e32a-4d7f-80be-1b3aa143ab00 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:48.624643 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 76/151] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:48.632551 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72a4cb-3724-4b96-ab5c-f396f122d87a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:48.633249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72a4cb-3724-4b96-ab5c-f396f122d87a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:48.633890 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72a4cb-3724-4b96-ab5c-f396f122d87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:48.642504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23de2d-074a-4598-a9d5-1c0d49903247 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:48.644559 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23de2d-074a-4598-a9d5-1c0d49903247 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:48.659592 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1f72a4cb-3724-4b96-ab5c-f396f122d87a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:48.667147 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1f72a4cb-3724-4b96-ab5c-f396f122d87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:48.767049 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:48.800947 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 77/152] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:48.804358 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72a4cb-3724-4b96-ab5c-f396f122d87a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:48.872542 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 76/153] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:54:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:54:48.875314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23de2d-074a-4598-a9d5-1c0d49903247 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:48.985036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72a4cb-3724-4b96-ab5c-f396f122d87a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:49.010503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:49.046124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23de2d-074a-4598-a9d5-1c0d49903247 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:49.046576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d844aaf-0c94-4c19-964a-78e217836a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:49.047300 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d844aaf-0c94-4c19-964a-78e217836a85 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:49.047719 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d844aaf-0c94-4c19-964a-78e217836a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:49.048125 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d844aaf-0c94-4c19-964a-78e217836a85 None admin] PATH_INFO: `/v3/users/ab0ce7c38c274718a8fd45c535922c16` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:49.050266 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d844aaf-0c94-4c19-964a-78e217836a85 None admin] RBAC: Authorizing `identity:get_user(user_id=ab0ce7c38c274718a8fd45c535922c16)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:49.056736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d844aaf-0c94-4c19-964a-78e217836a85 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:49.060029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 78/154] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:48 2022] GET /identity/v3/users/ab0ce7c38c274718a8fd45c535922c16 => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:49.062723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d844aaf-0c94-4c19-964a-78e217836a85 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:49.135760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d9d48-78f3-48dc-974f-dfb3e7065f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:49.137320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d9d48-78f3-48dc-974f-dfb3e7065f87 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:49.137634 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d9d48-78f3-48dc-974f-dfb3e7065f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:49.137915 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d9d48-78f3-48dc-974f-dfb3e7065f87 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:49.167415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d9d48-78f3-48dc-974f-dfb3e7065f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-6a0d9d48-78f3-48dc-974f-dfb3e7065f87 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:49.178275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:49.179346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:49.180167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:49.180167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:49.180167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:49.180167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:49.180167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:49.180167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:49.180167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:49.180167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:49.180167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:49.180167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:49.180167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:54:49.180167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:54:49.181370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 77/155] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:49.182326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d9d48-78f3-48dc-974f-dfb3e7065f87 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:49.225928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:49.296680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d844aaf-0c94-4c19-964a-78e217836a85 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:49.356962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780601c-9ebb-4163-9618-7b711ee959a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:49.358120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780601c-9ebb-4163-9618-7b711ee959a0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:49.358700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780601c-9ebb-4163-9618-7b711ee959a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:49.359145 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780601c-9ebb-4163-9618-7b711ee959a0 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:49.361140 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780601c-9ebb-4163-9618-7b711ee959a0 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:49.363194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780601c-9ebb-4163-9618-7b711ee959a0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:49.367413 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 79/156] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:49 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:49.369056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3d64f-ca21-4110-9e0f-df8a284a52b0 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:49.369498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3d64f-ca21-4110-9e0f-df8a284a52b0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:49.370134 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3d64f-ca21-4110-9e0f-df8a284a52b0 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:49.371851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 80/157] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:49.373467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3d64f-ca21-4110-9e0f-df8a284a52b0 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:49.398707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d9d48-78f3-48dc-974f-dfb3e7065f87 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:49.477096 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382adbb4-ca39-45d3-8ba8-d168ab2e2ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:49.478731 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382adbb4-ca39-45d3-8ba8-d168ab2e2ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:49.479679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382adbb4-ca39-45d3-8ba8-d168ab2e2ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:49.480356 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382adbb4-ca39-45d3-8ba8-d168ab2e2ce8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:49.487480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:49.603729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3d64f-ca21-4110-9e0f-df8a284a52b0 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:49.650576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382adbb4-ca39-45d3-8ba8-d168ab2e2ce8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:49.652597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382adbb4-ca39-45d3-8ba8-d168ab2e2ce8 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:49.665019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf8866-7a34-4590-a61a-b5d040bc67ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:49.680774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8866-7a34-4590-a61a-b5d040bc67ef None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:49.680774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8866-7a34-4590-a61a-b5d040bc67ef None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:49.680774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8866-7a34-4590-a61a-b5d040bc67ef None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:49.680774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf8866-7a34-4590-a61a-b5d040bc67ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:49.680774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf8866-7a34-4590-a61a-b5d040bc67ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:49.680774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf8866-7a34-4590-a61a-b5d040bc67ef None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:49.681489 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:49.695775 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 81/158] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:54:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:49.697183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf8866-7a34-4590-a61a-b5d040bc67ef None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:49.800893 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 78/159] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:54:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:49.807517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73b90e-f27b-4ab5-a2b0-ab7645eb837f None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:49.807807 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73b90e-f27b-4ab5-a2b0-ab7645eb837f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:49.808151 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73b90e-f27b-4ab5-a2b0-ab7645eb837f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:49.851633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-9e73b90e-f27b-4ab5-a2b0-ab7645eb837f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:49.852896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-9e73b90e-f27b-4ab5-a2b0-ab7645eb837f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:49.946235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf8866-7a34-4590-a61a-b5d040bc67ef None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:49.980439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:50.038659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc23c3a-57c4-48f8-87e1-3e1f47fd78c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:50.039761 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc23c3a-57c4-48f8-87e1-3e1f47fd78c9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:50.040263 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc23c3a-57c4-48f8-87e1-3e1f47fd78c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:50.040754 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc23c3a-57c4-48f8-87e1-3e1f47fd78c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:50.042352 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc23c3a-57c4-48f8-87e1-3e1f47fd78c9 None admin] RBAC: Adding query filter params (role.id=7555aed6a21441208a17dedef685336f, scope.project.id=d8b578718bf04a31bc5b638315420654, user.id=2a32a15f2a584ef0acafa1e4cd085d71) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:50.042909 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc23c3a-57c4-48f8-87e1-3e1f47fd78c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:50.045742 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc23c3a-57c4-48f8-87e1-3e1f47fd78c9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:50.059751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 82/160] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:54:49 2022] GET /identity/v3/role_assignments?user.id=2a32a15f2a584ef0acafa1e4cd085d71&scope.project.id=d8b578718bf04a31bc5b638315420654&role.id=7555aed6a21441208a17dedef685336f => generated 608 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:50.062208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77c8ae-e5b9-47c0-aae9-c95ec87bb3b8 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:50.062728 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77c8ae-e5b9-47c0-aae9-c95ec87bb3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:50.063313 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77c8ae-e5b9-47c0-aae9-c95ec87bb3b8 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:50.070279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 83/161] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:50.071865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77c8ae-e5b9-47c0-aae9-c95ec87bb3b8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:50.080231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 79/162] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:50.082403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73b90e-f27b-4ab5-a2b0-ab7645eb837f None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:50.267022 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:50.292209 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77c8ae-e5b9-47c0-aae9-c95ec87bb3b8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:50.363007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f001799-3e19-4fc6-8ed1-c4361c8a532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:50.364876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f001799-3e19-4fc6-8ed1-c4361c8a532b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:50.365344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f001799-3e19-4fc6-8ed1-c4361c8a532b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:50.365849 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f001799-3e19-4fc6-8ed1-c4361c8a532b None admin] PATH_INFO: `/v3/users/dfeb743e6fb0437cbddf37051ef71a20` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:50.368124 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f001799-3e19-4fc6-8ed1-c4361c8a532b None admin] RBAC: Authorizing `identity:get_user(user_id=dfeb743e6fb0437cbddf37051ef71a20)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:50.371477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f001799-3e19-4fc6-8ed1-c4361c8a532b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:50.374835 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 84/163] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:50 2022] GET /identity/v3/users/dfeb743e6fb0437cbddf37051ef71a20 => generated 289 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:50.377255 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980ef6a-d9f7-4685-ae9b-6e70bc15c35c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:50.377745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980ef6a-d9f7-4685-ae9b-6e70bc15c35c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:50.378232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980ef6a-d9f7-4685-ae9b-6e70bc15c35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:50.414507 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c980ef6a-d9f7-4685-ae9b-6e70bc15c35c None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:50.416672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c980ef6a-d9f7-4685-ae9b-6e70bc15c35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:50.463227 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73b90e-f27b-4ab5-a2b0-ab7645eb837f None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:50.513967 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:50.557927 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a31227-85aa-4b7d-97db-a071e47aa317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:50.560117 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a31227-85aa-4b7d-97db-a071e47aa317 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:50.561029 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a31227-85aa-4b7d-97db-a071e47aa317 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:50.562439 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a31227-85aa-4b7d-97db-a071e47aa317 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:50.565972 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a31227-85aa-4b7d-97db-a071e47aa317 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:50.569935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a31227-85aa-4b7d-97db-a071e47aa317 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:50.572307 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 80/164] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:50 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:50.573553 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a31227-85aa-4b7d-97db-a071e47aa317 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:50.594127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 85/165] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:50.596107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980ef6a-d9f7-4685-ae9b-6e70bc15c35c None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:50.874496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980ef6a-d9f7-4685-ae9b-6e70bc15c35c None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:50.879529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a31227-85aa-4b7d-97db-a071e47aa317 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:50.919021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:50.993753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20279e-3ac6-449e-beaf-a73f5537944c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:50.994935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20279e-3ac6-449e-beaf-a73f5537944c None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:50.995442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20279e-3ac6-449e-beaf-a73f5537944c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:50.995914 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20279e-3ac6-449e-beaf-a73f5537944c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:51.006924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148f309-70fb-49c3-ac17-3983ebef3213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:51.008115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148f309-70fb-49c3-ac17-3983ebef3213 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:51.008617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148f309-70fb-49c3-ac17-3983ebef3213 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:51.009894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148f309-70fb-49c3-ac17-3983ebef3213 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:51.015419 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148f309-70fb-49c3-ac17-3983ebef3213 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:51.022109 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148f309-70fb-49c3-ac17-3983ebef3213 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:51.043442 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 86/166] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:50 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:51.045017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148f309-70fb-49c3-ac17-3983ebef3213 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:51.052980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20279e-3ac6-449e-beaf-a73f5537944c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-7d20279e-3ac6-449e-beaf-a73f5537944c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:51.068028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:51.070100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:51.072153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:51.072153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:51.072153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:51.072153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:51.072153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:51.072153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:51.072153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:51.072153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:51.072153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:51.072153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:51.072153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:54:51.072153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:54:51.083736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 81/167] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 510 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:51.085270 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20279e-3ac6-449e-beaf-a73f5537944c None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:51.211159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:51.361234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148f309-70fb-49c3-ac17-3983ebef3213 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:51.457486 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20279e-3ac6-449e-beaf-a73f5537944c None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:51.525708 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6079255-8ab0-4bae-86c0-58c9649f0ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:51.527682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6079255-8ab0-4bae-86c0-58c9649f0ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:51.531244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6079255-8ab0-4bae-86c0-58c9649f0ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:51.532064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6079255-8ab0-4bae-86c0-58c9649f0ae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:51.533974 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6079255-8ab0-4bae-86c0-58c9649f0ae6 None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=d8b578718bf04a31bc5b638315420654, user.id=ab0ce7c38c274718a8fd45c535922c16) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:51.537875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6079255-8ab0-4bae-86c0-58c9649f0ae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:51.540905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6079255-8ab0-4bae-86c0-58c9649f0ae6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:51.558998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4b985-6cad-4d36-9faa-914eb7c53e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:51.563532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 87/168] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:54:51 2022] GET /identity/v3/role_assignments?user.id=ab0ce7c38c274718a8fd45c535922c16&scope.project.id=d8b578718bf04a31bc5b638315420654&role.id=17054492864541709fda49dbf677a7a2 => generated 608 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:51.565215 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4b985-6cad-4d36-9faa-914eb7c53e7f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:51.565939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4b985-6cad-4d36-9faa-914eb7c53e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:51.566746 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4b985-6cad-4d36-9faa-914eb7c53e7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:51.569655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6079255-8ab0-4bae-86c0-58c9649f0ae6 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:51.606907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4b985-6cad-4d36-9faa-914eb7c53e7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-65b4b985-6cad-4d36-9faa-914eb7c53e7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:51.624336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:51.626041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:51.627663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:51.627663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:51.627663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:51.627663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:51.627663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:51.627663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:51.627663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:51.627663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:51.627663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:51.627663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:51.627663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:54:51.627663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:54:51.638405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 82/169] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:54:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 548 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:51.640598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4b985-6cad-4d36-9faa-914eb7c53e7f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:51.775644 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:51.933603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6079255-8ab0-4bae-86c0-58c9649f0ae6 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:51.954347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:51.982704 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4b985-6cad-4d36-9faa-914eb7c53e7f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:52.064043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a6803-3677-4ca5-b2d5-b89d5e80e513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:52.066858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6803-3677-4ca5-b2d5-b89d5e80e513 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:52.069401 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6803-3677-4ca5-b2d5-b89d5e80e513 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:52.070831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6803-3677-4ca5-b2d5-b89d5e80e513 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:52.071658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a6803-3677-4ca5-b2d5-b89d5e80e513 None admin] RBAC: Adding query filter params (name=member) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:52.071979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a6803-3677-4ca5-b2d5-b89d5e80e513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:52.073444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a6803-3677-4ca5-b2d5-b89d5e80e513 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:52.074403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bb288-09d6-4790-bee5-b6f452686006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:52.076409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bb288-09d6-4790-bee5-b6f452686006 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:52.077206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bb288-09d6-4790-bee5-b6f452686006 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:52.077956 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bb288-09d6-4790-bee5-b6f452686006 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654/users/dfeb743e6fb0437cbddf37051ef71a20/roles/1cb1920ac8734f678410e3f1ad89de68` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:52.083217 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bb288-09d6-4790-bee5-b6f452686006 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8b578718bf04a31bc5b638315420654, user_id=dfeb743e6fb0437cbddf37051ef71a20, role_id=1cb1920ac8734f678410e3f1ad89de68)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:52.087626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bb288-09d6-4790-bee5-b6f452686006 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:52.090870 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 83/170] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:54:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:52.091863 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a6803-3677-4ca5-b2d5-b89d5e80e513 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:52.219530 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 88/171] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:54:51 2022] PUT /identity/v3/projects/d8b578718bf04a31bc5b638315420654/users/dfeb743e6fb0437cbddf37051ef71a20/roles/1cb1920ac8734f678410e3f1ad89de68 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:54:52.226429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bb288-09d6-4790-bee5-b6f452686006 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:52.278535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:52.287156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a6803-3677-4ca5-b2d5-b89d5e80e513 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:52.344779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a269b-cd50-4190-9e69-2e718d2c3783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:52.345352 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a269b-cd50-4190-9e69-2e718d2c3783 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:52.345639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a269b-cd50-4190-9e69-2e718d2c3783 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:52.345918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a269b-cd50-4190-9e69-2e718d2c3783 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:52.346725 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a269b-cd50-4190-9e69-2e718d2c3783 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:52.347043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a269b-cd50-4190-9e69-2e718d2c3783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:52.348484 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a269b-cd50-4190-9e69-2e718d2c3783 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:52.397412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 84/172] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:54:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:52.431882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a269b-cd50-4190-9e69-2e718d2c3783 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:52.607437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a269b-cd50-4190-9e69-2e718d2c3783 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:52.639671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bb288-09d6-4790-bee5-b6f452686006 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:52.662439 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639876a3-aea1-4b4f-963c-c7eb048aef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:52.663165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639876a3-aea1-4b4f-963c-c7eb048aef59 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:52.663639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639876a3-aea1-4b4f-963c-c7eb048aef59 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:52.664068 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639876a3-aea1-4b4f-963c-c7eb048aef59 None admin] PATH_INFO: `/v3/users/2a32a15f2a584ef0acafa1e4cd085d71` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:52.667059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639876a3-aea1-4b4f-963c-c7eb048aef59 None admin] RBAC: Authorizing `identity:get_user(user_id=2a32a15f2a584ef0acafa1e4cd085d71)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:52.668899 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639876a3-aea1-4b4f-963c-c7eb048aef59 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:52.670973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 85/173] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:52 2022] GET /identity/v3/users/2a32a15f2a584ef0acafa1e4cd085d71 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:52.677282 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639876a3-aea1-4b4f-963c-c7eb048aef59 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:52.717580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:52.731064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d901bef-7b37-46af-99c1-2e74a0eb01f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:52.732180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d901bef-7b37-46af-99c1-2e74a0eb01f8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:52.732674 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d901bef-7b37-46af-99c1-2e74a0eb01f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:52.733163 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d901bef-7b37-46af-99c1-2e74a0eb01f8 None admin] PATH_INFO: `/v3/users/2a32a15f2a584ef0acafa1e4cd085d71` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:52.736179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d901bef-7b37-46af-99c1-2e74a0eb01f8 None admin] RBAC: Authorizing `identity:get_user(user_id=2a32a15f2a584ef0acafa1e4cd085d71)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:52.740031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d901bef-7b37-46af-99c1-2e74a0eb01f8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:52.744650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 89/174] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:52 2022] GET /identity/v3/users/2a32a15f2a584ef0acafa1e4cd085d71 => generated 275 bytes in 524 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:52.754099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d901bef-7b37-46af-99c1-2e74a0eb01f8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:52.841300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639876a3-aea1-4b4f-963c-c7eb048aef59 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:52.843020 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:52.922906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de44a1-09d5-44bf-82c6-bd59913a797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:52.923455 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de44a1-09d5-44bf-82c6-bd59913a797d None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:52.923787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de44a1-09d5-44bf-82c6-bd59913a797d None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:52.924140 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de44a1-09d5-44bf-82c6-bd59913a797d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:52.995497 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d901bef-7b37-46af-99c1-2e74a0eb01f8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:53.061573 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cd469-f7b2-4868-86dd-ad7fa3fdc170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:53.064665 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cd469-f7b2-4868-86dd-ad7fa3fdc170 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:53.065170 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cd469-f7b2-4868-86dd-ad7fa3fdc170 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:53.065729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cd469-f7b2-4868-86dd-ad7fa3fdc170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:53.145182 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de44a1-09d5-44bf-82c6-bd59913a797d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:53.148310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de44a1-09d5-44bf-82c6-bd59913a797d None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:53.199694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:53.321403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cd469-f7b2-4868-86dd-ad7fa3fdc170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:53.324944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cd469-f7b2-4868-86dd-ad7fa3fdc170 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:53.394010 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:53.414952 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 86/175] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:54:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:53.416870 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ea11d-5454-4662-8125-159ae3f96022 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:53.417373 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ea11d-5454-4662-8125-159ae3f96022 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:53.417831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ea11d-5454-4662-8125-159ae3f96022 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:53.423772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 87/176] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:53.427652 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe05c-c337-483d-b123-5972081c9c72 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:53.428456 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe05c-c337-483d-b123-5972081c9c72 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:53.429213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe05c-c337-483d-b123-5972081c9c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:53.473269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-0f6fe05c-c337-483d-b123-5972081c9c72 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:53.474845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0f6fe05c-c337-483d-b123-5972081c9c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:53.535747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 90/177] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:54:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 782 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:53.542228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cd469-f7b2-4868-86dd-ad7fa3fdc170 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:53.618169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 88/178] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:53.621377 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc4ac7-149e-43d9-ba8d-fdef5267ebed None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:53.622208 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc4ac7-149e-43d9-ba8d-fdef5267ebed None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:53.622966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc4ac7-149e-43d9-ba8d-fdef5267ebed None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:53.625696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 89/179] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:53.627541 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc4ac7-149e-43d9-ba8d-fdef5267ebed None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:53.721938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cd469-f7b2-4868-86dd-ad7fa3fdc170 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:53.795846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:53.824027 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228092fc-66c7-4963-8ac3-7758f7dffdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:53.825792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228092fc-66c7-4963-8ac3-7758f7dffdba None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:53.827323 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228092fc-66c7-4963-8ac3-7758f7dffdba None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:53.827503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228092fc-66c7-4963-8ac3-7758f7dffdba None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:53.832342 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228092fc-66c7-4963-8ac3-7758f7dffdba None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:53.836206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228092fc-66c7-4963-8ac3-7758f7dffdba None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:53.840558 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 91/180] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:53 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:53.843897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ae9e9-d2bd-459a-84d3-384b5e17d5c9 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:53.845123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ae9e9-d2bd-459a-84d3-384b5e17d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:53.846055 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ae9e9-d2bd-459a-84d3-384b5e17d5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:53.859876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:53.887247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-732ae9e9-d2bd-459a-84d3-384b5e17d5c9 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:53.889960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-732ae9e9-d2bd-459a-84d3-384b5e17d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:53.891287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc4ac7-149e-43d9-ba8d-fdef5267ebed None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:53.947443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b2406-e557-4790-acd7-aba4b2cc3cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:53.948460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b2406-e557-4790-acd7-aba4b2cc3cdb None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:53.948833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b2406-e557-4790-acd7-aba4b2cc3cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:53.949221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b2406-e557-4790-acd7-aba4b2cc3cdb None admin] PATH_INFO: `/v3/projects/ef6148b502084d8d8e5238b168bcf198` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:53.950682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b2406-e557-4790-acd7-aba4b2cc3cdb None admin] RBAC: Authorizing `identity:get_project(project_id=ef6148b502084d8d8e5238b168bcf198)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:53.953597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b2406-e557-4790-acd7-aba4b2cc3cdb None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:53.955534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 90/181] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:53 2022] GET /identity/v3/projects/ef6148b502084d8d8e5238b168bcf198 => generated 312 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:53.956665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b2406-e557-4790-acd7-aba4b2cc3cdb None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:54.000507 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 92/182] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:54.001274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ae9e9-d2bd-459a-84d3-384b5e17d5c9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:54.133974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b2406-e557-4790-acd7-aba4b2cc3cdb None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:54.139185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ae9e9-d2bd-459a-84d3-384b5e17d5c9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:54.166504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:54.180520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac5603-cb44-4dc8-8267-c1f76b313848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:54.181320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac5603-cb44-4dc8-8267-c1f76b313848 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:54.181705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac5603-cb44-4dc8-8267-c1f76b313848 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:54.182025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac5603-cb44-4dc8-8267-c1f76b313848 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:54.196585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:54.199480 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac5603-cb44-4dc8-8267-c1f76b313848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:54.203912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b91fc-6fa9-46a4-89e0-ceb1c49c6077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:54.205194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b91fc-6fa9-46a4-89e0-ceb1c49c6077 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:54.205387 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b91fc-6fa9-46a4-89e0-ceb1c49c6077 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:54.205807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b91fc-6fa9-46a4-89e0-ceb1c49c6077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:54.207544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b91fc-6fa9-46a4-89e0-ceb1c49c6077 None admin] RBAC: Adding query filter params (role.id=3b3abbcf8ee04f0387cfdede5812d226, scope.project.id=d8b578718bf04a31bc5b638315420654, user.id=2a32a15f2a584ef0acafa1e4cd085d71) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:54.208873 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b91fc-6fa9-46a4-89e0-ceb1c49c6077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-49ac5603-cb44-4dc8-8267-c1f76b313848 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:54.209797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:54.211682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:54.213770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:54.213770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:54.213770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:54.213770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:54.213770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:54.213770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:54.213770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:54.213770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:54.213770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:54.213770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:54.213770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:54:54.213770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:54:54.213770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 91/183] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:54:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:54.220901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b91fc-6fa9-46a4-89e0-ceb1c49c6077 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:54.221161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d608-fbe1-49db-8a6d-e8a093729e77 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:54.221161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d608-fbe1-49db-8a6d-e8a093729e77 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:54.221161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d608-fbe1-49db-8a6d-e8a093729e77 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:54.221161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 92/184] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:54.221161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73d608-fbe1-49db-8a6d-e8a093729e77 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:54.242771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 93/185] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:54:54 2022] GET /identity/v3/role_assignments?user.id=2a32a15f2a584ef0acafa1e4cd085d71&scope.project.id=d8b578718bf04a31bc5b638315420654&role.id=3b3abbcf8ee04f0387cfdede5812d226 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:54.242771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b91fc-6fa9-46a4-89e0-ceb1c49c6077 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:54.418409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b91fc-6fa9-46a4-89e0-ceb1c49c6077 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:54.439416 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73d608-fbe1-49db-8a6d-e8a093729e77 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:54.468582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90653594-9c3c-4ec5-b81c-a69f28d4b3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:54.469268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90653594-9c3c-4ec5-b81c-a69f28d4b3fc None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:54.469555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90653594-9c3c-4ec5-b81c-a69f28d4b3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:54.469838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90653594-9c3c-4ec5-b81c-a69f28d4b3fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:54.485979 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90653594-9c3c-4ec5-b81c-a69f28d4b3fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-90653594-9c3c-4ec5-b81c-a69f28d4b3fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:54.496838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:54.498338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:54.499727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:54.499727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:54.499727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:54.499727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:54.499727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:54.499727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:54.499727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:54.499727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:54.499727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:54.499727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:54.499727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:54:54.499727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:54:54.499727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 94/186] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:54:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:54.499727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401f1ec-4a36-42b5-b4b3-e946c40981d1 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:54.500996 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401f1ec-4a36-42b5-b4b3-e946c40981d1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:54.500996 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401f1ec-4a36-42b5-b4b3-e946c40981d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:54.528556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1285155-fad6-4b92-be5d-bed5cb129124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:54.529204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285155-fad6-4b92-be5d-bed5cb129124 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:54.529501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285155-fad6-4b92-be5d-bed5cb129124 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:54.529783 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285155-fad6-4b92-be5d-bed5cb129124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:54.530525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d401f1ec-4a36-42b5-b4b3-e946c40981d1 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:54.530694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1285155-fad6-4b92-be5d-bed5cb129124 None admin] RBAC: Adding query filter params (role.id=7555aed6a21441208a17dedef685336f, scope.project.id=ef6148b502084d8d8e5238b168bcf198, user.id=2a32a15f2a584ef0acafa1e4cd085d71) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:54.530947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1285155-fad6-4b92-be5d-bed5cb129124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:54.532451 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1285155-fad6-4b92-be5d-bed5cb129124 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:54.533587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d401f1ec-4a36-42b5-b4b3-e946c40981d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:54.545425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 93/187] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:54:54 2022] GET /identity/v3/role_assignments?user.id=2a32a15f2a584ef0acafa1e4cd085d71&scope.project.id=ef6148b502084d8d8e5238b168bcf198&role.id=7555aed6a21441208a17dedef685336f => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:54.547218 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1285155-fad6-4b92-be5d-bed5cb129124 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:54.638763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:54.693232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:54.727470 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 95/188] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:54.728396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401f1ec-4a36-42b5-b4b3-e946c40981d1 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:54.796071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1285155-fad6-4b92-be5d-bed5cb129124 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:54.870593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7f882-950b-4292-9ef0-5d673edd3c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:54.871615 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7f882-950b-4292-9ef0-5d673edd3c58 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:54.872002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7f882-950b-4292-9ef0-5d673edd3c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:54.872495 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7f882-950b-4292-9ef0-5d673edd3c58 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:54.873423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7f882-950b-4292-9ef0-5d673edd3c58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:54.873863 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7f882-950b-4292-9ef0-5d673edd3c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:54.876547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7f882-950b-4292-9ef0-5d673edd3c58 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:54.890308 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 94/189] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:54.891532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7f882-950b-4292-9ef0-5d673edd3c58 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:54.997385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401f1ec-4a36-42b5-b4b3-e946c40981d1 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:55.068179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bc341-b2a1-416e-9d7c-62737f34db2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:55.069202 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bc341-b2a1-416e-9d7c-62737f34db2d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:55.069694 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bc341-b2a1-416e-9d7c-62737f34db2d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:55.070427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bc341-b2a1-416e-9d7c-62737f34db2d None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:55.071560 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bc341-b2a1-416e-9d7c-62737f34db2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:55.072111 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bc341-b2a1-416e-9d7c-62737f34db2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:55.074916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bc341-b2a1-416e-9d7c-62737f34db2d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:55.091991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 96/190] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:54:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:55.093509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bc341-b2a1-416e-9d7c-62737f34db2d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:55.130635 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7f882-950b-4292-9ef0-5d673edd3c58 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:55.153465 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:55.181259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:55.201196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d70aa-54e2-45e8-be9b-02b3e1eb7bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:55.202342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d70aa-54e2-45e8-be9b-02b3e1eb7bec None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:55.202896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d70aa-54e2-45e8-be9b-02b3e1eb7bec None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:55.203400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d70aa-54e2-45e8-be9b-02b3e1eb7bec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:55.205802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d70aa-54e2-45e8-be9b-02b3e1eb7bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:55.208900 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d70aa-54e2-45e8-be9b-02b3e1eb7bec None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:55.219060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 95/191] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:54:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:55.219060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d70aa-54e2-45e8-be9b-02b3e1eb7bec None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:55.251680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bc341-b2a1-416e-9d7c-62737f34db2d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:55.318678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58236941-c259-4233-88f7-6cbb10563f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:55.320128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58236941-c259-4233-88f7-6cbb10563f89 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:55.320834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58236941-c259-4233-88f7-6cbb10563f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:55.321548 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58236941-c259-4233-88f7-6cbb10563f89 None admin] PATH_INFO: `/v3/users/6030e4731648499da8b7cfcdecb660aa` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:55.349729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58236941-c259-4233-88f7-6cbb10563f89 None admin] RBAC: Authorizing `identity:get_user(user_id=6030e4731648499da8b7cfcdecb660aa)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:55.352736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58236941-c259-4233-88f7-6cbb10563f89 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:55.356128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 97/192] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:55 2022] GET /identity/v3/users/6030e4731648499da8b7cfcdecb660aa => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:55.357546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58236941-c259-4233-88f7-6cbb10563f89 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:55.398155 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d70aa-54e2-45e8-be9b-02b3e1eb7bec None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:55.469543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793eb6ce-6288-49e4-90f5-3f1b8feef8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:55.470611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793eb6ce-6288-49e4-90f5-3f1b8feef8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:55.471019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793eb6ce-6288-49e4-90f5-3f1b8feef8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:55.471475 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793eb6ce-6288-49e4-90f5-3f1b8feef8e6 None admin] PATH_INFO: `/v3/users/6030e4731648499da8b7cfcdecb660aa` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:55.473512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793eb6ce-6288-49e4-90f5-3f1b8feef8e6 None admin] RBAC: Authorizing `identity:get_user(user_id=6030e4731648499da8b7cfcdecb660aa)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:55.477298 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793eb6ce-6288-49e4-90f5-3f1b8feef8e6 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:55.480043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 96/193] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:55 2022] GET /identity/v3/users/6030e4731648499da8b7cfcdecb660aa => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:55.481410 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793eb6ce-6288-49e4-90f5-3f1b8feef8e6 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:55.556142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:55.564399 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58236941-c259-4233-88f7-6cbb10563f89 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:55.581837 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:55.622222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2965286-bdf5-41c0-b6d6-b4713edd3ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:55.623120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2965286-bdf5-41c0-b6d6-b4713edd3ae7 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:55.623606 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2965286-bdf5-41c0-b6d6-b4713edd3ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:55.623894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2965286-bdf5-41c0-b6d6-b4713edd3ae7 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:55.624623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2965286-bdf5-41c0-b6d6-b4713edd3ae7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:55.626128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2965286-bdf5-41c0-b6d6-b4713edd3ae7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:55.658113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793eb6ce-6288-49e4-90f5-3f1b8feef8e6 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:55.707532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368d618-ab7e-4d92-b7eb-84a8127833e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:55.708331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368d618-ab7e-4d92-b7eb-84a8127833e0 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:55.708780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368d618-ab7e-4d92-b7eb-84a8127833e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:55.709266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368d618-ab7e-4d92-b7eb-84a8127833e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:55.733814 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 98/194] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:54:55 2022] POST /identity/v3/users => generated 297 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:54:55.733814 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fc26e-98bb-49a8-be04-dd22b0688052 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:55.733814 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fc26e-98bb-49a8-be04-dd22b0688052 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:55.733814 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fc26e-98bb-49a8-be04-dd22b0688052 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:55.733814 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 99/195] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:55.733814 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fc26e-98bb-49a8-be04-dd22b0688052 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:55.848715 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368d618-ab7e-4d92-b7eb-84a8127833e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:55.851529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368d618-ab7e-4d92-b7eb-84a8127833e0 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:55.936012 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fc26e-98bb-49a8-be04-dd22b0688052 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:55.938759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:56.008222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260de2d-bab9-43c9-bef3-903e1fbda796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:56.009436 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260de2d-bab9-43c9-bef3-903e1fbda796 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:56.009946 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260de2d-bab9-43c9-bef3-903e1fbda796 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:56.010479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260de2d-bab9-43c9-bef3-903e1fbda796 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:56.043999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 97/196] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:54:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:56.044997 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d361ef-7e28-48d7-b3c8-77a7f2383e8d None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:56.045290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d361ef-7e28-48d7-b3c8-77a7f2383e8d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:56.045564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d361ef-7e28-48d7-b3c8-77a7f2383e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:56.073492 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:56.075819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-06d361ef-7e28-48d7-b3c8-77a7f2383e8d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:56.077795 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-06d361ef-7e28-48d7-b3c8-77a7f2383e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:56.147372 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260de2d-bab9-43c9-bef3-903e1fbda796 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:56.149201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260de2d-bab9-43c9-bef3-903e1fbda796 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:56.228268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 98/197] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:56.229635 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d361ef-7e28-48d7-b3c8-77a7f2383e8d None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:56.407820 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 100/198] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:54:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:56.411763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260de2d-bab9-43c9-bef3-903e1fbda796 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:56.415471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:56.468493 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d361ef-7e28-48d7-b3c8-77a7f2383e8d None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:56.544663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5873558-106f-4ff4-b825-fe1b35147603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:56.546070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5873558-106f-4ff4-b825-fe1b35147603 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:56.546778 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5873558-106f-4ff4-b825-fe1b35147603 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:56.547379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5873558-106f-4ff4-b825-fe1b35147603 None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:56.549912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5873558-106f-4ff4-b825-fe1b35147603 None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:56.553944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:56.554852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5873558-106f-4ff4-b825-fe1b35147603 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:56.559747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 99/199] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:56 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:56.561702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5873558-106f-4ff4-b825-fe1b35147603 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:56.638646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260de2d-bab9-43c9-bef3-903e1fbda796 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:56.708944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e02aa-8bfa-4b14-8567-53f375eb3c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:56.710240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e02aa-8bfa-4b14-8567-53f375eb3c0a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:56.710875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e02aa-8bfa-4b14-8567-53f375eb3c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:56.711347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e02aa-8bfa-4b14-8567-53f375eb3c0a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:56.734889 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e02aa-8bfa-4b14-8567-53f375eb3c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-080e02aa-8bfa-4b14-8567-53f375eb3c0a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:56.745970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:56.746995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:56.747789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:56.747789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:56.747789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:56.747789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:56.747789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:56.747789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:56.747789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:56.747789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:56.747789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:56.747789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:56.747789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:54:56.747789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:54:56.748553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 101/200] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:56.749659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e02aa-8bfa-4b14-8567-53f375eb3c0a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:56.776559 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5873558-106f-4ff4-b825-fe1b35147603 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:56.836326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926cac3-962b-4a83-bc16-eb1e88a0f262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:56.837624 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926cac3-962b-4a83-bc16-eb1e88a0f262 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:56.838113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926cac3-962b-4a83-bc16-eb1e88a0f262 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:56.838601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926cac3-962b-4a83-bc16-eb1e88a0f262 None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:56.840323 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926cac3-962b-4a83-bc16-eb1e88a0f262 None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:56.843027 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926cac3-962b-4a83-bc16-eb1e88a0f262 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:56.846245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 100/201] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:56 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:56.853659 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926cac3-962b-4a83-bc16-eb1e88a0f262 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:56.877462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:56.960286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e02aa-8bfa-4b14-8567-53f375eb3c0a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:57.008913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:57.030584 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137047aa-0550-4c78-829f-ecd95a407cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:57.031756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137047aa-0550-4c78-829f-ecd95a407cdd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:57.032262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137047aa-0550-4c78-829f-ecd95a407cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:57.032748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137047aa-0550-4c78-829f-ecd95a407cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:57.035158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137047aa-0550-4c78-829f-ecd95a407cdd None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=03c5e81f100d42b1bcc655353fbecbc8, user.id=6030e4731648499da8b7cfcdecb660aa) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:57.035158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137047aa-0550-4c78-829f-ecd95a407cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:57.039018 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137047aa-0550-4c78-829f-ecd95a407cdd None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:57.049975 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 102/202] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:54:56 2022] GET /identity/v3/role_assignments?user.id=6030e4731648499da8b7cfcdecb660aa&scope.project.id=03c5e81f100d42b1bcc655353fbecbc8&role.id=17054492864541709fda49dbf677a7a2 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:57.060358 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137047aa-0550-4c78-829f-ecd95a407cdd None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:57.064892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926cac3-962b-4a83-bc16-eb1e88a0f262 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:57.136283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8932-8c51-4aab-b82e-69d606d6580b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:57.137470 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8932-8c51-4aab-b82e-69d606d6580b None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:57.137977 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8932-8c51-4aab-b82e-69d606d6580b None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:57.138494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8932-8c51-4aab-b82e-69d606d6580b None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:57.139744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e8932-8c51-4aab-b82e-69d606d6580b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:57.141649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e8932-8c51-4aab-b82e-69d606d6580b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:57.143845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e8932-8c51-4aab-b82e-69d606d6580b None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:57.164715 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 101/203] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:54:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:57.180159 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8932-8c51-4aab-b82e-69d606d6580b None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:57.351472 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:57.417762 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8932-8c51-4aab-b82e-69d606d6580b None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:57.418693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137047aa-0550-4c78-829f-ecd95a407cdd None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:57.508060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d93346-1a4a-488f-9251-860ce25fe6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:57.508753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d93346-1a4a-488f-9251-860ce25fe6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:57.509042 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d93346-1a4a-488f-9251-860ce25fe6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:57.509326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d93346-1a4a-488f-9251-860ce25fe6f8 None admin] PATH_INFO: `/v3/users/dfeb743e6fb0437cbddf37051ef71a20` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:57.511988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d93346-1a4a-488f-9251-860ce25fe6f8 None admin] RBAC: Authorizing `identity:get_user(user_id=dfeb743e6fb0437cbddf37051ef71a20)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:57.513516 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d93346-1a4a-488f-9251-860ce25fe6f8 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:57.515403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 102/204] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:54:57 2022] GET /identity/v3/users/dfeb743e6fb0437cbddf37051ef71a20 => generated 289 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:57.525664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d93346-1a4a-488f-9251-860ce25fe6f8 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:57.528673 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4170d9f-21b5-47a0-887a-57db4d746fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:57.529572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4170d9f-21b5-47a0-887a-57db4d746fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:57.529862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4170d9f-21b5-47a0-887a-57db4d746fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:57.530147 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4170d9f-21b5-47a0-887a-57db4d746fa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:57.531310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4170d9f-21b5-47a0-887a-57db4d746fa3 None admin] RBAC: Adding query filter params (role.id=3b3abbcf8ee04f0387cfdede5812d226, scope.project.id=03c5e81f100d42b1bcc655353fbecbc8, user.id=6030e4731648499da8b7cfcdecb660aa) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:57.531853 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4170d9f-21b5-47a0-887a-57db4d746fa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:57.533616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4170d9f-21b5-47a0-887a-57db4d746fa3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:57.562545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 103/205] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:54:57 2022] GET /identity/v3/role_assignments?user.id=6030e4731648499da8b7cfcdecb660aa&scope.project.id=03c5e81f100d42b1bcc655353fbecbc8&role.id=3b3abbcf8ee04f0387cfdede5812d226 => generated 259 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:57.717235 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d93346-1a4a-488f-9251-860ce25fe6f8 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:57.791954 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc4631-b717-4087-8bf5-740d28b36f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:57.793118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc4631-b717-4087-8bf5-740d28b36f44 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:57.793571 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc4631-b717-4087-8bf5-740d28b36f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:57.794083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc4631-b717-4087-8bf5-740d28b36f44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:57.822943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:57.944381 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc4631-b717-4087-8bf5-740d28b36f44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:57.947376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc4631-b717-4087-8bf5-740d28b36f44 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:58.151368 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 103/206] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:54:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:58.164518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4170d9f-21b5-47a0-887a-57db4d746fa3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:58.289452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:58.371744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4170d9f-21b5-47a0-887a-57db4d746fa3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:58.423614 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e66fd-aa5a-45d3-aa7c-1bae43e2e738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:58.425412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e66fd-aa5a-45d3-aa7c-1bae43e2e738 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:58.425412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e66fd-aa5a-45d3-aa7c-1bae43e2e738 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:58.425412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e66fd-aa5a-45d3-aa7c-1bae43e2e738 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:58.427860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e66fd-aa5a-45d3-aa7c-1bae43e2e738 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:58.429262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e66fd-aa5a-45d3-aa7c-1bae43e2e738 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:58.431319 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 104/207] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:54:58 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:54:58.440290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc4631-b717-4087-8bf5-740d28b36f44 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:58.526857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:58.638300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc4631-b717-4087-8bf5-740d28b36f44 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:58.724959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee9ff0-0b9d-4ef8-8e1e-bf79466c5261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:58.726030 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee9ff0-0b9d-4ef8-8e1e-bf79466c5261 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:58.726580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee9ff0-0b9d-4ef8-8e1e-bf79466c5261 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:58.727164 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee9ff0-0b9d-4ef8-8e1e-bf79466c5261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:58.728764 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee9ff0-0b9d-4ef8-8e1e-bf79466c5261 None admin] RBAC: Adding query filter params (role.id=1cb1920ac8734f678410e3f1ad89de68, scope.project.id=d8b578718bf04a31bc5b638315420654, user.id=dfeb743e6fb0437cbddf37051ef71a20) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:54:58.729347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee9ff0-0b9d-4ef8-8e1e-bf79466c5261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:58.732249 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee9ff0-0b9d-4ef8-8e1e-bf79466c5261 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:58.748063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 104/208] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:54:58 2022] GET /identity/v3/role_assignments?user.id=dfeb743e6fb0437cbddf37051ef71a20&scope.project.id=d8b578718bf04a31bc5b638315420654&role.id=1cb1920ac8734f678410e3f1ad89de68 => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:54:59.549115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cd7d8-44cb-43b1-a644-e509cc615a29 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:59.549882 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cd7d8-44cb-43b1-a644-e509cc615a29 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:59.549882 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cd7d8-44cb-43b1-a644-e509cc615a29 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:59.552219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 105/209] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:54:59.560471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44947b3e-f0e3-4cf0-b2e7-1d0cf946b750 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:59.561229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44947b3e-f0e3-4cf0-b2e7-1d0cf946b750 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:59.561229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44947b3e-f0e3-4cf0-b2e7-1d0cf946b750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:59.583149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-44947b3e-f0e3-4cf0-b2e7-1d0cf946b750 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:59.585072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-44947b3e-f0e3-4cf0-b2e7-1d0cf946b750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:59.680142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 105/210] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:59.717091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c258a-352b-43f8-ab6b-a0a35856aaca None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:59.717432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c258a-352b-43f8-ab6b-a0a35856aaca None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:59.717649 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c258a-352b-43f8-ab6b-a0a35856aaca None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:59.719431 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 106/211] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:59.722007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44947b3e-f0e3-4cf0-b2e7-1d0cf946b750 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:59.730164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee8a19-7b00-43e9-8fd2-82f3aadb71f7 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:59.731184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee8a19-7b00-43e9-8fd2-82f3aadb71f7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:59.731950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee8a19-7b00-43e9-8fd2-82f3aadb71f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:59.764711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:59.766904 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-45ee8a19-7b00-43e9-8fd2-82f3aadb71f7 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:59.769564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-45ee8a19-7b00-43e9-8fd2-82f3aadb71f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:59.874680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44947b3e-f0e3-4cf0-b2e7-1d0cf946b750 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:59.946713 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281730b-db8a-4eca-832a-3a1ea013d633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:59.947871 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281730b-db8a-4eca-832a-3a1ea013d633 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:59.948385 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281730b-db8a-4eca-832a-3a1ea013d633 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:59.948903 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281730b-db8a-4eca-832a-3a1ea013d633 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:59.958333 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 107/212] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:54:59.972342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281730b-db8a-4eca-832a-3a1ea013d633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-c281730b-db8a-4eca-832a-3a1ea013d633 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:54:59.983606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:54:59.985383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:54:59.986962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:54:59.986962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:54:59.986962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:54:59.986962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:54:59.986962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:54:59.986962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:54:59.986962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:54:59.986962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:54:59.986962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:54:59.986962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:54:59.986962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:54:59.986962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:54:59.986962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 106/213] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:54:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:54:59.997479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee8a19-7b00-43e9-8fd2-82f3aadb71f7 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:00.010703 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281730b-db8a-4eca-832a-3a1ea013d633 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:00.107282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:00.150021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:00.158124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281730b-db8a-4eca-832a-3a1ea013d633 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:00.210949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e5b2b-4940-4ef0-814d-c4b13adbcd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:00.212057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e5b2b-4940-4ef0-814d-c4b13adbcd72 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:00.212623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e5b2b-4940-4ef0-814d-c4b13adbcd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:00.213177 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e5b2b-4940-4ef0-814d-c4b13adbcd72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:00.215642 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e5b2b-4940-4ef0-814d-c4b13adbcd72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:00.218382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e5b2b-4940-4ef0-814d-c4b13adbcd72 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:00.220691 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee8a19-7b00-43e9-8fd2-82f3aadb71f7 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:00.227979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 107/214] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:00.233663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e5b2b-4940-4ef0-814d-c4b13adbcd72 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:00.296941 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3140da-7fd1-4677-83cf-5e3562a81f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:00.298756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3140da-7fd1-4677-83cf-5e3562a81f9b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:00.299666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3140da-7fd1-4677-83cf-5e3562a81f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:00.300446 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3140da-7fd1-4677-83cf-5e3562a81f9b None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:00.302760 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3140da-7fd1-4677-83cf-5e3562a81f9b None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:00.303659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3140da-7fd1-4677-83cf-5e3562a81f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:00.306739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3140da-7fd1-4677-83cf-5e3562a81f9b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:00.326635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 108/215] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:54:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:00.338575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3140da-7fd1-4677-83cf-5e3562a81f9b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:00.429293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e5b2b-4940-4ef0-814d-c4b13adbcd72 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:00.501037 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ff4c8-2aa7-4282-b154-a6d8bc2f171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:00.502059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ff4c8-2aa7-4282-b154-a6d8bc2f171c None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:00.502589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ff4c8-2aa7-4282-b154-a6d8bc2f171c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:00.503063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ff4c8-2aa7-4282-b154-a6d8bc2f171c None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:00.505112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ff4c8-2aa7-4282-b154-a6d8bc2f171c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:00.507636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ff4c8-2aa7-4282-b154-a6d8bc2f171c None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:00.559028 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3140da-7fd1-4677-83cf-5e3562a81f9b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:00.581752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:00.614206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 108/216] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:55:00 2022] POST /identity/v3/users => generated 297 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:55:00.615593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8259a1-dbdb-4e17-a7f2-6c89b97f9a07 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:00.615885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8259a1-dbdb-4e17-a7f2-6c89b97f9a07 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:00.616241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8259a1-dbdb-4e17-a7f2-6c89b97f9a07 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:00.617867 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 109/217] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:00.629222 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118b53e-48e7-4647-bf23-43b89e6112da None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:00.630299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118b53e-48e7-4647-bf23-43b89e6112da None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:00.631068 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118b53e-48e7-4647-bf23-43b89e6112da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:00.635233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce93cb1-2659-471d-be63-b4ebc24141f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:00.636998 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce93cb1-2659-471d-be63-b4ebc24141f9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:00.637868 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce93cb1-2659-471d-be63-b4ebc24141f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:00.638718 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce93cb1-2659-471d-be63-b4ebc24141f9 None admin] PATH_INFO: `/v3/users/c5ed401465eb4f32a274bf7cc42986a9` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:00.668076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-c118b53e-48e7-4647-bf23-43b89e6112da None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:00.670977 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c118b53e-48e7-4647-bf23-43b89e6112da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:00.672277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce93cb1-2659-471d-be63-b4ebc24141f9 None admin] RBAC: Authorizing `identity:get_user(user_id=c5ed401465eb4f32a274bf7cc42986a9)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:00.676251 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce93cb1-2659-471d-be63-b4ebc24141f9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:00.690244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 109/218] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:00 2022] GET /identity/v3/users/c5ed401465eb4f32a274bf7cc42986a9 => generated 297 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:00.691356 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce93cb1-2659-471d-be63-b4ebc24141f9 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:00.704029 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:00.831621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 110/219] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:00.856595 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118b53e-48e7-4647-bf23-43b89e6112da None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:00.919712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce93cb1-2659-471d-be63-b4ebc24141f9 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:00.985039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78724b69-c775-4641-8efa-8ca4196a22b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:00.986348 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78724b69-c775-4641-8efa-8ca4196a22b8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:00.987053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78724b69-c775-4641-8efa-8ca4196a22b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:00.987693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78724b69-c775-4641-8efa-8ca4196a22b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:01.054566 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118b53e-48e7-4647-bf23-43b89e6112da None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:01.055137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:01.110728 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78724b69-c775-4641-8efa-8ca4196a22b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:01.112677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78724b69-c775-4641-8efa-8ca4196a22b8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:01.120455 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deeabf5-7198-48ca-96c5-09b76f534ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:01.121704 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deeabf5-7198-48ca-96c5-09b76f534ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:01.122267 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deeabf5-7198-48ca-96c5-09b76f534ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:01.122811 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deeabf5-7198-48ca-96c5-09b76f534ff0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:01.158307 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deeabf5-7198-48ca-96c5-09b76f534ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-6deeabf5-7198-48ca-96c5-09b76f534ff0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:01.167408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:01.169829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:01.171400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:01.171400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:01.171400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:01.171400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:01.171400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:01.171400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:01.171400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:01.171400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:01.171400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:01.171400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:01.171400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:55:01.171400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:01.171400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 111/220] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:55:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:55:01.171400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a5133-556b-468d-8310-9af6bf4e7747 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:01.172751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a5133-556b-468d-8310-9af6bf4e7747 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:01.172751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a5133-556b-468d-8310-9af6bf4e7747 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:01.172751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 112/221] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:01.181181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78a23a-0f1d-440d-aac2-1ba7e5fd08e1 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:01.181181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78a23a-0f1d-440d-aac2-1ba7e5fd08e1 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:01.181181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78a23a-0f1d-440d-aac2-1ba7e5fd08e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:01.200723 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-8e78a23a-0f1d-440d-aac2-1ba7e5fd08e1 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:01.201964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8e78a23a-0f1d-440d-aac2-1ba7e5fd08e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:01.206513 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:01.289509 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 113/222] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:01.295019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78a23a-0f1d-440d-aac2-1ba7e5fd08e1 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:01.335320 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 110/223] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:01.344863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78724b69-c775-4641-8efa-8ca4196a22b8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:01.472148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:01.534582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78724b69-c775-4641-8efa-8ca4196a22b8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:01.575534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78a23a-0f1d-440d-aac2-1ba7e5fd08e1 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:01.602213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e06ff-0587-4515-b5db-77d5124682e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:01.603936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e06ff-0587-4515-b5db-77d5124682e9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:01.604398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e06ff-0587-4515-b5db-77d5124682e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:01.604839 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e06ff-0587-4515-b5db-77d5124682e9 None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:01.607370 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e06ff-0587-4515-b5db-77d5124682e9 None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:01.610917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e06ff-0587-4515-b5db-77d5124682e9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:01.614606 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 111/224] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:01 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:01.616139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e06ff-0587-4515-b5db-77d5124682e9 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:01.648042 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01506c-9310-46d0-9fa6-20818377f3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:01.648741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01506c-9310-46d0-9fa6-20818377f3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:01.649026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01506c-9310-46d0-9fa6-20818377f3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:01.649297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01506c-9310-46d0-9fa6-20818377f3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:01.650098 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01506c-9310-46d0-9fa6-20818377f3b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:01.650432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01506c-9310-46d0-9fa6-20818377f3b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:01.651907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01506c-9310-46d0-9fa6-20818377f3b8 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:01.663664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 114/225] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:01.664676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01506c-9310-46d0-9fa6-20818377f3b8 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:01.670948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:01.811002 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e06ff-0587-4515-b5db-77d5124682e9 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:01.828845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01506c-9310-46d0-9fa6-20818377f3b8 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:01.858735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf86aa-9667-4e7f-8cea-cf1399362542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:01.859327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf86aa-9667-4e7f-8cea-cf1399362542 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:01.859821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf86aa-9667-4e7f-8cea-cf1399362542 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:01.860153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf86aa-9667-4e7f-8cea-cf1399362542 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:01.864216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:01.876093 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf86aa-9667-4e7f-8cea-cf1399362542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-7edf86aa-9667-4e7f-8cea-cf1399362542 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:01.881642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:01.883537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:01.885031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:01.885031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:01.885031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:01.885031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:01.885031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:01.885031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:01.885031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:01.885031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:01.885031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:01.885031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:01.885031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:01.885031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:01.885031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 112/226] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:55:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:01.885031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf86aa-9667-4e7f-8cea-cf1399362542 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:01.906830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4611c-b749-4033-b0c4-c38f9b32c8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:01.908390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4611c-b749-4033-b0c4-c38f9b32c8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:01.909184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4611c-b749-4033-b0c4-c38f9b32c8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:01.909986 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4611c-b749-4033-b0c4-c38f9b32c8e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:01.912096 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4611c-b749-4033-b0c4-c38f9b32c8e3 None admin] RBAC: Adding query filter params (role.id=7555aed6a21441208a17dedef685336f, scope.project.id=03c5e81f100d42b1bcc655353fbecbc8, user.id=c5ed401465eb4f32a274bf7cc42986a9) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:01.912992 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4611c-b749-4033-b0c4-c38f9b32c8e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:01.916125 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4611c-b749-4033-b0c4-c38f9b32c8e3 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:01.928017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 115/227] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:55:01 2022] GET /identity/v3/role_assignments?user.id=c5ed401465eb4f32a274bf7cc42986a9&scope.project.id=03c5e81f100d42b1bcc655353fbecbc8&role.id=7555aed6a21441208a17dedef685336f => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:01.929967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4611c-b749-4033-b0c4-c38f9b32c8e3 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:02.063738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:02.077621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf86aa-9667-4e7f-8cea-cf1399362542 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:02.141342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4611c-b749-4033-b0c4-c38f9b32c8e3 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:02.154209 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8823e15-f904-4837-b99d-36463f7ecdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:02.154933 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8823e15-f904-4837-b99d-36463f7ecdbc None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:02.155223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8823e15-f904-4837-b99d-36463f7ecdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:02.155496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8823e15-f904-4837-b99d-36463f7ecdbc None admin] PATH_INFO: `/v3/users/6030e4731648499da8b7cfcdecb660aa` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:02.156790 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8823e15-f904-4837-b99d-36463f7ecdbc None admin] RBAC: Authorizing `identity:get_user(user_id=6030e4731648499da8b7cfcdecb660aa)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:02.158429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8823e15-f904-4837-b99d-36463f7ecdbc None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:02.161067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 113/228] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:01 2022] GET /identity/v3/users/6030e4731648499da8b7cfcdecb660aa => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:02.171443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8823e15-f904-4837-b99d-36463f7ecdbc None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:02.242847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fddfb3-5f9f-49cb-a962-2143fd5131b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:02.244482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fddfb3-5f9f-49cb-a962-2143fd5131b6 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:02.247250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fddfb3-5f9f-49cb-a962-2143fd5131b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:02.250063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fddfb3-5f9f-49cb-a962-2143fd5131b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:02.253320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fddfb3-5f9f-49cb-a962-2143fd5131b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:02.254925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fddfb3-5f9f-49cb-a962-2143fd5131b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:02.258112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fddfb3-5f9f-49cb-a962-2143fd5131b6 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:02.293686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 116/229] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:55:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:02.303648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fddfb3-5f9f-49cb-a962-2143fd5131b6 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:02.374957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:02.519680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8823e15-f904-4837-b99d-36463f7ecdbc None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:02.602023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776125f7-034e-4fba-a935-78217c71e05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:02.606622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776125f7-034e-4fba-a935-78217c71e05c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:02.608313 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776125f7-034e-4fba-a935-78217c71e05c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:02.611073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776125f7-034e-4fba-a935-78217c71e05c None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:02.624678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776125f7-034e-4fba-a935-78217c71e05c None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:02.628131 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776125f7-034e-4fba-a935-78217c71e05c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:02.632656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 114/230] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:02 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:02.644139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776125f7-034e-4fba-a935-78217c71e05c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:02.689400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fddfb3-5f9f-49cb-a962-2143fd5131b6 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:02.748486 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:02.768076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd90236-f91a-49f9-bb0c-ef0e17129452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:02.769010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd90236-f91a-49f9-bb0c-ef0e17129452 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:02.769529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd90236-f91a-49f9-bb0c-ef0e17129452 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:02.770615 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd90236-f91a-49f9-bb0c-ef0e17129452 None admin] PATH_INFO: `/v3/users/6030e4731648499da8b7cfcdecb660aa` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:02.777536 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd90236-f91a-49f9-bb0c-ef0e17129452 None admin] RBAC: Authorizing `identity:get_user(user_id=6030e4731648499da8b7cfcdecb660aa)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:02.780510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd90236-f91a-49f9-bb0c-ef0e17129452 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:02.783866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 117/231] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:02 2022] GET /identity/v3/users/6030e4731648499da8b7cfcdecb660aa => generated 283 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:02.801631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd90236-f91a-49f9-bb0c-ef0e17129452 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:03.045317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776125f7-034e-4fba-a935-78217c71e05c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:03.118948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ab2f2-5462-4667-8404-792ffa714c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:03.120440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ab2f2-5462-4667-8404-792ffa714c4e None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:03.120830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ab2f2-5462-4667-8404-792ffa714c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:03.121284 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ab2f2-5462-4667-8404-792ffa714c4e None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8/users/6030e4731648499da8b7cfcdecb660aa/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:03.125298 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ab2f2-5462-4667-8404-792ffa714c4e None admin] RBAC: Authorizing `identity:create_grant(project_id=03c5e81f100d42b1bcc655353fbecbc8, user_id=6030e4731648499da8b7cfcdecb660aa, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:03.130389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ab2f2-5462-4667-8404-792ffa714c4e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:03.132884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd90236-f91a-49f9-bb0c-ef0e17129452 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:03.135039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:03.175808 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ed049-3ad3-41e4-9807-a6218376e259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:03.177212 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ed049-3ad3-41e4-9807-a6218376e259 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:03.177624 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ed049-3ad3-41e4-9807-a6218376e259 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:03.177998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ed049-3ad3-41e4-9807-a6218376e259 None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:03.179531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ed049-3ad3-41e4-9807-a6218376e259 None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:03.181377 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ed049-3ad3-41e4-9807-a6218376e259 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:03.183599 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 118/232] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:02 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:03.190147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ed049-3ad3-41e4-9807-a6218376e259 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:03.220577 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 115/233] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:55:02 2022] PUT /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8/users/6030e4731648499da8b7cfcdecb660aa/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:55:03.326968 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:03.389520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ed049-3ad3-41e4-9807-a6218376e259 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:03.445487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62274684-bb62-494b-807f-9b1835d2cc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:03.446321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62274684-bb62-494b-807f-9b1835d2cc1f None admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:03.446644 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62274684-bb62-494b-807f-9b1835d2cc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:03.446933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62274684-bb62-494b-807f-9b1835d2cc1f None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8/users/6030e4731648499da8b7cfcdecb660aa/roles/3b3abbcf8ee04f0387cfdede5812d226` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:03.449421 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62274684-bb62-494b-807f-9b1835d2cc1f None admin] RBAC: Authorizing `identity:create_grant(project_id=03c5e81f100d42b1bcc655353fbecbc8, user_id=6030e4731648499da8b7cfcdecb660aa, role_id=3b3abbcf8ee04f0387cfdede5812d226)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:03.451024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62274684-bb62-494b-807f-9b1835d2cc1f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:03.591707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 119/234] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:55:03 2022] PUT /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8/users/6030e4731648499da8b7cfcdecb660aa/roles/3b3abbcf8ee04f0387cfdede5812d226 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:55:03.867858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58849eea-a3d9-4c9f-855f-8736ca5f4a3d None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:03.868651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58849eea-a3d9-4c9f-855f-8736ca5f4a3d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:03.868651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58849eea-a3d9-4c9f-855f-8736ca5f4a3d None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:03.870151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 116/235] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:03.877850 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51787a-d14d-4ec4-ad5c-2307237ef642 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:03.878655 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51787a-d14d-4ec4-ad5c-2307237ef642 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:03.878655 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51787a-d14d-4ec4-ad5c-2307237ef642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:03.900691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-bb51787a-d14d-4ec4-ad5c-2307237ef642 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:03.902168 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-bb51787a-d14d-4ec4-ad5c-2307237ef642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:04.056413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 120/236] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:04.058001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe7dc8-e0f1-44ec-a077-66cfeedde9a9 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:04.058293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe7dc8-e0f1-44ec-a077-66cfeedde9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:04.058603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe7dc8-e0f1-44ec-a077-66cfeedde9a9 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:04.060392 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 117/237] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:04.068945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b09690-f46e-4aa1-b07c-bf0b961bf9e2 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:04.069426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b09690-f46e-4aa1-b07c-bf0b961bf9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:04.069912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b09690-f46e-4aa1-b07c-bf0b961bf9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:04.104602 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe7dc8-e0f1-44ec-a077-66cfeedde9a9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:04.108204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d7b09690-f46e-4aa1-b07c-bf0b961bf9e2 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:04.109552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d7b09690-f46e-4aa1-b07c-bf0b961bf9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:04.230962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:04.272353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 121/238] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:04.335658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b09690-f46e-4aa1-b07c-bf0b961bf9e2 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:04.349291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe7dc8-e0f1-44ec-a077-66cfeedde9a9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:04.467665 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b2fc1-9007-450b-98d3-7bbedbb9e6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:04.468334 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b2fc1-9007-450b-98d3-7bbedbb9e6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:04.468617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b2fc1-9007-450b-98d3-7bbedbb9e6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:04.468892 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b2fc1-9007-450b-98d3-7bbedbb9e6d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:04.502772 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b2fc1-9007-450b-98d3-7bbedbb9e6d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-1b6b2fc1-9007-450b-98d3-7bbedbb9e6d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:04.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:04.512366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:04.514077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:04.514077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:04.514077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:04.514077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:04.514077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:04.514077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:04.514077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:04.514077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:04.514077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:04.514077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:04.514077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:55:04.514077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:04.514077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 118/239] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:55:04.528644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b2fc1-9007-450b-98d3-7bbedbb9e6d7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:04.576066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b09690-f46e-4aa1-b07c-bf0b961bf9e2 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:04.626985 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff973fc-1054-4483-8801-4b19d3a116ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:04.628106 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff973fc-1054-4483-8801-4b19d3a116ab None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:04.628591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff973fc-1054-4483-8801-4b19d3a116ab None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:04.630910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff973fc-1054-4483-8801-4b19d3a116ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:04.637327 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff973fc-1054-4483-8801-4b19d3a116ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:04.641342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff973fc-1054-4483-8801-4b19d3a116ab None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:04.646667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 122/240] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:04.660973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff973fc-1054-4483-8801-4b19d3a116ab None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:04.671748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:04.791544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b2fc1-9007-450b-98d3-7bbedbb9e6d7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:04.806740 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:04.900286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd3ea7-3a7c-4c2c-af0d-a8dc43f56537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:04.900987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd3ea7-3a7c-4c2c-af0d-a8dc43f56537 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:04.901222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd3ea7-3a7c-4c2c-af0d-a8dc43f56537 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:04.901499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd3ea7-3a7c-4c2c-af0d-a8dc43f56537 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:04.902310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd3ea7-3a7c-4c2c-af0d-a8dc43f56537 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:04.902646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd3ea7-3a7c-4c2c-af0d-a8dc43f56537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:04.904106 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd3ea7-3a7c-4c2c-af0d-a8dc43f56537 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:04.937184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 119/241] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:04.951163 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd3ea7-3a7c-4c2c-af0d-a8dc43f56537 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:04.963823 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff973fc-1054-4483-8801-4b19d3a116ab None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:05.081024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b916646-19a1-4b4d-96ff-99b93fc6e9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:05.081563 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b916646-19a1-4b4d-96ff-99b93fc6e9d8 None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:05.081847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b916646-19a1-4b4d-96ff-99b93fc6e9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:05.082914 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b916646-19a1-4b4d-96ff-99b93fc6e9d8 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:05.084041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b916646-19a1-4b4d-96ff-99b93fc6e9d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:05.085544 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b916646-19a1-4b4d-96ff-99b93fc6e9d8 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:05.203208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd3ea7-3a7c-4c2c-af0d-a8dc43f56537 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:05.217384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 123/242] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:55:04 2022] POST /identity/v3/users => generated 293 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:55:05.235994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:05.284434 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b7ec9-ef83-4fee-8c8d-acf68ebe2f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:05.286166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b7ec9-ef83-4fee-8c8d-acf68ebe2f25 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:05.286754 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b7ec9-ef83-4fee-8c8d-acf68ebe2f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:05.287266 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b7ec9-ef83-4fee-8c8d-acf68ebe2f25 None admin] PATH_INFO: `/v3/users/8626442f72d24dc685e43159a7f80461` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:05.332291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b7ec9-ef83-4fee-8c8d-acf68ebe2f25 None admin] RBAC: Authorizing `identity:get_user(user_id=8626442f72d24dc685e43159a7f80461)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:05.334948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b7ec9-ef83-4fee-8c8d-acf68ebe2f25 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:05.338437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 120/243] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:04 2022] GET /identity/v3/users/8626442f72d24dc685e43159a7f80461 => generated 297 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:05.347343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b916646-19a1-4b4d-96ff-99b93fc6e9d8 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:05.579170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b916646-19a1-4b4d-96ff-99b93fc6e9d8 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:05.600916 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:05.666085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211858b-eab0-449a-a3ed-484ad7310cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:05.667283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211858b-eab0-449a-a3ed-484ad7310cab None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:05.667808 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211858b-eab0-449a-a3ed-484ad7310cab None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:05.668301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211858b-eab0-449a-a3ed-484ad7310cab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:05.758648 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a631238-6915-41e4-8648-4a13e178a258 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:05.759132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a631238-6915-41e4-8648-4a13e178a258 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:05.759610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a631238-6915-41e4-8648-4a13e178a258 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:05.765842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 121/244] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:05.774987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18663f35-be99-4896-9534-011dc08ba722 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:05.775496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18663f35-be99-4896-9534-011dc08ba722 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:05.776012 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18663f35-be99-4896-9534-011dc08ba722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:05.818655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-18663f35-be99-4896-9534-011dc08ba722 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:05.820864 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-18663f35-be99-4896-9534-011dc08ba722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:05.848657 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211858b-eab0-449a-a3ed-484ad7310cab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:05.852716 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211858b-eab0-449a-a3ed-484ad7310cab None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:05.953779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 122/245] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:55:05.996547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18663f35-be99-4896-9534-011dc08ba722 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:06.079205 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 124/246] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:06.091562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211858b-eab0-449a-a3ed-484ad7310cab None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:06.112967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:06.204144 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18663f35-be99-4896-9534-011dc08ba722 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:06.208249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:06.278707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e361db7-3718-47b7-b963-6be4373e643e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:06.280194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e361db7-3718-47b7-b963-6be4373e643e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:06.280345 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e361db7-3718-47b7-b963-6be4373e643e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:06.280863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e361db7-3718-47b7-b963-6be4373e643e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:06.305387 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e361db7-3718-47b7-b963-6be4373e643e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:06.313179 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211858b-eab0-449a-a3ed-484ad7310cab None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-8e361db7-3718-47b7-b963-6be4373e643e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:06.315905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:06.318617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:06.320740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:06.320740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:06.320740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:06.320740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:06.320740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:06.320740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:06.320740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:06.320740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:06.320740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:06.320740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:06.320740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:06.320740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:06.320740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 123/247] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:06.329168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e361db7-3718-47b7-b963-6be4373e643e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:06.396855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dfdc7-3822-4944-8a21-b4c255b4f0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:06.398296 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dfdc7-3822-4944-8a21-b4c255b4f0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:06.399195 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dfdc7-3822-4944-8a21-b4c255b4f0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:06.399929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dfdc7-3822-4944-8a21-b4c255b4f0c3 None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:06.402844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dfdc7-3822-4944-8a21-b4c255b4f0c3 None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:06.405981 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dfdc7-3822-4944-8a21-b4c255b4f0c3 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:06.414266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 125/248] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:06 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:06.425039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dfdc7-3822-4944-8a21-b4c255b4f0c3 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:06.541525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e361db7-3718-47b7-b963-6be4373e643e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:06.575246 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:06.610229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dfdc7-3822-4944-8a21-b4c255b4f0c3 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:06.612093 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5d381-bee2-48ce-b3f9-dc3bd6e0c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:06.613745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5d381-bee2-48ce-b3f9-dc3bd6e0c232 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:06.614269 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5d381-bee2-48ce-b3f9-dc3bd6e0c232 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:06.614820 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5d381-bee2-48ce-b3f9-dc3bd6e0c232 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:06.616301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5d381-bee2-48ce-b3f9-dc3bd6e0c232 None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:06.616860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5d381-bee2-48ce-b3f9-dc3bd6e0c232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:06.619684 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5d381-bee2-48ce-b3f9-dc3bd6e0c232 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:06.637926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 124/249] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:06.647818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5d381-bee2-48ce-b3f9-dc3bd6e0c232 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:06.665568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cb960-2201-4722-a279-303b8a7ecb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:06.667207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cb960-2201-4722-a279-303b8a7ecb03 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:06.667687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cb960-2201-4722-a279-303b8a7ecb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:06.669606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cb960-2201-4722-a279-303b8a7ecb03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:06.670322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cb960-2201-4722-a279-303b8a7ecb03 None admin] RBAC: Adding query filter params (role.id=1cb1920ac8734f678410e3f1ad89de68, scope.project.id=03c5e81f100d42b1bcc655353fbecbc8, user.id=8626442f72d24dc685e43159a7f80461) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:06.671102 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cb960-2201-4722-a279-303b8a7ecb03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:06.673482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cb960-2201-4722-a279-303b8a7ecb03 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:06.689941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 126/250] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:55:06 2022] GET /identity/v3/role_assignments?user.id=8626442f72d24dc685e43159a7f80461&scope.project.id=03c5e81f100d42b1bcc655353fbecbc8&role.id=1cb1920ac8734f678410e3f1ad89de68 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:06.702541 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:06.730997 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd13ba-1209-48f6-8a13-07153d1b2ea9 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:06.731569 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd13ba-1209-48f6-8a13-07153d1b2ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:06.732077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd13ba-1209-48f6-8a13-07153d1b2ea9 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:06.735588 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 127/251] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:06.743395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c6e9f-8942-4042-8b27-c066801e654f None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:06.744136 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c6e9f-8942-4042-8b27-c066801e654f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:06.744752 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c6e9f-8942-4042-8b27-c066801e654f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:06.800878 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-260c6e9f-8942-4042-8b27-c066801e654f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:06.803953 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-260c6e9f-8942-4042-8b27-c066801e654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:06.857339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5d381-bee2-48ce-b3f9-dc3bd6e0c232 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:06.910946 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf517e-a3bd-4741-9a3c-a43beb6efcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:06.911792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf517e-a3bd-4741-9a3c-a43beb6efcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:06.912165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf517e-a3bd-4741-9a3c-a43beb6efcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:06.912439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf517e-a3bd-4741-9a3c-a43beb6efcb6 None admin] PATH_INFO: `/v3/users/c5ed401465eb4f32a274bf7cc42986a9` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:06.915154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf517e-a3bd-4741-9a3c-a43beb6efcb6 None admin] RBAC: Authorizing `identity:get_user(user_id=c5ed401465eb4f32a274bf7cc42986a9)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:06.917233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf517e-a3bd-4741-9a3c-a43beb6efcb6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:06.920344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 125/252] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:06 2022] GET /identity/v3/users/c5ed401465eb4f32a274bf7cc42986a9 => generated 297 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:06.934698 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf517e-a3bd-4741-9a3c-a43beb6efcb6 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:07.040319 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 128/253] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:07.114819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c6e9f-8942-4042-8b27-c066801e654f None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:07.179068 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:07.190765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf517e-a3bd-4741-9a3c-a43beb6efcb6 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:07.262021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0944f7d-a8f6-45ad-a0b9-d110635239ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:07.263070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0944f7d-a8f6-45ad-a0b9-d110635239ef None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:07.263572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0944f7d-a8f6-45ad-a0b9-d110635239ef None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:07.264072 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0944f7d-a8f6-45ad-a0b9-d110635239ef None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:07.266498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0944f7d-a8f6-45ad-a0b9-d110635239ef None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:07.268850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0944f7d-a8f6-45ad-a0b9-d110635239ef None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:07.272418 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 126/254] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:06 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:07.278223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0944f7d-a8f6-45ad-a0b9-d110635239ef None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:07.291956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:07.402401 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c6e9f-8942-4042-8b27-c066801e654f None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:07.507860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0944f7d-a8f6-45ad-a0b9-d110635239ef None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:07.522788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd497cb5-5635-4693-ade1-e98c4376c4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:07.523479 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd497cb5-5635-4693-ade1-e98c4376c4bd None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:07.523765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd497cb5-5635-4693-ade1-e98c4376c4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:07.524049 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd497cb5-5635-4693-ade1-e98c4376c4bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:07.559588 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd497cb5-5635-4693-ade1-e98c4376c4bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-dd497cb5-5635-4693-ade1-e98c4376c4bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:07.569945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:07.571019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:07.571898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:07.571898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:07.571898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:07.571898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:07.571898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:07.571898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:07.571898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:07.571898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:07.571898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:07.571898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:07.571898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:55:07.571898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:07.580672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 129/255] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:55:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:55:07.591545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd497cb5-5635-4693-ade1-e98c4376c4bd None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:07.612161 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee0596-9699-4e20-8b2b-d3af8327a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:07.613020 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee0596-9699-4e20-8b2b-d3af8327a55b None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:07.614071 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee0596-9699-4e20-8b2b-d3af8327a55b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:07.614402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee0596-9699-4e20-8b2b-d3af8327a55b None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8/users/c5ed401465eb4f32a274bf7cc42986a9/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:07.620041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee0596-9699-4e20-8b2b-d3af8327a55b None admin] RBAC: Authorizing `identity:create_grant(project_id=03c5e81f100d42b1bcc655353fbecbc8, user_id=c5ed401465eb4f32a274bf7cc42986a9, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:07.621615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee0596-9699-4e20-8b2b-d3af8327a55b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:07.723252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 127/256] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:55:07 2022] PUT /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8/users/c5ed401465eb4f32a274bf7cc42986a9/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:55:07.823932 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd497cb5-5635-4693-ade1-e98c4376c4bd None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:07.878337 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:07.886059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec3f21-d2c6-43b4-ab6c-4d891a63290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:07.886865 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec3f21-d2c6-43b4-ab6c-4d891a63290a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:07.887157 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec3f21-d2c6-43b4-ab6c-4d891a63290a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:07.887437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec3f21-d2c6-43b4-ab6c-4d891a63290a None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:07.888369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec3f21-d2c6-43b4-ab6c-4d891a63290a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:07.888686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec3f21-d2c6-43b4-ab6c-4d891a63290a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:07.890169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec3f21-d2c6-43b4-ab6c-4d891a63290a None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:07.904668 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 130/257] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:07.912883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee0596-9699-4e20-8b2b-d3af8327a55b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:07.947925 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:08.155822 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee0596-9699-4e20-8b2b-d3af8327a55b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:08.176950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1efeb-d9d5-4c68-a4e9-e640d276a528 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:08.177628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1efeb-d9d5-4c68-a4e9-e640d276a528 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:08.177628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1efeb-d9d5-4c68-a4e9-e640d276a528 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:08.179874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 131/258] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:55:08.187795 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871c88b-ae22-456c-8cfc-cdf4ec8efed5 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:08.188293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871c88b-ae22-456c-8cfc-cdf4ec8efed5 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:08.188775 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871c88b-ae22-456c-8cfc-cdf4ec8efed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:08.238025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d871c88b-ae22-456c-8cfc-cdf4ec8efed5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:08.240209 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d871c88b-ae22-456c-8cfc-cdf4ec8efed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:08.247117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61672842-3969-414a-afed-a17e6ce1d4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:08.248258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61672842-3969-414a-afed-a17e6ce1d4bb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:08.248773 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61672842-3969-414a-afed-a17e6ce1d4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:08.249275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61672842-3969-414a-afed-a17e6ce1d4bb None admin] PATH_INFO: `/v3/users/6030e4731648499da8b7cfcdecb660aa` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:08.253097 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61672842-3969-414a-afed-a17e6ce1d4bb None admin] RBAC: Authorizing `identity:get_user(user_id=6030e4731648499da8b7cfcdecb660aa)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:08.256486 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61672842-3969-414a-afed-a17e6ce1d4bb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:08.268968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 128/259] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:07 2022] GET /identity/v3/users/6030e4731648499da8b7cfcdecb660aa => generated 283 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:08.271258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61672842-3969-414a-afed-a17e6ce1d4bb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:08.476149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 132/260] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:55:08.603103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871c88b-ae22-456c-8cfc-cdf4ec8efed5 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:08.614467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:08.658244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61672842-3969-414a-afed-a17e6ce1d4bb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:08.807743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5012e-69d8-4268-887c-05b1a40626b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:08.808746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5012e-69d8-4268-887c-05b1a40626b8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:08.809236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5012e-69d8-4268-887c-05b1a40626b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:08.809744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5012e-69d8-4268-887c-05b1a40626b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:08.966746 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871c88b-ae22-456c-8cfc-cdf4ec8efed5 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:09.041168 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:09.083351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea8037-f8b1-4d8b-8118-ea280bf484d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:09.084282 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea8037-f8b1-4d8b-8118-ea280bf484d8 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:09.084762 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea8037-f8b1-4d8b-8118-ea280bf484d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:09.085244 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea8037-f8b1-4d8b-8118-ea280bf484d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:09.098773 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5012e-69d8-4268-887c-05b1a40626b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:09.101624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5012e-69d8-4268-887c-05b1a40626b8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:09.136295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea8037-f8b1-4d8b-8118-ea280bf484d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-fcea8037-f8b1-4d8b-8118-ea280bf484d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:09.155266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:09.156949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:09.159165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:09.159165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:09.159165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:09.159165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:09.159165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:09.159165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:09.159165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:09.159165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:09.159165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:09.159165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:09.159165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:09.159165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:09.159165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 133/261] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:55:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 556 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:09.169038 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea8037-f8b1-4d8b-8118-ea280bf484d8 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:09.310704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:09.342144 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 129/262] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1072 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:09.357614 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5012e-69d8-4268-887c-05b1a40626b8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:09.564462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea8037-f8b1-4d8b-8118-ea280bf484d8 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:09.584172 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5012e-69d8-4268-887c-05b1a40626b8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:09.651782 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28a625-174c-431d-9c0a-ee2b793716b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:09.653572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28a625-174c-431d-9c0a-ee2b793716b4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:09.654271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28a625-174c-431d-9c0a-ee2b793716b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:09.655161 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28a625-174c-431d-9c0a-ee2b793716b4 None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:09.656752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28a625-174c-431d-9c0a-ee2b793716b4 None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:09.658468 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28a625-174c-431d-9c0a-ee2b793716b4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:09.662429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 130/263] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:09 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:09.672231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28a625-174c-431d-9c0a-ee2b793716b4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:09.674294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecc4f8-54f6-4293-8e4a-3441bf40fb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:09.674984 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecc4f8-54f6-4293-8e4a-3441bf40fb81 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:09.675302 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecc4f8-54f6-4293-8e4a-3441bf40fb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:09.675578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecc4f8-54f6-4293-8e4a-3441bf40fb81 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:09.676343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecc4f8-54f6-4293-8e4a-3441bf40fb81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:09.676654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecc4f8-54f6-4293-8e4a-3441bf40fb81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:09.678279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecc4f8-54f6-4293-8e4a-3441bf40fb81 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:09.709676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 134/264] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:55:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 542 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:09.717621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecc4f8-54f6-4293-8e4a-3441bf40fb81 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:09.806972 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:09.853049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28a625-174c-431d-9c0a-ee2b793716b4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:09.867014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:09.923032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fd106-f347-4d1a-86d3-28dac87dfb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:09.924031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fd106-f347-4d1a-86d3-28dac87dfb11 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:09.931439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fd106-f347-4d1a-86d3-28dac87dfb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:09.932046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fd106-f347-4d1a-86d3-28dac87dfb11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:09.933119 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fd106-f347-4d1a-86d3-28dac87dfb11 None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=03c5e81f100d42b1bcc655353fbecbc8, user.id=6030e4731648499da8b7cfcdecb660aa) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:09.933658 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fd106-f347-4d1a-86d3-28dac87dfb11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:09.935629 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fd106-f347-4d1a-86d3-28dac87dfb11 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:09.956206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 131/265] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:55:09 2022] GET /identity/v3/role_assignments?user.id=6030e4731648499da8b7cfcdecb660aa&scope.project.id=03c5e81f100d42b1bcc655353fbecbc8&role.id=17054492864541709fda49dbf677a7a2 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:10.044537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecc4f8-54f6-4293-8e4a-3441bf40fb81 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:10.122981 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c15ac1-935e-4e6d-932c-e40f976deb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:10.124152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c15ac1-935e-4e6d-932c-e40f976deb59 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:10.124672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c15ac1-935e-4e6d-932c-e40f976deb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:10.125179 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c15ac1-935e-4e6d-932c-e40f976deb59 None admin] PATH_INFO: `/v3/users/6030e4731648499da8b7cfcdecb660aa` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:10.131974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c15ac1-935e-4e6d-932c-e40f976deb59 None admin] RBAC: Authorizing `identity:get_user(user_id=6030e4731648499da8b7cfcdecb660aa)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:10.136755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c15ac1-935e-4e6d-932c-e40f976deb59 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:10.137067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710bf34-a894-4d5b-9895-610dbf9d43be None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:10.137713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710bf34-a894-4d5b-9895-610dbf9d43be None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:10.138309 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710bf34-a894-4d5b-9895-610dbf9d43be None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:10.138738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 135/266] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:09 2022] GET /identity/v3/users/6030e4731648499da8b7cfcdecb660aa => generated 283 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:10.140425 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 132/267] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:55:10.148072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539cc6d-d9be-4001-8ac5-202c87437671 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:10.148567 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539cc6d-d9be-4001-8ac5-202c87437671 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:10.149056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539cc6d-d9be-4001-8ac5-202c87437671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:10.156319 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710bf34-a894-4d5b-9895-610dbf9d43be None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:10.212324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-c539cc6d-d9be-4001-8ac5-202c87437671 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:10.214436 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c539cc6d-d9be-4001-8ac5-202c87437671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:10.367409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 136/268] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:10.402585 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539cc6d-d9be-4001-8ac5-202c87437671 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:10.478451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710bf34-a894-4d5b-9895-610dbf9d43be None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:10.499511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:10.521672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:10.563644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da03c3-bffe-4e76-95ba-99fa0910caa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:10.564486 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da03c3-bffe-4e76-95ba-99fa0910caa5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:10.565027 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da03c3-bffe-4e76-95ba-99fa0910caa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:10.565381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da03c3-bffe-4e76-95ba-99fa0910caa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:10.601343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539cc6d-d9be-4001-8ac5-202c87437671 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:10.663695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acba38-a218-4089-9535-a7551a03220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:10.665367 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acba38-a218-4089-9535-a7551a03220f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:10.666168 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acba38-a218-4089-9535-a7551a03220f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:10.666953 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acba38-a218-4089-9535-a7551a03220f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:10.687994 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acba38-a218-4089-9535-a7551a03220f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-48acba38-a218-4089-9535-a7551a03220f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:10.698060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:10.700738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:10.702402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:10.702402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:10.702402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:10.702402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:10.702402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:10.702402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:10.702402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:10.702402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:10.702402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:10.702402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:10.702402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:10.702402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:10.706148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 137/269] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:55:10.713903 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acba38-a218-4089-9535-a7551a03220f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:10.788070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da03c3-bffe-4e76-95ba-99fa0910caa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:10.800651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da03c3-bffe-4e76-95ba-99fa0910caa5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:10.869591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acba38-a218-4089-9535-a7551a03220f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:10.872612 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:10.933332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde689f8-090e-4298-ab49-327c6827432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:10.934338 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde689f8-090e-4298-ab49-327c6827432e None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:10.935906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde689f8-090e-4298-ab49-327c6827432e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:10.936411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde689f8-090e-4298-ab49-327c6827432e None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:10.937378 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde689f8-090e-4298-ab49-327c6827432e None admin] RBAC: Adding query filter params (name=member) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:10.938067 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde689f8-090e-4298-ab49-327c6827432e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:10.943441 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde689f8-090e-4298-ab49-327c6827432e None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:10.962242 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 138/270] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:10.963961 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7aa16-bb1d-472f-b038-eacdbb4943fa None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:10.964269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7aa16-bb1d-472f-b038-eacdbb4943fa None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:10.964530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7aa16-bb1d-472f-b038-eacdbb4943fa None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:10.966256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 139/271] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:10.974622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7aa16-bb1d-472f-b038-eacdbb4943fa None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:11.043853 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 133/272] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 888 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:11.045313 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa35bc-fe34-44d1-b215-ad37f9343f01 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:11.045605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa35bc-fe34-44d1-b215-ad37f9343f01 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:11.045883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa35bc-fe34-44d1-b215-ad37f9343f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:11.071535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-afaa35bc-fe34-44d1-b215-ad37f9343f01 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:11.072835 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-afaa35bc-fe34-44d1-b215-ad37f9343f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:11.104462 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:11.126895 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7aa16-bb1d-472f-b038-eacdbb4943fa None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:11.165898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f356cb-33e6-4dbc-8772-8ed0c7fbc692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:11.166591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f356cb-33e6-4dbc-8772-8ed0c7fbc692 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:11.166881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f356cb-33e6-4dbc-8772-8ed0c7fbc692 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:11.167160 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f356cb-33e6-4dbc-8772-8ed0c7fbc692 None admin] PATH_INFO: `/v3/users/ca0cf402c2f24990a5a6ced05da428bf` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:11.184349 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f356cb-33e6-4dbc-8772-8ed0c7fbc692 None admin] RBAC: Authorizing `identity:get_user(user_id=ca0cf402c2f24990a5a6ced05da428bf)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:11.185841 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f356cb-33e6-4dbc-8772-8ed0c7fbc692 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:11.193475 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 140/273] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:10 2022] GET /identity/v3/users/ca0cf402c2f24990a5a6ced05da428bf => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:11.193475 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10be946-9f92-4f6e-95d9-4741932e4d3c None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:11.193475 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10be946-9f92-4f6e-95d9-4741932e4d3c None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:11.193475 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10be946-9f92-4f6e-95d9-4741932e4d3c None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:11.193475 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 141/274] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:11.193475 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10be946-9f92-4f6e-95d9-4741932e4d3c None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:11.218456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 134/275] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:11.218456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa35bc-fe34-44d1-b215-ad37f9343f01 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:11.247949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:11.372373 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10be946-9f92-4f6e-95d9-4741932e4d3c None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:11.431986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa35bc-fe34-44d1-b215-ad37f9343f01 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:11.437996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90503473-c1af-4a3e-97da-1a9ad518bed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:11.439098 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90503473-c1af-4a3e-97da-1a9ad518bed0 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:11.439547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90503473-c1af-4a3e-97da-1a9ad518bed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:11.440008 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90503473-c1af-4a3e-97da-1a9ad518bed0 None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:11.443148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90503473-c1af-4a3e-97da-1a9ad518bed0 None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:11.445850 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90503473-c1af-4a3e-97da-1a9ad518bed0 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:11.454681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 142/276] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:11 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:11.454681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31305f-5faf-495e-92b5-d5ca2c8d7816 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:11.454681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31305f-5faf-495e-92b5-d5ca2c8d7816 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:11.454681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31305f-5faf-495e-92b5-d5ca2c8d7816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:11.491363 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-0a31305f-5faf-495e-92b5-d5ca2c8d7816 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:11.493537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0a31305f-5faf-495e-92b5-d5ca2c8d7816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:11.510669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badf8c4-b9f0-4479-b782-8f0f9e4bd81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:11.511683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badf8c4-b9f0-4479-b782-8f0f9e4bd81d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:11.512167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badf8c4-b9f0-4479-b782-8f0f9e4bd81d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:11.512666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badf8c4-b9f0-4479-b782-8f0f9e4bd81d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:11.515089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badf8c4-b9f0-4479-b782-8f0f9e4bd81d None admin] RBAC: Adding query filter params (role.id=7555aed6a21441208a17dedef685336f, user.id=ca0cf402c2f24990a5a6ced05da428bf, scope.system=all) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:11.515673 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badf8c4-b9f0-4479-b782-8f0f9e4bd81d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:11.519623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badf8c4-b9f0-4479-b782-8f0f9e4bd81d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:11.526421 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 135/277] 10.222.0.98 () {56 vars in 1308 bytes} [Tue Jul 26 14:55:11 2022] GET /identity/v3/role_assignments?user.id=ca0cf402c2f24990a5a6ced05da428bf&scope.system=all&role.id=7555aed6a21441208a17dedef685336f => generated 226 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:11.527124 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badf8c4-b9f0-4479-b782-8f0f9e4bd81d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:11.557347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:11.673678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 143/278] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:11.675418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31305f-5faf-495e-92b5-d5ca2c8d7816 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:11.727681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:11.768346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badf8c4-b9f0-4479-b782-8f0f9e4bd81d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:11.842774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8805629-edb6-4b47-ba2b-4d2ce9f30614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:11.845750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8805629-edb6-4b47-ba2b-4d2ce9f30614 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:11.846601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8805629-edb6-4b47-ba2b-4d2ce9f30614 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:11.847490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8805629-edb6-4b47-ba2b-4d2ce9f30614 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:11.881315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8805629-edb6-4b47-ba2b-4d2ce9f30614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-a8805629-edb6-4b47-ba2b-4d2ce9f30614 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:11.894799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:11.896546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:11.898110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:11.898110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:11.898110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:11.898110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:11.898110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:11.898110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:11.898110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:11.898110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:11.898110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:11.898110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:11.898110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:55:11.898110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:11.900886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 136/279] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:11.902490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8805629-edb6-4b47-ba2b-4d2ce9f30614 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:11.915495 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31305f-5faf-495e-92b5-d5ca2c8d7816 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:11.992287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81369e-9744-4f0d-b310-1460187de0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:11.993249 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81369e-9744-4f0d-b310-1460187de0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:11.993746 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81369e-9744-4f0d-b310-1460187de0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:11.994247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81369e-9744-4f0d-b310-1460187de0b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:11.995853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81369e-9744-4f0d-b310-1460187de0b0 None admin] RBAC: Adding query filter params (role.id=3b3abbcf8ee04f0387cfdede5812d226, scope.project.id=03c5e81f100d42b1bcc655353fbecbc8, user.id=6030e4731648499da8b7cfcdecb660aa) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:11.996419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81369e-9744-4f0d-b310-1460187de0b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:11.999315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81369e-9744-4f0d-b310-1460187de0b0 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:12.011434 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 144/280] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:55:11 2022] GET /identity/v3/role_assignments?user.id=6030e4731648499da8b7cfcdecb660aa&scope.project.id=03c5e81f100d42b1bcc655353fbecbc8&role.id=3b3abbcf8ee04f0387cfdede5812d226 => generated 608 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:12.013034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81369e-9744-4f0d-b310-1460187de0b0 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:12.064201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:12.122332 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8805629-edb6-4b47-ba2b-4d2ce9f30614 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:12.184300 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6d895-9fac-400c-a378-bd05398c690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:12.184990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6d895-9fac-400c-a378-bd05398c690c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:12.185272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6d895-9fac-400c-a378-bd05398c690c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:12.185550 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6d895-9fac-400c-a378-bd05398c690c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:12.187140 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6d895-9fac-400c-a378-bd05398c690c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:12.188655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6d895-9fac-400c-a378-bd05398c690c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:12.191638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 137/281] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:12.195135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b21fd6-845f-4ab9-af12-89b0ed389f0b None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:12.195611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b21fd6-845f-4ab9-af12-89b0ed389f0b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:12.196108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b21fd6-845f-4ab9-af12-89b0ed389f0b None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:12.202691 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 138/282] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:12.204464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b21fd6-845f-4ab9-af12-89b0ed389f0b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:12.234675 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:12.263433 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81369e-9744-4f0d-b310-1460187de0b0 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:12.346615 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1edc9-6266-496e-8ba1-bad2eca2b3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:12.348890 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1edc9-6266-496e-8ba1-bad2eca2b3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:12.349515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1edc9-6266-496e-8ba1-bad2eca2b3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:12.350110 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1edc9-6266-496e-8ba1-bad2eca2b3b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:12.351686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1edc9-6266-496e-8ba1-bad2eca2b3b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:12.352269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1edc9-6266-496e-8ba1-bad2eca2b3b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:12.355285 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1edc9-6266-496e-8ba1-bad2eca2b3b7 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:12.374770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 145/283] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:12.377035 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cb7ba-a231-441b-83aa-69548bea39bb None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:12.378036 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cb7ba-a231-441b-83aa-69548bea39bb None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:12.379447 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cb7ba-a231-441b-83aa-69548bea39bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:12.413870 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b21fd6-845f-4ab9-af12-89b0ed389f0b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:12.417025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b13cb7ba-a231-441b-83aa-69548bea39bb None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:12.419245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b13cb7ba-a231-441b-83aa-69548bea39bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:12.474944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67312df4-9584-4950-9653-7100b0e39421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:12.475903 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312df4-9584-4950-9653-7100b0e39421 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:12.476333 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312df4-9584-4950-9653-7100b0e39421 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:12.476756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312df4-9584-4950-9653-7100b0e39421 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:12.477861 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67312df4-9584-4950-9653-7100b0e39421 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:12.480182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67312df4-9584-4950-9653-7100b0e39421 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:12.565340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 146/284] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:12.568053 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cb7ba-a231-441b-83aa-69548bea39bb None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:12.595046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:12.602839 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 139/285] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:55:12 2022] POST /identity/v3/users => generated 293 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:55:12.610423 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67312df4-9584-4950-9653-7100b0e39421 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:12.730213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:12.769207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cb7ba-a231-441b-83aa-69548bea39bb None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:12.826408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67312df4-9584-4950-9653-7100b0e39421 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:12.844320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710ce89-815a-4b2d-a07b-af983cec9f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:12.845968 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710ce89-815a-4b2d-a07b-af983cec9f8f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:12.848124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710ce89-815a-4b2d-a07b-af983cec9f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:12.848950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710ce89-815a-4b2d-a07b-af983cec9f8f None admin] PATH_INFO: `/v3/users/8626442f72d24dc685e43159a7f80461` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:12.851725 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710ce89-815a-4b2d-a07b-af983cec9f8f None admin] RBAC: Authorizing `identity:get_user(user_id=8626442f72d24dc685e43159a7f80461)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:12.855018 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710ce89-815a-4b2d-a07b-af983cec9f8f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:12.859416 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 147/286] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:12 2022] GET /identity/v3/users/8626442f72d24dc685e43159a7f80461 => generated 297 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:12.866147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710ce89-815a-4b2d-a07b-af983cec9f8f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:12.887754 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22909bb2-9f1f-43fc-a5cf-686b38b0cccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:12.888612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22909bb2-9f1f-43fc-a5cf-686b38b0cccb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:12.889037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22909bb2-9f1f-43fc-a5cf-686b38b0cccb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:12.889479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22909bb2-9f1f-43fc-a5cf-686b38b0cccb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:12.909510 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22909bb2-9f1f-43fc-a5cf-686b38b0cccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-22909bb2-9f1f-43fc-a5cf-686b38b0cccb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:12.919204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:12.920451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:12.921430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:12.921430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:12.921430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:12.921430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:12.921430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:12.921430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:12.921430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:12.921430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:12.921430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:12.921430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:12.921430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:12.921430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:12.921430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 140/287] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:12.932310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22909bb2-9f1f-43fc-a5cf-686b38b0cccb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:13.049646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:13.055615 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710ce89-815a-4b2d-a07b-af983cec9f8f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:13.114653 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22909bb2-9f1f-43fc-a5cf-686b38b0cccb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:13.136361 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea0cfb-c57b-4c8d-a496-184ccade8bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:13.137429 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea0cfb-c57b-4c8d-a496-184ccade8bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:13.137918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea0cfb-c57b-4c8d-a496-184ccade8bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:13.138413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea0cfb-c57b-4c8d-a496-184ccade8bf9 None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:13.144549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea0cfb-c57b-4c8d-a496-184ccade8bf9 None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:13.147838 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea0cfb-c57b-4c8d-a496-184ccade8bf9 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:13.154115 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 148/288] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:12 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:13.160859 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea0cfb-c57b-4c8d-a496-184ccade8bf9 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:13.219148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1880a-4666-43e6-9fc6-fa8bd23a718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:13.221234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1880a-4666-43e6-9fc6-fa8bd23a718a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:13.221904 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1880a-4666-43e6-9fc6-fa8bd23a718a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:13.222216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1880a-4666-43e6-9fc6-fa8bd23a718a None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:13.222920 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:13.223925 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1880a-4666-43e6-9fc6-fa8bd23a718a None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:13.229844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1880a-4666-43e6-9fc6-fa8bd23a718a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:13.231770 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1880a-4666-43e6-9fc6-fa8bd23a718a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:13.270702 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 141/289] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:13.272840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1880a-4666-43e6-9fc6-fa8bd23a718a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:13.457629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea0cfb-c57b-4c8d-a496-184ccade8bf9 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:13.556004 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1880a-4666-43e6-9fc6-fa8bd23a718a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:13.561820 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cb5a9-4bc5-4823-8e1f-434f01dbbf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:13.563100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cb5a9-4bc5-4823-8e1f-434f01dbbf3d None admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:13.563601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cb5a9-4bc5-4823-8e1f-434f01dbbf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:13.567406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cb5a9-4bc5-4823-8e1f-434f01dbbf3d None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8/users/8626442f72d24dc685e43159a7f80461/roles/1cb1920ac8734f678410e3f1ad89de68` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:13.575950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cb5a9-4bc5-4823-8e1f-434f01dbbf3d None admin] RBAC: Authorizing `identity:create_grant(project_id=03c5e81f100d42b1bcc655353fbecbc8, user_id=8626442f72d24dc685e43159a7f80461, role_id=1cb1920ac8734f678410e3f1ad89de68)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:13.578836 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cb5a9-4bc5-4823-8e1f-434f01dbbf3d None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:13.625506 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:13.647722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba1c52-85ec-4d30-a5e6-7909598c71d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:13.648973 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba1c52-85ec-4d30-a5e6-7909598c71d1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:13.649474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba1c52-85ec-4d30-a5e6-7909598c71d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:13.649964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba1c52-85ec-4d30-a5e6-7909598c71d1 None admin] PATH_INFO: `/v3/users/c5ed401465eb4f32a274bf7cc42986a9` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:13.652406 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba1c52-85ec-4d30-a5e6-7909598c71d1 None admin] RBAC: Authorizing `identity:get_user(user_id=c5ed401465eb4f32a274bf7cc42986a9)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:13.655684 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba1c52-85ec-4d30-a5e6-7909598c71d1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:13.659871 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 142/290] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:13 2022] GET /identity/v3/users/c5ed401465eb4f32a274bf7cc42986a9 => generated 297 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:13.670811 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba1c52-85ec-4d30-a5e6-7909598c71d1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:13.683685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 149/291] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:55:13 2022] PUT /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8/users/8626442f72d24dc685e43159a7f80461/roles/1cb1920ac8734f678410e3f1ad89de68 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:55:13.921830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba1c52-85ec-4d30-a5e6-7909598c71d1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:13.985310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c452b1-5908-4a80-a7a7-267a07b3ec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:13.986277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c452b1-5908-4a80-a7a7-267a07b3ec6b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:13.986750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c452b1-5908-4a80-a7a7-267a07b3ec6b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:13.987207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c452b1-5908-4a80-a7a7-267a07b3ec6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:14.090254 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:14.119359 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c452b1-5908-4a80-a7a7-267a07b3ec6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:14.122156 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c452b1-5908-4a80-a7a7-267a07b3ec6b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:14.366900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 143/292] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:14.375665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cb5a9-4bc5-4823-8e1f-434f01dbbf3d None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:14.524000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:14.587525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cb5a9-4bc5-4823-8e1f-434f01dbbf3d None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:14.650914 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f46747-7bca-4376-ac64-82e5ac81906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:14.651504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f46747-7bca-4376-ac64-82e5ac81906e None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:14.651787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f46747-7bca-4376-ac64-82e5ac81906e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:14.652067 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f46747-7bca-4376-ac64-82e5ac81906e None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:14.659683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f46747-7bca-4376-ac64-82e5ac81906e None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:14.661448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f46747-7bca-4376-ac64-82e5ac81906e None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:14.663822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 150/293] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:14 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:14.672902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c452b1-5908-4a80-a7a7-267a07b3ec6b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:14.839855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:14.869188 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c452b1-5908-4a80-a7a7-267a07b3ec6b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:14.957591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d1c4c-cdad-4141-ac68-f89a7f06ba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:14.959109 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d1c4c-cdad-4141-ac68-f89a7f06ba93 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:14.959887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d1c4c-cdad-4141-ac68-f89a7f06ba93 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:14.960626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d1c4c-cdad-4141-ac68-f89a7f06ba93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:14.962438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d1c4c-cdad-4141-ac68-f89a7f06ba93 None admin] RBAC: Adding query filter params (role.id=7555aed6a21441208a17dedef685336f, scope.project.id=03c5e81f100d42b1bcc655353fbecbc8, user.id=c5ed401465eb4f32a274bf7cc42986a9) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:14.963304 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d1c4c-cdad-4141-ac68-f89a7f06ba93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:14.966252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d1c4c-cdad-4141-ac68-f89a7f06ba93 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:14.983250 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 144/294] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:55:14 2022] GET /identity/v3/role_assignments?user.id=c5ed401465eb4f32a274bf7cc42986a9&scope.project.id=03c5e81f100d42b1bcc655353fbecbc8&role.id=7555aed6a21441208a17dedef685336f => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:15.135162 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c1cdd-bb2f-492e-99af-8fac237c1e0a None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:15.135613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c1cdd-bb2f-492e-99af-8fac237c1e0a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:15.136133 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c1cdd-bb2f-492e-99af-8fac237c1e0a None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:15.139274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 151/295] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:15.145766 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b40f52-a32d-433f-815b-fbd4f2daa1db None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:15.146781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b40f52-a32d-433f-815b-fbd4f2daa1db None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:15.147555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b40f52-a32d-433f-815b-fbd4f2daa1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:15.188901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-21b40f52-a32d-433f-815b-fbd4f2daa1db None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:15.191966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-21b40f52-a32d-433f-815b-fbd4f2daa1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:15.368933 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 145/296] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:15.403243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c1cdd-bb2f-492e-99af-8fac237c1e0a None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:15.572751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c1cdd-bb2f-492e-99af-8fac237c1e0a None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:15.633826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b20d5-61c6-4fb2-912a-5961634c5f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:15.634468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b20d5-61c6-4fb2-912a-5961634c5f94 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:15.634765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b20d5-61c6-4fb2-912a-5961634c5f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:15.635033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b20d5-61c6-4fb2-912a-5961634c5f94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:15.652683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b20d5-61c6-4fb2-912a-5961634c5f94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-f52b20d5-61c6-4fb2-912a-5961634c5f94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:15.658564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:15.660868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:15.663109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:15.663109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:15.663109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:15.663109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:15.663109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:15.663109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:15.663109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:15.663109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:15.663109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:15.663109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:15.663109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:15.663109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:15.663109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 152/297] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:15.665979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:15.671897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b40f52-a32d-433f-815b-fbd4f2daa1db None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:15.842810 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:15.870693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b40f52-a32d-433f-815b-fbd4f2daa1db None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:15.943274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a0623-24c4-49a7-88ad-03e55303c491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:15.944263 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a0623-24c4-49a7-88ad-03e55303c491 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:15.944697 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a0623-24c4-49a7-88ad-03e55303c491 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:15.945196 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a0623-24c4-49a7-88ad-03e55303c491 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:15.946644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a0623-24c4-49a7-88ad-03e55303c491 None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:15.947270 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a0623-24c4-49a7-88ad-03e55303c491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:15.950083 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a0623-24c4-49a7-88ad-03e55303c491 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:15.969839 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 146/298] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:15.977834 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b20d5-61c6-4fb2-912a-5961634c5f94 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:16.058939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a6b4f-ade2-4cf0-b9a4-5a273d6dda2c None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:16.059571 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a6b4f-ade2-4cf0-b9a4-5a273d6dda2c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:16.060046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a6b4f-ade2-4cf0-b9a4-5a273d6dda2c None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:16.062070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 147/299] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:55:16.068474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72d3ce-aafd-4a94-bb18-ddbefd354ad9 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:16.069100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72d3ce-aafd-4a94-bb18-ddbefd354ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:16.069569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72d3ce-aafd-4a94-bb18-ddbefd354ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:16.100348 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2f72d3ce-aafd-4a94-bb18-ddbefd354ad9 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:16.101766 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2f72d3ce-aafd-4a94-bb18-ddbefd354ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:16.196552 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 148/300] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:55:16.209578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b20d5-61c6-4fb2-912a-5961634c5f94 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:16.222216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72d3ce-aafd-4a94-bb18-ddbefd354ad9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:16.324005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca9531-c643-4123-9dce-1445354bf13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:16.324687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca9531-c643-4123-9dce-1445354bf13b None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:16.325035 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca9531-c643-4123-9dce-1445354bf13b None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:16.325265 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca9531-c643-4123-9dce-1445354bf13b None admin] PATH_INFO: `/v3/users/ca0cf402c2f24990a5a6ced05da428bf` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:16.326644 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca9531-c643-4123-9dce-1445354bf13b None admin] RBAC: Authorizing `identity:get_user(user_id=ca0cf402c2f24990a5a6ced05da428bf)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:16.328147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca9531-c643-4123-9dce-1445354bf13b None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:16.330909 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 153/301] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:15 2022] GET /identity/v3/users/ca0cf402c2f24990a5a6ced05da428bf => generated 293 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:16.337289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deefeed-d198-47d9-bcee-af721f05c9fd None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:16.338303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deefeed-d198-47d9-bcee-af721f05c9fd None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:16.339105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deefeed-d198-47d9-bcee-af721f05c9fd None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:16.342804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 154/302] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:16.345035 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deefeed-d198-47d9-bcee-af721f05c9fd None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:16.383916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:16.430312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72d3ce-aafd-4a94-bb18-ddbefd354ad9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:16.465440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:16.509894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54dc4c-2857-4300-9273-77f31361fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:16.511682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54dc4c-2857-4300-9273-77f31361fc26 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:16.511682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54dc4c-2857-4300-9273-77f31361fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:16.512325 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54dc4c-2857-4300-9273-77f31361fc26 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:16.531855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deefeed-d198-47d9-bcee-af721f05c9fd None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:16.533477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54dc4c-2857-4300-9273-77f31361fc26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-bb54dc4c-2857-4300-9273-77f31361fc26 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:16.546457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:16.554515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:16.555663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:16.555663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:16.555663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:16.555663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:16.555663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:16.555663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:16.555663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:16.555663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:16.555663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:16.555663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:16.555663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:55:16.555663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:16.555663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 149/303] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:55:16.555663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f04025-5084-4033-96bf-80148697e971 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:16.556688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f04025-5084-4033-96bf-80148697e971 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:16.556688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f04025-5084-4033-96bf-80148697e971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:16.583279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-53f04025-5084-4033-96bf-80148697e971 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:16.585850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-53f04025-5084-4033-96bf-80148697e971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:16.611547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491dca8-9af9-413a-ba54-12ff78f97269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:16.613096 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491dca8-9af9-413a-ba54-12ff78f97269 None admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:16.613434 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491dca8-9af9-413a-ba54-12ff78f97269 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:16.613669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491dca8-9af9-413a-ba54-12ff78f97269 None admin] PATH_INFO: `/v3/system/users/ca0cf402c2f24990a5a6ced05da428bf/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:16.615428 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491dca8-9af9-413a-ba54-12ff78f97269 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ca0cf402c2f24990a5a6ced05da428bf, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:16.617290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491dca8-9af9-413a-ba54-12ff78f97269 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:16.730471 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 150/304] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:16.730471 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f04025-5084-4033-96bf-80148697e971 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:16.767162 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 155/305] 10.222.0.98 () {58 vars in 1334 bytes} [Tue Jul 26 14:55:16 2022] PUT /identity/v3/system/users/ca0cf402c2f24990a5a6ced05da428bf/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:55:16.769458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491dca8-9af9-413a-ba54-12ff78f97269 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:16.889414 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:16.960259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f04025-5084-4033-96bf-80148697e971 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:17.040567 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491dca8-9af9-413a-ba54-12ff78f97269 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:17.042752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7d7b9-9313-45b9-810a-2ad64a1ead22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:17.043770 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7d7b9-9313-45b9-810a-2ad64a1ead22 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:17.044240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7d7b9-9313-45b9-810a-2ad64a1ead22 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:17.044717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7d7b9-9313-45b9-810a-2ad64a1ead22 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:17.046042 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7d7b9-9313-45b9-810a-2ad64a1ead22 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:17.046600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7d7b9-9313-45b9-810a-2ad64a1ead22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:17.048762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7d7b9-9313-45b9-810a-2ad64a1ead22 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:17.064890 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 151/306] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:17.072168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7d7b9-9313-45b9-810a-2ad64a1ead22 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:17.119657 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:17.135207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01090525-1ee7-4bd6-b5e3-9d633b27c10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:17.135891 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01090525-1ee7-4bd6-b5e3-9d633b27c10e None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:17.136215 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01090525-1ee7-4bd6-b5e3-9d633b27c10e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:17.136476 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01090525-1ee7-4bd6-b5e3-9d633b27c10e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:17.139680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01090525-1ee7-4bd6-b5e3-9d633b27c10e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:17.143261 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01090525-1ee7-4bd6-b5e3-9d633b27c10e None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:17.145283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 156/307] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:17.151130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01090525-1ee7-4bd6-b5e3-9d633b27c10e None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:17.297763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7d7b9-9313-45b9-810a-2ad64a1ead22 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:17.325956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01090525-1ee7-4bd6-b5e3-9d633b27c10e None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:17.355862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:17.370430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ead12-ce39-4373-a342-3ff8ba6488d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:17.371410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ead12-ce39-4373-a342-3ff8ba6488d7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:17.371957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ead12-ce39-4373-a342-3ff8ba6488d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:17.372332 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ead12-ce39-4373-a342-3ff8ba6488d7 None admin] PATH_INFO: `/v3/users/0e342b24212a4abdb40ee2744a507fd4` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:17.372964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45acadf-450b-4a1e-938f-d1424087bc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:17.373629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45acadf-450b-4a1e-938f-d1424087bc22 None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:17.373921 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45acadf-450b-4a1e-938f-d1424087bc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:17.374203 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45acadf-450b-4a1e-938f-d1424087bc22 None admin] PATH_INFO: `/v3/groups` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:17.375717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45acadf-450b-4a1e-938f-d1424087bc22 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:17.376843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45acadf-450b-4a1e-938f-d1424087bc22 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:17.392986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ead12-ce39-4373-a342-3ff8ba6488d7 None admin] RBAC: Authorizing `identity:get_user(user_id=0e342b24212a4abdb40ee2744a507fd4)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:17.395735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ead12-ce39-4373-a342-3ff8ba6488d7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:17.399833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 152/308] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:17 2022] GET /identity/v3/users/0e342b24212a4abdb40ee2744a507fd4 => generated 293 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:17.401498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7e82d-23cf-4a0a-8e7b-0a69ecf44e20 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:17.403741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7e82d-23cf-4a0a-8e7b-0a69ecf44e20 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:17.403741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7e82d-23cf-4a0a-8e7b-0a69ecf44e20 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:17.404270 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 153/309] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:17.407603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7e82d-23cf-4a0a-8e7b-0a69ecf44e20 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:17.510686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 157/310] 10.222.0.98 () {60 vars in 1134 bytes} [Tue Jul 26 14:55:17 2022] POST /identity/v3/groups => generated 229 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:55:17.510686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e166abe-36c3-4ac6-988b-4b9de5430639 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:17.510686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e166abe-36c3-4ac6-988b-4b9de5430639 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:17.510686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e166abe-36c3-4ac6-988b-4b9de5430639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:17.555830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-6e166abe-36c3-4ac6-988b-4b9de5430639 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:17.558029 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6e166abe-36c3-4ac6-988b-4b9de5430639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:17.584517 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7e82d-23cf-4a0a-8e7b-0a69ecf44e20 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:17.676439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411307f5-6f23-4db7-9245-2162223f6fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:17.677710 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411307f5-6f23-4db7-9245-2162223f6fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:17.678243 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411307f5-6f23-4db7-9245-2162223f6fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:17.678829 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411307f5-6f23-4db7-9245-2162223f6fc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:17.680958 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411307f5-6f23-4db7-9245-2162223f6fc7 None admin] RBAC: Adding query filter params (role.id=1cb1920ac8734f678410e3f1ad89de68, user.id=0e342b24212a4abdb40ee2744a507fd4, scope.system=all) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:17.681644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411307f5-6f23-4db7-9245-2162223f6fc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:17.684818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411307f5-6f23-4db7-9245-2162223f6fc7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:17.697499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 154/311] 10.222.0.98 () {56 vars in 1308 bytes} [Tue Jul 26 14:55:17 2022] GET /identity/v3/role_assignments?user.id=0e342b24212a4abdb40ee2744a507fd4&scope.system=all&role.id=1cb1920ac8734f678410e3f1ad89de68 => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:17.718709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:17.745198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 158/312] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:17.789015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411307f5-6f23-4db7-9245-2162223f6fc7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:17.901971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:17.999708 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411307f5-6f23-4db7-9245-2162223f6fc7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:18.057953 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97142cb0-66b7-4e27-b875-6792b00e2b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:18.058668 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97142cb0-66b7-4e27-b875-6792b00e2b2f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:18.058945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97142cb0-66b7-4e27-b875-6792b00e2b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:18.059222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97142cb0-66b7-4e27-b875-6792b00e2b2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:18.075853 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97142cb0-66b7-4e27-b875-6792b00e2b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-97142cb0-66b7-4e27-b875-6792b00e2b2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:18.086335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:18.087781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:18.089235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:18.089235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:18.089235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:18.089235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:18.089235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:18.089235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:18.089235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:18.089235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:18.089235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:18.089235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:18.089235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:55:18.089235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:18.094542 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 155/313] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:18.098150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e166abe-36c3-4ac6-988b-4b9de5430639 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:18.318744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e166abe-36c3-4ac6-988b-4b9de5430639 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:18.389802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469edde-f3c3-4499-adf6-9bc85175a784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:18.390974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469edde-f3c3-4499-adf6-9bc85175a784 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:18.391474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469edde-f3c3-4499-adf6-9bc85175a784 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:18.391975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469edde-f3c3-4499-adf6-9bc85175a784 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:18.393856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469edde-f3c3-4499-adf6-9bc85175a784 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:18.394406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469edde-f3c3-4499-adf6-9bc85175a784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:18.397210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469edde-f3c3-4499-adf6-9bc85175a784 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:18.414396 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 159/314] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:18.421035 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97142cb0-66b7-4e27-b875-6792b00e2b2f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:18.570051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97142cb0-66b7-4e27-b875-6792b00e2b2f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:18.586957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:18.631341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a4701-4196-4d09-8f13-fb8e072d842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:18.632027 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a4701-4196-4d09-8f13-fb8e072d842a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:18.632310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a4701-4196-4d09-8f13-fb8e072d842a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:18.632583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a4701-4196-4d09-8f13-fb8e072d842a None admin] PATH_INFO: `/v3/users/8626442f72d24dc685e43159a7f80461` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:18.633920 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a4701-4196-4d09-8f13-fb8e072d842a None admin] RBAC: Authorizing `identity:get_user(user_id=8626442f72d24dc685e43159a7f80461)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:18.635433 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a4701-4196-4d09-8f13-fb8e072d842a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:18.637476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 156/315] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:18 2022] GET /identity/v3/users/8626442f72d24dc685e43159a7f80461 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:18.643203 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469edde-f3c3-4499-adf6-9bc85175a784 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:18.745023 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:18.834500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469edde-f3c3-4499-adf6-9bc85175a784 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:18.902616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71b4d-d68d-4ff3-9e1f-da3904ba7f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:18.903687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71b4d-d68d-4ff3-9e1f-da3904ba7f41 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:18.904196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71b4d-d68d-4ff3-9e1f-da3904ba7f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:18.904699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71b4d-d68d-4ff3-9e1f-da3904ba7f41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:19.020839 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c71b4d-d68d-4ff3-9e1f-da3904ba7f41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:19.022329 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c71b4d-d68d-4ff3-9e1f-da3904ba7f41 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:19.104579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:19.169553 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 160/316] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:19.179811 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a4701-4196-4d09-8f13-fb8e072d842a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:19.370576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a4701-4196-4d09-8f13-fb8e072d842a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:19.425918 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cabca1-ed0e-48f9-869e-3fe28e29c822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:19.426914 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cabca1-ed0e-48f9-869e-3fe28e29c822 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:19.427374 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cabca1-ed0e-48f9-869e-3fe28e29c822 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:19.427671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cabca1-ed0e-48f9-869e-3fe28e29c822 None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:19.430088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cabca1-ed0e-48f9-869e-3fe28e29c822 None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:19.432208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cabca1-ed0e-48f9-869e-3fe28e29c822 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:19.434878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 157/317] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:19 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:19.443552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71b4d-d68d-4ff3-9e1f-da3904ba7f41 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:19.477667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4e8a3-b757-434f-8f4b-5fb2cc8201cd None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:19.478327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4e8a3-b757-434f-8f4b-5fb2cc8201cd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:19.478962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4e8a3-b757-434f-8f4b-5fb2cc8201cd None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:19.484038 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 158/318] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:55:19.492143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f53a1-e974-4a7a-beed-d491289d69ee None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:19.492755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f53a1-e974-4a7a-beed-d491289d69ee None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:19.493331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f53a1-e974-4a7a-beed-d491289d69ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:19.525015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cf9f53a1-e974-4a7a-beed-d491289d69ee None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:19.527419 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cf9f53a1-e974-4a7a-beed-d491289d69ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:19.596965 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:19.638494 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 159/319] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:55:19.645001 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71b4d-d68d-4ff3-9e1f-da3904ba7f41 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:19.672424 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f53a1-e974-4a7a-beed-d491289d69ee None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:19.714680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb5c49-3113-4b27-b5e7-e51fae347d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:19.715789 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb5c49-3113-4b27-b5e7-e51fae347d66 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:19.716433 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb5c49-3113-4b27-b5e7-e51fae347d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:19.716930 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb5c49-3113-4b27-b5e7-e51fae347d66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:19.718918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb5c49-3113-4b27-b5e7-e51fae347d66 None admin] RBAC: Adding query filter params (role.id=1cb1920ac8734f678410e3f1ad89de68, scope.project.id=03c5e81f100d42b1bcc655353fbecbc8, user.id=8626442f72d24dc685e43159a7f80461) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:19.719590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb5c49-3113-4b27-b5e7-e51fae347d66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:19.726395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb5c49-3113-4b27-b5e7-e51fae347d66 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:19.736206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 161/320] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:55:19 2022] GET /identity/v3/role_assignments?user.id=8626442f72d24dc685e43159a7f80461&scope.project.id=03c5e81f100d42b1bcc655353fbecbc8&role.id=1cb1920ac8734f678410e3f1ad89de68 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:19.876506 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f53a1-e974-4a7a-beed-d491289d69ee None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:19.949868 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fd12c-41c8-4a9f-82aa-53b49225a5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:19.950684 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fd12c-41c8-4a9f-82aa-53b49225a5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:19.951132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fd12c-41c8-4a9f-82aa-53b49225a5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:19.951456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fd12c-41c8-4a9f-82aa-53b49225a5d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:19.973947 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fd12c-41c8-4a9f-82aa-53b49225a5d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-440fd12c-41c8-4a9f-82aa-53b49225a5d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:19.984375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:19.985341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:19.986227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:19.986227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:19.986227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:19.986227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:19.986227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:19.986227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:19.986227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:19.986227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:19.986227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:19.986227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:19.986227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:19.986227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:19.989416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 160/321] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:55:19.996767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb5c49-3113-4b27-b5e7-e51fae347d66 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:20.035658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:20.209689 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb5c49-3113-4b27-b5e7-e51fae347d66 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:20.280609 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6601f4-26a1-431a-a856-6bc0665e1876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:20.281701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6601f4-26a1-431a-a856-6bc0665e1876 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:20.282204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6601f4-26a1-431a-a856-6bc0665e1876 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:20.282775 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6601f4-26a1-431a-a856-6bc0665e1876 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:20.284249 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6601f4-26a1-431a-a856-6bc0665e1876 None admin] RBAC: Adding query filter params (name=member) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:20.284814 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6601f4-26a1-431a-a856-6bc0665e1876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:20.287518 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6601f4-26a1-431a-a856-6bc0665e1876 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:20.306042 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 162/322] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:20.315350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fd12c-41c8-4a9f-82aa-53b49225a5d0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:20.391117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:20.513213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5bd66-d2ea-4598-8168-f6778642969a None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:20.513485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5bd66-d2ea-4598-8168-f6778642969a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:20.513664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5bd66-d2ea-4598-8168-f6778642969a None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:20.516165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 163/323] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:55:20.525188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7868379-ac14-42c6-96b1-ddaea224d40c None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:20.525856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7868379-ac14-42c6-96b1-ddaea224d40c None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:20.526035 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7868379-ac14-42c6-96b1-ddaea224d40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:20.552356 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fd12c-41c8-4a9f-82aa-53b49225a5d0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:20.560339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-f7868379-ac14-42c6-96b1-ddaea224d40c None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:20.563435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f7868379-ac14-42c6-96b1-ddaea224d40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:20.618559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dafe6-4345-474f-95a4-b7cd3d32e514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:20.619739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dafe6-4345-474f-95a4-b7cd3d32e514 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:20.620251 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dafe6-4345-474f-95a4-b7cd3d32e514 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:20.620726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dafe6-4345-474f-95a4-b7cd3d32e514 None admin] PATH_INFO: `/v3/users/ca0cf402c2f24990a5a6ced05da428bf` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:20.623267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dafe6-4345-474f-95a4-b7cd3d32e514 None admin] RBAC: Authorizing `identity:get_user(user_id=ca0cf402c2f24990a5a6ced05da428bf)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:20.626189 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dafe6-4345-474f-95a4-b7cd3d32e514 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:20.630451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 161/324] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:20 2022] GET /identity/v3/users/ca0cf402c2f24990a5a6ced05da428bf => generated 293 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:20.639345 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dafe6-4345-474f-95a4-b7cd3d32e514 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:20.713453 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 164/325] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:55:20.715713 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a06e96-fd70-47c6-b2fe-89d077fd4637 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:20.716209 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a06e96-fd70-47c6-b2fe-89d077fd4637 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:20.716695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a06e96-fd70-47c6-b2fe-89d077fd4637 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:20.719607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 165/326] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:20.728191 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e746ed-89c8-4cd1-9b43-e210df0e5d89 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:20.728602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e746ed-89c8-4cd1-9b43-e210df0e5d89 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:20.728810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e746ed-89c8-4cd1-9b43-e210df0e5d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:20.752144 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-63e746ed-89c8-4cd1-9b43-e210df0e5d89 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:20.754637 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-63e746ed-89c8-4cd1-9b43-e210df0e5d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:20.757086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:20.807589 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dafe6-4345-474f-95a4-b7cd3d32e514 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:20.809585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:20.859531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 166/327] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:20.864005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e746ed-89c8-4cd1-9b43-e210df0e5d89 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:20.867118 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341792b-2312-46db-8efa-dfa2196dabd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:20.867767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341792b-2312-46db-8efa-dfa2196dabd7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:20.868048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341792b-2312-46db-8efa-dfa2196dabd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:20.868394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341792b-2312-46db-8efa-dfa2196dabd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:20.874901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341792b-2312-46db-8efa-dfa2196dabd7 None admin] RBAC: Adding query filter params (role.id=7555aed6a21441208a17dedef685336f, user.id=ca0cf402c2f24990a5a6ced05da428bf, scope.system=all) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:20.874901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341792b-2312-46db-8efa-dfa2196dabd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:20.874901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341792b-2312-46db-8efa-dfa2196dabd7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:20.895958 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 162/328] 10.222.0.98 () {56 vars in 1308 bytes} [Tue Jul 26 14:55:20 2022] GET /identity/v3/role_assignments?user.id=ca0cf402c2f24990a5a6ced05da428bf&scope.system=all&role.id=7555aed6a21441208a17dedef685336f => generated 510 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:20.898338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341792b-2312-46db-8efa-dfa2196dabd7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:21.092340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e746ed-89c8-4cd1-9b43-e210df0e5d89 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:21.132232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341792b-2312-46db-8efa-dfa2196dabd7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:21.170774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f11fb3-8a6d-4d87-9233-f51d3d80b343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:21.171302 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f11fb3-8a6d-4d87-9233-f51d3d80b343 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:21.171762 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f11fb3-8a6d-4d87-9233-f51d3d80b343 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:21.172249 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f11fb3-8a6d-4d87-9233-f51d3d80b343 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:21.189099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:21.194915 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f11fb3-8a6d-4d87-9233-f51d3d80b343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:21.205720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a907962-9682-4da8-a917-c96f7c5aaa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:21.206412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a907962-9682-4da8-a917-c96f7c5aaa57 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:21.206696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a907962-9682-4da8-a917-c96f7c5aaa57 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-c7f11fb3-8a6d-4d87-9233-f51d3d80b343 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:21.206947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:21.208148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:21.209331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:21.209331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:21.209331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:21.209331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:21.209331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:21.209331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:21.209331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:21.209331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:21.209331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:21.209331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:21.209331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:55:21.209331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:21.209979 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a907962-9682-4da8-a917-c96f7c5aaa57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:21.210059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 167/329] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:21.210127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a907962-9682-4da8-a917-c96f7c5aaa57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:21.212139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a907962-9682-4da8-a917-c96f7c5aaa57 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:21.213958 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 163/330] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:21.220606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f11fb3-8a6d-4d87-9233-f51d3d80b343 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:21.221769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a907962-9682-4da8-a917-c96f7c5aaa57 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:21.272785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:21.386817 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a907962-9682-4da8-a917-c96f7c5aaa57 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:21.401027 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f11fb3-8a6d-4d87-9233-f51d3d80b343 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:21.445898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce44e2-d9c6-4d5f-9ed2-d9d2c192cbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:21.446580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce44e2-d9c6-4d5f-9ed2-d9d2c192cbdb None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:21.446868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce44e2-d9c6-4d5f-9ed2-d9d2c192cbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:21.447134 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6953f0-05a3-4119-a14a-0a61a4506f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:21.447276 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce44e2-d9c6-4d5f-9ed2-d9d2c192cbdb None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:21.447877 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce44e2-d9c6-4d5f-9ed2-d9d2c192cbdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:21.448041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6953f0-05a3-4119-a14a-0a61a4506f3c None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:21.448316 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6953f0-05a3-4119-a14a-0a61a4506f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:21.448444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce44e2-d9c6-4d5f-9ed2-d9d2c192cbdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:21.448660 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6953f0-05a3-4119-a14a-0a61a4506f3c None admin] PATH_INFO: `/v3/groups` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:21.449551 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6953f0-05a3-4119-a14a-0a61a4506f3c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:21.449757 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce44e2-d9c6-4d5f-9ed2-d9d2c192cbdb None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:21.451797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6953f0-05a3-4119-a14a-0a61a4506f3c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:21.460699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 168/331] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:21.466817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce44e2-d9c6-4d5f-9ed2-d9d2c192cbdb None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:21.568134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:21.569109 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 164/332] 10.222.0.98 () {60 vars in 1134 bytes} [Tue Jul 26 14:55:21 2022] POST /identity/v3/groups => generated 226 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:55:21.650547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce44e2-d9c6-4d5f-9ed2-d9d2c192cbdb None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:21.713169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a94e69-1882-4c29-a23a-62ed01c1e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:21.714297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a94e69-1882-4c29-a23a-62ed01c1e9ce None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:21.715257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a94e69-1882-4c29-a23a-62ed01c1e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:21.715257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a94e69-1882-4c29-a23a-62ed01c1e9ce None admin] PATH_INFO: `/v3/users/0e342b24212a4abdb40ee2744a507fd4` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:21.717607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a94e69-1882-4c29-a23a-62ed01c1e9ce None admin] RBAC: Authorizing `identity:get_user(user_id=0e342b24212a4abdb40ee2744a507fd4)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:21.720374 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a94e69-1882-4c29-a23a-62ed01c1e9ce None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:21.724829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 169/333] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:21 2022] GET /identity/v3/users/0e342b24212a4abdb40ee2744a507fd4 => generated 293 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:21.733228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6953f0-05a3-4119-a14a-0a61a4506f3c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:21.925967 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:21.948176 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6953f0-05a3-4119-a14a-0a61a4506f3c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:22.013479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e99af-2b91-4f34-9367-3e5a0d7b58a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:22.014336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e99af-2b91-4f34-9367-3e5a0d7b58a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:22.014769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e99af-2b91-4f34-9367-3e5a0d7b58a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:22.015196 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e99af-2b91-4f34-9367-3e5a0d7b58a1 None admin] PATH_INFO: `/v3/system/users/0e342b24212a4abdb40ee2744a507fd4/roles/1cb1920ac8734f678410e3f1ad89de68` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:22.018682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e99af-2b91-4f34-9367-3e5a0d7b58a1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0e342b24212a4abdb40ee2744a507fd4, role_id=1cb1920ac8734f678410e3f1ad89de68)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:22.020405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e99af-2b91-4f34-9367-3e5a0d7b58a1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:22.104426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 165/334] 10.222.0.98 () {58 vars in 1334 bytes} [Tue Jul 26 14:55:21 2022] PUT /identity/v3/system/users/0e342b24212a4abdb40ee2744a507fd4/roles/1cb1920ac8734f678410e3f1ad89de68 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:55:25.820967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6f61d-bf01-4481-bd90-aef54cc1dd19 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:25.821883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6f61d-bf01-4481-bd90-aef54cc1dd19 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:25.822303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6f61d-bf01-4481-bd90-aef54cc1dd19 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:25.824282 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 170/335] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:25.833534 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae48e15-4353-4a99-a283-83e1ce95b671 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:25.834503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae48e15-4353-4a99-a283-83e1ce95b671 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:25.834954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae48e15-4353-4a99-a283-83e1ce95b671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:25.860138 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cae48e15-4353-4a99-a283-83e1ce95b671 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:25.862559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cae48e15-4353-4a99-a283-83e1ce95b671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:25.952553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 166/336] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:25.956613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73681493-d94a-41a0-9123-bcf363ca7e7f None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:25.957409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73681493-d94a-41a0-9123-bcf363ca7e7f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:25.957995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73681493-d94a-41a0-9123-bcf363ca7e7f None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:25.961092 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 171/337] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:55:25.966452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94386a-f5f9-4c76-93cd-79828de6c0b9 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:25.966995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94386a-f5f9-4c76-93cd-79828de6c0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:25.967445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94386a-f5f9-4c76-93cd-79828de6c0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:25.996276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-6b94386a-f5f9-4c76-93cd-79828de6c0b9 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:25.997809 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6b94386a-f5f9-4c76-93cd-79828de6c0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:26.016511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73681493-d94a-41a0-9123-bcf363ca7e7f None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:26.193559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 167/338] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:26.238606 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94386a-f5f9-4c76-93cd-79828de6c0b9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:26.282058 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:26.344775 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73681493-d94a-41a0-9123-bcf363ca7e7f None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:26.412726 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:26.443650 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264b9da-b072-4f1e-8eb9-0b6f80af8744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:26.444737 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b9da-b072-4f1e-8eb9-0b6f80af8744 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:26.445263 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b9da-b072-4f1e-8eb9-0b6f80af8744 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:26.445776 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b9da-b072-4f1e-8eb9-0b6f80af8744 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:26.483729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264b9da-b072-4f1e-8eb9-0b6f80af8744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-8264b9da-b072-4f1e-8eb9-0b6f80af8744 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:26.494255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:26.495283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:26.496138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:26.496138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:26.496138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:26.496138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:26.496138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:26.496138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:26.496138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:26.496138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:26.496138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:26.496138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:26.496138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:26.496138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:26.505558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 172/339] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 489 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:26.510492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f790b-a1de-4207-8b3f-2e777fab294e None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:26.510492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f790b-a1de-4207-8b3f-2e777fab294e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:26.510492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f790b-a1de-4207-8b3f-2e777fab294e None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:26.510823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94386a-f5f9-4c76-93cd-79828de6c0b9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:26.512293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 173/340] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:26.513754 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f790b-a1de-4207-8b3f-2e777fab294e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:26.585825 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc409fe-f221-4ceb-bebc-cae1d26e7f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:26.586523 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc409fe-f221-4ceb-bebc-cae1d26e7f90 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:26.586813 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc409fe-f221-4ceb-bebc-cae1d26e7f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:26.587094 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc409fe-f221-4ceb-bebc-cae1d26e7f90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:26.610260 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc409fe-f221-4ceb-bebc-cae1d26e7f90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-8fc409fe-f221-4ceb-bebc-cae1d26e7f90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:26.628564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:26.629537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:26.630340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:26.630340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:26.630340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:26.630340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:26.630340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:26.630340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:26.630340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:26.630340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:26.630340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:26.630340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:26.630340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:26.630340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:26.631482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 168/341] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:26.633953 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f2f28-6e01-40cd-961d-21ecee28f92f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:26.634393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f2f28-6e01-40cd-961d-21ecee28f92f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:26.635022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f2f28-6e01-40cd-961d-21ecee28f92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:26.678913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e33f2f28-6e01-40cd-961d-21ecee28f92f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:26.681065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e33f2f28-6e01-40cd-961d-21ecee28f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:26.749677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f790b-a1de-4207-8b3f-2e777fab294e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:26.788199 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 169/342] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:26.789699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e8a41-6199-4ee2-98cc-2a77460523f6 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:26.789990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e8a41-6199-4ee2-98cc-2a77460523f6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:26.790269 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e8a41-6199-4ee2-98cc-2a77460523f6 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:26.792003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 170/343] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:26.792637 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e8a41-6199-4ee2-98cc-2a77460523f6 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:26.812227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:26.839008 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88bcc3-4ed8-4715-bfcb-724ef3461227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:26.840430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88bcc3-4ed8-4715-bfcb-724ef3461227 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:26.840921 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88bcc3-4ed8-4715-bfcb-724ef3461227 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:26.841443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88bcc3-4ed8-4715-bfcb-724ef3461227 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:26.843369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88bcc3-4ed8-4715-bfcb-724ef3461227 None admin] RBAC: Adding query filter params (name=member) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:26.844591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88bcc3-4ed8-4715-bfcb-724ef3461227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:26.848458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88bcc3-4ed8-4715-bfcb-724ef3461227 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:26.873171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 174/344] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:26.875836 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831ada3-d9b6-4b04-8a51-19fbbb7f7074 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:26.876376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831ada3-d9b6-4b04-8a51-19fbbb7f7074 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:26.877515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831ada3-d9b6-4b04-8a51-19fbbb7f7074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:26.917554 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-7831ada3-d9b6-4b04-8a51-19fbbb7f7074 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:26.919593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7831ada3-d9b6-4b04-8a51-19fbbb7f7074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:26.999030 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:27.021036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e8a41-6199-4ee2-98cc-2a77460523f6 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:27.043636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 175/345] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:27.049751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831ada3-d9b6-4b04-8a51-19fbbb7f7074 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:27.153559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd39d1-3012-4cea-8fd4-918ecb7000bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:27.154673 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd39d1-3012-4cea-8fd4-918ecb7000bf None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:27.155161 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd39d1-3012-4cea-8fd4-918ecb7000bf None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:27.155643 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd39d1-3012-4cea-8fd4-918ecb7000bf None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:27.156987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd39d1-3012-4cea-8fd4-918ecb7000bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:27.157647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd39d1-3012-4cea-8fd4-918ecb7000bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:27.160504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd39d1-3012-4cea-8fd4-918ecb7000bf None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:27.176546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 171/346] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:27.177458 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd39d1-3012-4cea-8fd4-918ecb7000bf None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:27.250047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831ada3-d9b6-4b04-8a51-19fbbb7f7074 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:27.265449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:27.312313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e90c73-70a6-4cdf-b8f0-d65d4e477df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:27.313538 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e90c73-70a6-4cdf-b8f0-d65d4e477df9 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:27.314291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e90c73-70a6-4cdf-b8f0-d65d4e477df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:27.315550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e90c73-70a6-4cdf-b8f0-d65d4e477df9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:27.333093 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd39d1-3012-4cea-8fd4-918ecb7000bf None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:27.335514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e90c73-70a6-4cdf-b8f0-d65d4e477df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-f5e90c73-70a6-4cdf-b8f0-d65d4e477df9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:27.348128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:27.349256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:27.350153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:27.350153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:27.350153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:27.350153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:27.350153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:27.350153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:27.350153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:27.350153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:27.350153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:27.350153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:27.350153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:55:27.350153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:27.353678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 176/347] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:27.355251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e90c73-70a6-4cdf-b8f0-d65d4e477df9 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:27.391968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd6474-29f7-4940-8178-b7734e98576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:27.392535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd6474-29f7-4940-8178-b7734e98576c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:27.393083 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd6474-29f7-4940-8178-b7734e98576c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:27.393083 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd6474-29f7-4940-8178-b7734e98576c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:27.428123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:27.524049 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e90c73-70a6-4cdf-b8f0-d65d4e477df9 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:27.529847 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd6474-29f7-4940-8178-b7734e98576c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:27.531432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd6474-29f7-4940-8178-b7734e98576c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:27.583505 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e9522-c0b2-430a-aa60-93272ab3f82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:27.584040 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e9522-c0b2-430a-aa60-93272ab3f82a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:27.584322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e9522-c0b2-430a-aa60-93272ab3f82a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:27.584598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e9522-c0b2-430a-aa60-93272ab3f82a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:27.605155 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e9522-c0b2-430a-aa60-93272ab3f82a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-040e9522-c0b2-430a-aa60-93272ab3f82a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:27.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:27.612171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:27.613545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:27.613545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:27.613545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:27.613545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:27.613545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:27.613545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:27.613545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:27.613545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:27.613545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:27.613545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:27.613545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:27.613545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:27.613545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 177/348] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:55:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:27.614235 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1fa30-9fef-4a09-9624-1c87a2b2ab2e None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:27.614573 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1fa30-9fef-4a09-9624-1c87a2b2ab2e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:27.614797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1fa30-9fef-4a09-9624-1c87a2b2ab2e None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:27.616444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 178/349] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:27.617253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1fa30-9fef-4a09-9624-1c87a2b2ab2e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:27.681999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:27.744890 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 172/350] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:27.745782 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd6474-29f7-4940-8178-b7734e98576c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:27.769195 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:27.774526 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1fa30-9fef-4a09-9624-1c87a2b2ab2e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:27.847138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9c4b8-7b5c-41b4-82fe-43e94c044be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:27.848537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9c4b8-7b5c-41b4-82fe-43e94c044be3 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:27.848996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9c4b8-7b5c-41b4-82fe-43e94c044be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:27.849432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9c4b8-7b5c-41b4-82fe-43e94c044be3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:27.914731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd6474-29f7-4940-8178-b7734e98576c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:27.956816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9c4b8-7b5c-41b4-82fe-43e94c044be3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:27.959700 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9c4b8-7b5c-41b4-82fe-43e94c044be3 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:27.983053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbe55c-84a4-455b-90bc-0d5514a48bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:27.984059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbe55c-84a4-455b-90bc-0d5514a48bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:27.984558 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbe55c-84a4-455b-90bc-0d5514a48bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:27.985119 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbe55c-84a4-455b-90bc-0d5514a48bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:27.986630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbe55c-84a4-455b-90bc-0d5514a48bb8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:27.987152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbe55c-84a4-455b-90bc-0d5514a48bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:27.988942 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbe55c-84a4-455b-90bc-0d5514a48bb8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:28.000796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 173/351] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:28.002941 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbe55c-84a4-455b-90bc-0d5514a48bb8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:28.054832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:28.140020 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:28.148498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 179/352] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:28.150685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb07353-00cb-4ca8-91d7-79a29d244caa None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:28.151268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb07353-00cb-4ca8-91d7-79a29d244caa None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:28.151772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb07353-00cb-4ca8-91d7-79a29d244caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:28.183585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbe55c-84a4-455b-90bc-0d5514a48bb8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:28.185449 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-1fb07353-00cb-4ca8-91d7-79a29d244caa None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:28.187601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-1fb07353-00cb-4ca8-91d7-79a29d244caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:28.249438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcd5d8-7f33-4e56-9965-8092512671ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:28.250713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcd5d8-7f33-4e56-9965-8092512671ca None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:28.251059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcd5d8-7f33-4e56-9965-8092512671ca None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:28.251588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcd5d8-7f33-4e56-9965-8092512671ca None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:28.253017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcd5d8-7f33-4e56-9965-8092512671ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:28.253566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcd5d8-7f33-4e56-9965-8092512671ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:28.256003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcd5d8-7f33-4e56-9965-8092512671ca None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:28.276414 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 174/353] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:55:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:28.277412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcd5d8-7f33-4e56-9965-8092512671ca None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:28.331190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 180/354] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:28.332858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb07353-00cb-4ca8-91d7-79a29d244caa None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:28.451321 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:28.476982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcd5d8-7f33-4e56-9965-8092512671ca None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:28.539780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb07353-00cb-4ca8-91d7-79a29d244caa None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:28.551990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f2a1e-db98-47a6-9eba-13e9b1f82266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:28.553968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f2a1e-db98-47a6-9eba-13e9b1f82266 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:28.554471 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f2a1e-db98-47a6-9eba-13e9b1f82266 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:28.555606 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f2a1e-db98-47a6-9eba-13e9b1f82266 None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:28.558973 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f2a1e-db98-47a6-9eba-13e9b1f82266 None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:28.561694 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f2a1e-db98-47a6-9eba-13e9b1f82266 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:28.565876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 175/355] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:28 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:28.568560 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069506e-41d9-4666-9916-912965664d9b None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:28.569673 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069506e-41d9-4666-9916-912965664d9b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:28.570448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069506e-41d9-4666-9916-912965664d9b None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:28.573735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 176/356] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:28.575826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069506e-41d9-4666-9916-912965664d9b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:28.588060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:28.600945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770624cf-a282-4515-86f7-32a2ec3cf484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:28.602217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770624cf-a282-4515-86f7-32a2ec3cf484 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:28.602736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770624cf-a282-4515-86f7-32a2ec3cf484 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:28.603234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770624cf-a282-4515-86f7-32a2ec3cf484 None admin] PATH_INFO: `/v3/users/0e342b24212a4abdb40ee2744a507fd4` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:28.608007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770624cf-a282-4515-86f7-32a2ec3cf484 None admin] RBAC: Authorizing `identity:get_user(user_id=0e342b24212a4abdb40ee2744a507fd4)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:28.610190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770624cf-a282-4515-86f7-32a2ec3cf484 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:28.613885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 181/357] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:55:28 2022] GET /identity/v3/users/0e342b24212a4abdb40ee2744a507fd4 => generated 293 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:28.615644 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770624cf-a282-4515-86f7-32a2ec3cf484 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:28.777438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069506e-41d9-4666-9916-912965664d9b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:28.801577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770624cf-a282-4515-86f7-32a2ec3cf484 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:28.837076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c0614-ec6b-4b11-82ed-09adde7d8789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:28.838164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c0614-ec6b-4b11-82ed-09adde7d8789 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:28.838720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c0614-ec6b-4b11-82ed-09adde7d8789 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:28.839199 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c0614-ec6b-4b11-82ed-09adde7d8789 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:28.841578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c0614-ec6b-4b11-82ed-09adde7d8789 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:28.844560 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c0614-ec6b-4b11-82ed-09adde7d8789 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:28.848481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 177/358] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:28 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:28.849883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c0614-ec6b-4b11-82ed-09adde7d8789 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:28.879832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11064030-b841-4c6d-9a70-7b4e211af734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:28.880926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11064030-b841-4c6d-9a70-7b4e211af734 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:28.881424 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11064030-b841-4c6d-9a70-7b4e211af734 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:28.881889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11064030-b841-4c6d-9a70-7b4e211af734 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:28.899497 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:28.974831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:28.980991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11064030-b841-4c6d-9a70-7b4e211af734 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:28.983105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11064030-b841-4c6d-9a70-7b4e211af734 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:29.050006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c0614-ec6b-4b11-82ed-09adde7d8789 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:29.096719 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be157ae5-6474-4388-b564-b459ad0c69b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:29.097418 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be157ae5-6474-4388-b564-b459ad0c69b5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:29.097767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be157ae5-6474-4388-b564-b459ad0c69b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:29.098048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be157ae5-6474-4388-b564-b459ad0c69b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:29.111770 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be157ae5-6474-4388-b564-b459ad0c69b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-be157ae5-6474-4388-b564-b459ad0c69b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:29.117276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:29.119177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:29.120783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:29.120783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:29.120783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:29.120783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:29.120783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:29.120783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:29.120783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:29.120783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:29.120783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:29.120783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:29.120783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:29.120783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:29.120783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 178/359] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:55:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:29.120783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be157ae5-6474-4388-b564-b459ad0c69b5 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:29.157382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 182/360] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:29.157382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878c6ae-a35f-4f63-b534-e483018181a3 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:29.157382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878c6ae-a35f-4f63-b534-e483018181a3 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:29.157382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878c6ae-a35f-4f63-b534-e483018181a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:29.181279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-2878c6ae-a35f-4f63-b534-e483018181a3 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:29.182639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2878c6ae-a35f-4f63-b534-e483018181a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:29.233862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:29.254433 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be157ae5-6474-4388-b564-b459ad0c69b5 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:29.280746 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 183/361] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:29.281821 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878c6ae-a35f-4f63-b534-e483018181a3 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:29.313274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d326c2-2b95-441b-bd84-aa046e8494a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:29.315296 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d326c2-2b95-441b-bd84-aa046e8494a8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:29.315740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d326c2-2b95-441b-bd84-aa046e8494a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:29.316414 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d326c2-2b95-441b-bd84-aa046e8494a8 None admin] PATH_INFO: `/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:29.326900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d326c2-2b95-441b-bd84-aa046e8494a8 None admin] RBAC: Authorizing `identity:get_group(group_id=1fb99f71fcc84a98b705dc924e7a5e57)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:29.330308 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d326c2-2b95-441b-bd84-aa046e8494a8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:29.332784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 179/362] 10.222.0.98 () {56 vars in 1180 bytes} [Tue Jul 26 14:55:29 2022] GET /identity/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:29.334320 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d326c2-2b95-441b-bd84-aa046e8494a8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:29.341607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:29.464586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d326c2-2b95-441b-bd84-aa046e8494a8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:29.478305 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878c6ae-a35f-4f63-b534-e483018181a3 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:29.520233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450019f8-bf6f-421f-9f94-03fda51c3d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:29.521368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450019f8-bf6f-421f-9f94-03fda51c3d6c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:29.521878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450019f8-bf6f-421f-9f94-03fda51c3d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:29.522382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450019f8-bf6f-421f-9f94-03fda51c3d6c None admin] PATH_INFO: `/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:29.524694 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450019f8-bf6f-421f-9f94-03fda51c3d6c None admin] RBAC: Authorizing `identity:get_group(group_id=1fb99f71fcc84a98b705dc924e7a5e57)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:29.527554 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450019f8-bf6f-421f-9f94-03fda51c3d6c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:29.530703 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 180/363] 10.222.0.98 () {56 vars in 1180 bytes} [Tue Jul 26 14:55:29 2022] GET /identity/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:29.530703 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450019f8-bf6f-421f-9f94-03fda51c3d6c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:29.537999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dc348-1787-49a1-96a6-3be6bb01dc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:29.537999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dc348-1787-49a1-96a6-3be6bb01dc67 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:29.537999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dc348-1787-49a1-96a6-3be6bb01dc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:29.537999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dc348-1787-49a1-96a6-3be6bb01dc67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:29.538552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dc348-1787-49a1-96a6-3be6bb01dc67 None admin] RBAC: Adding query filter params (role.id=1cb1920ac8734f678410e3f1ad89de68, user.id=0e342b24212a4abdb40ee2744a507fd4, scope.system=all) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:29.538552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dc348-1787-49a1-96a6-3be6bb01dc67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:29.538552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dc348-1787-49a1-96a6-3be6bb01dc67 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:29.555665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 184/364] 10.222.0.98 () {56 vars in 1308 bytes} [Tue Jul 26 14:55:29 2022] GET /identity/v3/role_assignments?user.id=0e342b24212a4abdb40ee2744a507fd4&scope.system=all&role.id=1cb1920ac8734f678410e3f1ad89de68 => generated 510 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:29.556707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dc348-1787-49a1-96a6-3be6bb01dc67 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:29.569960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:29.718615 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:29.738948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450019f8-bf6f-421f-9f94-03fda51c3d6c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:29.741881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dc348-1787-49a1-96a6-3be6bb01dc67 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:29.804303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbee13-5a25-49dc-98f7-4d396e997a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:29.805350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06143e71-a84f-4e52-95e8-99e11d501a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:29.805476 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbee13-5a25-49dc-98f7-4d396e997a1c None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:29.805963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06143e71-a84f-4e52-95e8-99e11d501a7b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:29.806252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06143e71-a84f-4e52-95e8-99e11d501a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:29.806555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06143e71-a84f-4e52-95e8-99e11d501a7b None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:29.806831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbee13-5a25-49dc-98f7-4d396e997a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:29.807282 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbee13-5a25-49dc-98f7-4d396e997a1c None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:29.807390 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06143e71-a84f-4e52-95e8-99e11d501a7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:29.807584 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06143e71-a84f-4e52-95e8-99e11d501a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:29.809067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06143e71-a84f-4e52-95e8-99e11d501a7b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:29.809861 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbee13-5a25-49dc-98f7-4d396e997a1c None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:29.812746 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbee13-5a25-49dc-98f7-4d396e997a1c None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:29.818641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 185/365] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:29 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:29.821336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbee13-5a25-49dc-98f7-4d396e997a1c None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:29.821491 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 181/366] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:55:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:29.822926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06143e71-a84f-4e52-95e8-99e11d501a7b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:29.981115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:30.013992 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbee13-5a25-49dc-98f7-4d396e997a1c None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:30.022760 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06143e71-a84f-4e52-95e8-99e11d501a7b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:30.072929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7620222-2c77-4926-8dcc-344b302f463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:30.073670 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7620222-2c77-4926-8dcc-344b302f463a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:30.074139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7620222-2c77-4926-8dcc-344b302f463a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:30.074532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7620222-2c77-4926-8dcc-344b302f463a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:30.093347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec19c3d-648c-4fd2-b651-c910e90a191f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:30.094100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec19c3d-648c-4fd2-b651-c910e90a191f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:30.094432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec19c3d-648c-4fd2-b651-c910e90a191f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:30.095576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec19c3d-648c-4fd2-b651-c910e90a191f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:30.096637 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec19c3d-648c-4fd2-b651-c910e90a191f None admin] RBAC: Adding query filter params (group.id=1fb99f71fcc84a98b705dc924e7a5e57, role.id=7555aed6a21441208a17dedef685336f, scope.project.id=03c5e81f100d42b1bcc655353fbecbc8) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:30.097126 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec19c3d-648c-4fd2-b651-c910e90a191f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:30.098807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec19c3d-648c-4fd2-b651-c910e90a191f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:30.101032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7620222-2c77-4926-8dcc-344b302f463a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:30.105638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 182/367] 10.222.0.98 () {56 vars in 1376 bytes} [Tue Jul 26 14:55:29 2022] GET /identity/v3/role_assignments?group.id=1fb99f71fcc84a98b705dc924e7a5e57&scope.project.id=03c5e81f100d42b1bcc655353fbecbc8&role.id=7555aed6a21441208a17dedef685336f => generated 260 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:30.106770 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec19c3d-648c-4fd2-b651-c910e90a191f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-f7620222-2c77-4926-8dcc-344b302f463a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:30.112564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:30.114284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:30.122692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:30.122692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:30.122692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:30.122692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:30.122692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:30.122692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:30.122692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:30.122692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:30.122692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:30.122692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:30.122692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:55:30.122692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:30.122692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 186/368] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:55:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:30.122692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7620222-2c77-4926-8dcc-344b302f463a None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:30.153781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:30.341369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7620222-2c77-4926-8dcc-344b302f463a None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:30.348017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec19c3d-648c-4fd2-b651-c910e90a191f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:30.414115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d45cf-e1ca-45e5-ac04-35346dc5e53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:30.415136 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d45cf-e1ca-45e5-ac04-35346dc5e53b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:30.415594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d45cf-e1ca-45e5-ac04-35346dc5e53b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:30.416056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d45cf-e1ca-45e5-ac04-35346dc5e53b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:30.417713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d45cf-e1ca-45e5-ac04-35346dc5e53b None admin] RBAC: Adding query filter params (group.id=1fb99f71fcc84a98b705dc924e7a5e57, role.id=7555aed6a21441208a17dedef685336f, scope.project.id=d8b578718bf04a31bc5b638315420654) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:30.418227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d45cf-e1ca-45e5-ac04-35346dc5e53b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:30.418760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf3598-eb57-4a22-aa1a-3f381dd8aa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:30.420044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf3598-eb57-4a22-aa1a-3f381dd8aa3a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:30.420044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf3598-eb57-4a22-aa1a-3f381dd8aa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:30.420356 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf3598-eb57-4a22-aa1a-3f381dd8aa3a None admin] PATH_INFO: `/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:30.420521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d45cf-e1ca-45e5-ac04-35346dc5e53b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:30.430825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf3598-eb57-4a22-aa1a-3f381dd8aa3a None admin] RBAC: Authorizing `identity:get_group(group_id=1fb99f71fcc84a98b705dc924e7a5e57)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:30.430825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf3598-eb57-4a22-aa1a-3f381dd8aa3a None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:30.430825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 187/369] 10.222.0.98 () {56 vars in 1180 bytes} [Tue Jul 26 14:55:30 2022] GET /identity/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57 => generated 226 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:30.430825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf3598-eb57-4a22-aa1a-3f381dd8aa3a None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:30.438937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 183/370] 10.222.0.98 () {56 vars in 1376 bytes} [Tue Jul 26 14:55:30 2022] GET /identity/v3/role_assignments?group.id=1fb99f71fcc84a98b705dc924e7a5e57&scope.project.id=d8b578718bf04a31bc5b638315420654&role.id=7555aed6a21441208a17dedef685336f => generated 260 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:30.445377 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d45cf-e1ca-45e5-ac04-35346dc5e53b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:30.465790 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:30.558107 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:30.586685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf3598-eb57-4a22-aa1a-3f381dd8aa3a None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:30.633842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a076a6-a953-4da0-a16a-ecf03b76fa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:30.634546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a076a6-a953-4da0-a16a-ecf03b76fa82 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:30.634831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a076a6-a953-4da0-a16a-ecf03b76fa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:30.635162 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a076a6-a953-4da0-a16a-ecf03b76fa82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:30.670447 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d45cf-e1ca-45e5-ac04-35346dc5e53b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:30.737392 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a076a6-a953-4da0-a16a-ecf03b76fa82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:30.738982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a076a6-a953-4da0-a16a-ecf03b76fa82 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:30.740099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44290a1-1e23-4e98-ba92-aecf4d573a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:30.741166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44290a1-1e23-4e98-ba92-aecf4d573a1f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:30.741807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44290a1-1e23-4e98-ba92-aecf4d573a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:30.742412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44290a1-1e23-4e98-ba92-aecf4d573a1f None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:30.744113 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44290a1-1e23-4e98-ba92-aecf4d573a1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:30.744755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44290a1-1e23-4e98-ba92-aecf4d573a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:30.747412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44290a1-1e23-4e98-ba92-aecf4d573a1f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:30.764099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 184/371] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:30.765794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44290a1-1e23-4e98-ba92-aecf4d573a1f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:30.848693 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:30.874831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 188/372] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:30.876895 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a076a6-a953-4da0-a16a-ecf03b76fa82 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:30.943000 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:30.965161 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44290a1-1e23-4e98-ba92-aecf4d573a1f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:31.012995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a076a6-a953-4da0-a16a-ecf03b76fa82 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:31.035006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a854cb-4d77-49eb-a083-358a905f6f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:31.035827 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a854cb-4d77-49eb-a083-358a905f6f8a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:31.036216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a854cb-4d77-49eb-a083-358a905f6f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:31.036596 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a854cb-4d77-49eb-a083-358a905f6f8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:31.037570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a854cb-4d77-49eb-a083-358a905f6f8a None admin] RBAC: Adding query filter params (group.id=1fb99f71fcc84a98b705dc924e7a5e57, role.id=3b3abbcf8ee04f0387cfdede5812d226, scope.project.id=d8b578718bf04a31bc5b638315420654) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:31.038001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a854cb-4d77-49eb-a083-358a905f6f8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:31.039650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a854cb-4d77-49eb-a083-358a905f6f8a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:31.046865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 185/373] 10.222.0.98 () {56 vars in 1376 bytes} [Tue Jul 26 14:55:30 2022] GET /identity/v3/role_assignments?group.id=1fb99f71fcc84a98b705dc924e7a5e57&scope.project.id=d8b578718bf04a31bc5b638315420654&role.id=3b3abbcf8ee04f0387cfdede5812d226 => generated 260 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:31.048648 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a854cb-4d77-49eb-a083-358a905f6f8a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:31.072918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c469e2c-ebde-4fcc-8918-e8c0562416f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:31.073602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c469e2c-ebde-4fcc-8918-e8c0562416f8 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:31.073885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c469e2c-ebde-4fcc-8918-e8c0562416f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:31.074160 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c469e2c-ebde-4fcc-8918-e8c0562416f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:31.195019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:31.232081 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c469e2c-ebde-4fcc-8918-e8c0562416f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:31.235044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c469e2c-ebde-4fcc-8918-e8c0562416f8 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:31.375477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a854cb-4d77-49eb-a083-358a905f6f8a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:31.415778 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:31.419679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491c8db-c53f-4425-970d-1c26475993ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:31.420498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491c8db-c53f-4425-970d-1c26475993ec None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:31.421037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491c8db-c53f-4425-970d-1c26475993ec None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:31.421500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491c8db-c53f-4425-970d-1c26475993ec None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:31.423474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491c8db-c53f-4425-970d-1c26475993ec None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:31.425119 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491c8db-c53f-4425-970d-1c26475993ec None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:31.427101 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 186/374] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:31 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:31.435992 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491c8db-c53f-4425-970d-1c26475993ec None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:31.541065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 189/375] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:31.556865 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c469e2c-ebde-4fcc-8918-e8c0562416f8 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:31.744804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491c8db-c53f-4425-970d-1c26475993ec None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:31.799773 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:31.846649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c469e2c-ebde-4fcc-8918-e8c0562416f8 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:31.867626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db058345-e126-4628-8bde-831071723bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:31.871504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db058345-e126-4628-8bde-831071723bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:31.873786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db058345-e126-4628-8bde-831071723bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:31.874557 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db058345-e126-4628-8bde-831071723bb7 None admin] PATH_INFO: `/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:31.883248 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db058345-e126-4628-8bde-831071723bb7 None admin] RBAC: Authorizing `identity:get_group(group_id=1fb99f71fcc84a98b705dc924e7a5e57)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:31.888014 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db058345-e126-4628-8bde-831071723bb7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:31.895225 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 187/376] 10.222.0.98 () {56 vars in 1180 bytes} [Tue Jul 26 14:55:31 2022] GET /identity/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57 => generated 226 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:31.906398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db058345-e126-4628-8bde-831071723bb7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:31.956695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fd949-4228-4639-b009-bdbb13e1b7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:31.958178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fd949-4228-4639-b009-bdbb13e1b7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:31.958923 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fd949-4228-4639-b009-bdbb13e1b7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:31.959562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fd949-4228-4639-b009-bdbb13e1b7c1 None admin] PATH_INFO: `/v3/projects/eae5d7650fd54c5a8c95f42eefe32a57` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:31.962017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fd949-4228-4639-b009-bdbb13e1b7c1 None admin] RBAC: Authorizing `identity:get_project(project_id=eae5d7650fd54c5a8c95f42eefe32a57)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:31.964996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fd949-4228-4639-b009-bdbb13e1b7c1 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:31.968979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 190/377] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:31 2022] GET /identity/v3/projects/eae5d7650fd54c5a8c95f42eefe32a57 => generated 344 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:31.975485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fd949-4228-4639-b009-bdbb13e1b7c1 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:32.084855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:32.187038 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fd949-4228-4639-b009-bdbb13e1b7c1 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:32.241734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db058345-e126-4628-8bde-831071723bb7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:32.255954 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57a546-7815-4ef5-8707-70ec3c52a122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:32.257047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a546-7815-4ef5-8707-70ec3c52a122 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:32.257605 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a546-7815-4ef5-8707-70ec3c52a122 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:32.258153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a546-7815-4ef5-8707-70ec3c52a122 None admin] PATH_INFO: `/v3/groups/499b1619daa3411281927edb83934c25` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:32.269919 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57a546-7815-4ef5-8707-70ec3c52a122 None admin] RBAC: Authorizing `identity:get_group(group_id=499b1619daa3411281927edb83934c25)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:32.273145 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57a546-7815-4ef5-8707-70ec3c52a122 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:32.276959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 191/378] 10.222.0.98 () {56 vars in 1180 bytes} [Tue Jul 26 14:55:31 2022] GET /identity/v3/groups/499b1619daa3411281927edb83934c25 => generated 229 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:32.288576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57a546-7815-4ef5-8707-70ec3c52a122 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:32.313982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3259557-a1e5-44b7-a516-6ffd82173d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:32.314660 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3259557-a1e5-44b7-a516-6ffd82173d59 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:32.314942 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3259557-a1e5-44b7-a516-6ffd82173d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:32.315214 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3259557-a1e5-44b7-a516-6ffd82173d59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:32.316053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3259557-a1e5-44b7-a516-6ffd82173d59 None admin] RBAC: Adding query filter params (group.id=1fb99f71fcc84a98b705dc924e7a5e57, role.id=3b3abbcf8ee04f0387cfdede5812d226, scope.project.id=03c5e81f100d42b1bcc655353fbecbc8) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:32.316485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3259557-a1e5-44b7-a516-6ffd82173d59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:32.318102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3259557-a1e5-44b7-a516-6ffd82173d59 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:32.323588 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:32.328044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 188/379] 10.222.0.98 () {56 vars in 1376 bytes} [Tue Jul 26 14:55:31 2022] GET /identity/v3/role_assignments?group.id=1fb99f71fcc84a98b705dc924e7a5e57&scope.project.id=03c5e81f100d42b1bcc655353fbecbc8&role.id=3b3abbcf8ee04f0387cfdede5812d226 => generated 260 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:32.529478 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57a546-7815-4ef5-8707-70ec3c52a122 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:32.594887 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2697650-2dce-4e3f-b147-34a1784279fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:32.595797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2697650-2dce-4e3f-b147-34a1784279fa None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:32.596252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2697650-2dce-4e3f-b147-34a1784279fa None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:32.596703 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2697650-2dce-4e3f-b147-34a1784279fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:32.598048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2697650-2dce-4e3f-b147-34a1784279fa None admin] RBAC: Adding query filter params (group.id=499b1619daa3411281927edb83934c25, role.id=17054492864541709fda49dbf677a7a2, scope.project.id=eae5d7650fd54c5a8c95f42eefe32a57) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:32.598588 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2697650-2dce-4e3f-b147-34a1784279fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:32.601217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2697650-2dce-4e3f-b147-34a1784279fa None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:32.613586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 192/380] 10.222.0.98 () {56 vars in 1376 bytes} [Tue Jul 26 14:55:32 2022] GET /identity/v3/role_assignments?group.id=499b1619daa3411281927edb83934c25&scope.project.id=eae5d7650fd54c5a8c95f42eefe32a57&role.id=17054492864541709fda49dbf677a7a2 => generated 260 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:33.323518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ba832-61ad-467b-8abb-207937e7619d None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:33.324057 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ba832-61ad-467b-8abb-207937e7619d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:33.324519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ba832-61ad-467b-8abb-207937e7619d None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:33.327157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 189/381] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:33.334257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcba4b-cb4b-407a-a567-fa1f701e22ec None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:33.335236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcba4b-cb4b-407a-a567-fa1f701e22ec None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:33.335722 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcba4b-cb4b-407a-a567-fa1f701e22ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:33.365929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a1bcba4b-cb4b-407a-a567-fa1f701e22ec None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:33.367622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a1bcba4b-cb4b-407a-a567-fa1f701e22ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:33.509525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 193/382] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:55:33.515682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada69df-29ef-479f-b108-7e641e26cde6 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:33.517165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada69df-29ef-479f-b108-7e641e26cde6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:33.517961 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada69df-29ef-479f-b108-7e641e26cde6 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:33.521396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 190/383] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:33.528375 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfca84-eb93-44aa-9df7-fa893b8d7314 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:33.528787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfca84-eb93-44aa-9df7-fa893b8d7314 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:33.528941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfca84-eb93-44aa-9df7-fa893b8d7314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:33.561400 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada69df-29ef-479f-b108-7e641e26cde6 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:33.577151 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-63bfca84-eb93-44aa-9df7-fa893b8d7314 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:33.577151 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-63bfca84-eb93-44aa-9df7-fa893b8d7314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:33.595286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:33.674204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 194/384] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:33.712172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfca84-eb93-44aa-9df7-fa893b8d7314 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:33.812269 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada69df-29ef-479f-b108-7e641e26cde6 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:33.917763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:33.930151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94048a4f-aa26-41b5-9332-70b4530c0a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:33.931735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94048a4f-aa26-41b5-9332-70b4530c0a4c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:33.932474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94048a4f-aa26-41b5-9332-70b4530c0a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:33.934524 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94048a4f-aa26-41b5-9332-70b4530c0a4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:33.955643 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94048a4f-aa26-41b5-9332-70b4530c0a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-94048a4f-aa26-41b5-9332-70b4530c0a4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:33.962785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:33.963838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:33.964730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:33.964730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:33.964730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:33.964730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:33.964730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:33.964730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:33.964730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:33.964730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:33.964730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:33.964730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:33.964730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:33.964730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:33.968918 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 191/385] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:33.975886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94048a4f-aa26-41b5-9332-70b4530c0a4c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:34.056434 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfca84-eb93-44aa-9df7-fa893b8d7314 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:34.105253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1529c4-c117-43c8-9f91-1667a3dd430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:34.106297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1529c4-c117-43c8-9f91-1667a3dd430f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:34.106846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1529c4-c117-43c8-9f91-1667a3dd430f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:34.107402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1529c4-c117-43c8-9f91-1667a3dd430f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:34.117252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:34.122552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1529c4-c117-43c8-9f91-1667a3dd430f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-de1529c4-c117-43c8-9f91-1667a3dd430f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:34.129353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:34.137842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:34.138765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:34.138765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:34.138765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:34.138765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:34.138765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:34.138765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:34.138765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:34.138765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:34.138765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:34.138765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:34.138765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:34.138765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:34.138765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 195/386] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:55:34.140054 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94048a4f-aa26-41b5-9332-70b4530c0a4c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:34.141819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e867006-0721-4c18-962b-1e6198b6b6f6 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:34.142636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e867006-0721-4c18-962b-1e6198b6b6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:34.143066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e867006-0721-4c18-962b-1e6198b6b6f6 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:34.145157 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 196/387] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:34 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:34.146119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e867006-0721-4c18-962b-1e6198b6b6f6 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:34.185899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8d0ab-1f0d-44c7-8ced-d3cce60d4aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:34.186343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8d0ab-1f0d-44c7-8ced-d3cce60d4aed None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:34.186657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8d0ab-1f0d-44c7-8ced-d3cce60d4aed None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:34.186930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8d0ab-1f0d-44c7-8ced-d3cce60d4aed None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:34.187674 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8d0ab-1f0d-44c7-8ced-d3cce60d4aed None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:34.187981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8d0ab-1f0d-44c7-8ced-d3cce60d4aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:34.190484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8d0ab-1f0d-44c7-8ced-d3cce60d4aed None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:34.200584 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 192/388] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:34.206484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809c779-bd81-4fec-8bac-e0ebef764966 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:34.206484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809c779-bd81-4fec-8bac-e0ebef764966 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:34.206484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809c779-bd81-4fec-8bac-e0ebef764966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:34.222872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7809c779-bd81-4fec-8bac-e0ebef764966 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:34.223965 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7809c779-bd81-4fec-8bac-e0ebef764966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:34.286069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:34.313689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 193/389] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:34.314765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809c779-bd81-4fec-8bac-e0ebef764966 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:34.361086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e867006-0721-4c18-962b-1e6198b6b6f6 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:34.436037 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3244d-51fa-4aa0-bd93-473c460f287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:34.437050 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3244d-51fa-4aa0-bd93-473c460f287f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:34.437488 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3244d-51fa-4aa0-bd93-473c460f287f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:34.438104 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3244d-51fa-4aa0-bd93-473c460f287f None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:34.439430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3244d-51fa-4aa0-bd93-473c460f287f None admin] RBAC: Adding query filter params (name=member) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:34.440405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3244d-51fa-4aa0-bd93-473c460f287f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:34.443595 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3244d-51fa-4aa0-bd93-473c460f287f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:34.462083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 197/390] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:34.468157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809c779-bd81-4fec-8bac-e0ebef764966 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:34.473127 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3244d-51fa-4aa0-bd93-473c460f287f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:34.526598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcc0c5-98df-4f18-9f40-2a5a06f64e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:34.528192 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcc0c5-98df-4f18-9f40-2a5a06f64e6e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:34.528508 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcc0c5-98df-4f18-9f40-2a5a06f64e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:34.528815 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcc0c5-98df-4f18-9f40-2a5a06f64e6e None admin] PATH_INFO: `/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:34.530467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcc0c5-98df-4f18-9f40-2a5a06f64e6e None admin] RBAC: Authorizing `identity:get_group(group_id=1fb99f71fcc84a98b705dc924e7a5e57)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:34.532879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcc0c5-98df-4f18-9f40-2a5a06f64e6e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:34.542137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 194/391] 10.222.0.98 () {56 vars in 1180 bytes} [Tue Jul 26 14:55:34 2022] GET /identity/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:34.542137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcc0c5-98df-4f18-9f40-2a5a06f64e6e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:34.614338 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:34.619603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:34.708723 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3244d-51fa-4aa0-bd93-473c460f287f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:34.713184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcc0c5-98df-4f18-9f40-2a5a06f64e6e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:34.761698 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330838e-5873-467e-a565-3c992da09c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:34.762399 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330838e-5873-467e-a565-3c992da09c39 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:34.762759 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330838e-5873-467e-a565-3c992da09c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:34.763233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330838e-5873-467e-a565-3c992da09c39 None admin] PATH_INFO: `/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:34.764765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330838e-5873-467e-a565-3c992da09c39 None admin] RBAC: Authorizing `identity:get_group(group_id=1fb99f71fcc84a98b705dc924e7a5e57)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:34.766578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330838e-5873-467e-a565-3c992da09c39 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:34.773219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 195/392] 10.222.0.98 () {56 vars in 1180 bytes} [Tue Jul 26 14:55:34 2022] GET /identity/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:34.773219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330838e-5873-467e-a565-3c992da09c39 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:34.804536 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5739b-cda8-4951-b736-b8c268b0bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:34.806259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5739b-cda8-4951-b736-b8c268b0bfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:34.806990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5739b-cda8-4951-b736-b8c268b0bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:34.807668 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5739b-cda8-4951-b736-b8c268b0bfc6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:34.830053 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5739b-cda8-4951-b736-b8c268b0bfc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-82f5739b-cda8-4951-b736-b8c268b0bfc6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:34.843063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:34.845044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:34.846631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:34.846631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:34.846631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:34.846631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:34.846631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:34.846631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:34.846631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:34.846631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:34.846631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:34.846631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:34.846631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:34.846631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:34.850644 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 198/393] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:55:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:34.852384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5739b-cda8-4951-b736-b8c268b0bfc6 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:34.946099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330838e-5873-467e-a565-3c992da09c39 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:34.985890 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:35.020547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496fd2b-cfd9-42a9-84ee-8cab1990176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:35.023454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496fd2b-cfd9-42a9-84ee-8cab1990176d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:35.024245 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496fd2b-cfd9-42a9-84ee-8cab1990176d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:35.025560 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496fd2b-cfd9-42a9-84ee-8cab1990176d None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:35.029126 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496fd2b-cfd9-42a9-84ee-8cab1990176d None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:35.034758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496fd2b-cfd9-42a9-84ee-8cab1990176d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:35.040238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 196/394] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:34 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:35.047229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496fd2b-cfd9-42a9-84ee-8cab1990176d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:35.064861 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5739b-cda8-4951-b736-b8c268b0bfc6 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:35.097313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:35.126682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91563c3f-2b61-4e2c-9d2c-f95ccb2fccf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:35.128439 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91563c3f-2b61-4e2c-9d2c-f95ccb2fccf7 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:35.129233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91563c3f-2b61-4e2c-9d2c-f95ccb2fccf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:35.129979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91563c3f-2b61-4e2c-9d2c-f95ccb2fccf7 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:35.135410 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91563c3f-2b61-4e2c-9d2c-f95ccb2fccf7 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:35.138147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91563c3f-2b61-4e2c-9d2c-f95ccb2fccf7 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:35.142577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 199/395] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:34 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:35.149240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91563c3f-2b61-4e2c-9d2c-f95ccb2fccf7 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:35.259904 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496fd2b-cfd9-42a9-84ee-8cab1990176d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:35.333399 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7f62b-f8a3-4570-a3b9-23f96629d920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:35.334462 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7f62b-f8a3-4570-a3b9-23f96629d920 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:35.334978 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7f62b-f8a3-4570-a3b9-23f96629d920 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:35.335475 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7f62b-f8a3-4570-a3b9-23f96629d920 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:35.337074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7f62b-f8a3-4570-a3b9-23f96629d920 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:35.337669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7f62b-f8a3-4570-a3b9-23f96629d920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:35.340304 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7f62b-f8a3-4570-a3b9-23f96629d920 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:35.358216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 197/396] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:55:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:35.359847 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7f62b-f8a3-4570-a3b9-23f96629d920 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:35.381490 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91563c3f-2b61-4e2c-9d2c-f95ccb2fccf7 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:35.461373 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999f50c-3946-487e-98ac-017c03e54e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:35.463282 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f50c-3946-487e-98ac-017c03e54e53 None admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:35.464245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f50c-3946-487e-98ac-017c03e54e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:35.465171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f50c-3946-487e-98ac-017c03e54e53 None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8/groups/1fb99f71fcc84a98b705dc924e7a5e57/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:35.467059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:35.471562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999f50c-3946-487e-98ac-017c03e54e53 None admin] RBAC: Authorizing `identity:create_grant(project_id=03c5e81f100d42b1bcc655353fbecbc8, group_id=1fb99f71fcc84a98b705dc924e7a5e57, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:35.475095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999f50c-3946-487e-98ac-017c03e54e53 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:35.581867 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7f62b-f8a3-4570-a3b9-23f96629d920 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:35.614108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 200/397] 10.222.0.98 () {58 vars in 1442 bytes} [Tue Jul 26 14:55:35 2022] PUT /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8/groups/1fb99f71fcc84a98b705dc924e7a5e57/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:55:35.615957 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999f50c-3946-487e-98ac-017c03e54e53 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:35.667450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc28924-bec1-4fcc-81ef-ce27893c6e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:35.668393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc28924-bec1-4fcc-81ef-ce27893c6e67 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:35.668815 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc28924-bec1-4fcc-81ef-ce27893c6e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:35.669120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc28924-bec1-4fcc-81ef-ce27893c6e67 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654/groups/1fb99f71fcc84a98b705dc924e7a5e57/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:35.672651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc28924-bec1-4fcc-81ef-ce27893c6e67 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8b578718bf04a31bc5b638315420654, group_id=1fb99f71fcc84a98b705dc924e7a5e57, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:35.676842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc28924-bec1-4fcc-81ef-ce27893c6e67 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:35.697260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:35.762723 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999f50c-3946-487e-98ac-017c03e54e53 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:35.805344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd065c1-f3f6-4b72-bb58-dc30cce312ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:35.806351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd065c1-f3f6-4b72-bb58-dc30cce312ee None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:35.806829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd065c1-f3f6-4b72-bb58-dc30cce312ee None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:35.807245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd065c1-f3f6-4b72-bb58-dc30cce312ee None admin] PATH_INFO: `/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:35.809382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd065c1-f3f6-4b72-bb58-dc30cce312ee None admin] RBAC: Authorizing `identity:get_group(group_id=1fb99f71fcc84a98b705dc924e7a5e57)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:35.811185 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd065c1-f3f6-4b72-bb58-dc30cce312ee None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:35.814895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 198/398] 10.222.0.98 () {58 vars in 1442 bytes} [Tue Jul 26 14:55:35 2022] PUT /identity/v3/projects/d8b578718bf04a31bc5b638315420654/groups/1fb99f71fcc84a98b705dc924e7a5e57/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:55:35.814895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ac59-b883-49e6-8511-69c45d23ee9e None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:35.814895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ac59-b883-49e6-8511-69c45d23ee9e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:35.814895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ac59-b883-49e6-8511-69c45d23ee9e None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:35.815465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 199/399] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:35.822769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47766d1-4350-496c-8e46-88b404ab7892 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:35.822769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47766d1-4350-496c-8e46-88b404ab7892 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:35.822769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47766d1-4350-496c-8e46-88b404ab7892 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:35.822769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 200/400] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:35.823365 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 201/401] 10.222.0.98 () {56 vars in 1180 bytes} [Tue Jul 26 14:55:35 2022] GET /identity/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:35.824893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea884096-6b4c-4713-809e-b0b55cf4451b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:35.825213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea884096-6b4c-4713-809e-b0b55cf4451b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:35.825589 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea884096-6b4c-4713-809e-b0b55cf4451b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:35.829216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59174b93-9b5e-4445-a607-3fd7399a37ea None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:35.830136 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59174b93-9b5e-4445-a607-3fd7399a37ea None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:35.830881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59174b93-9b5e-4445-a607-3fd7399a37ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:35.855042 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ea884096-6b4c-4713-809e-b0b55cf4451b None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:35.855042 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ea884096-6b4c-4713-809e-b0b55cf4451b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:35.869181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-59174b93-9b5e-4445-a607-3fd7399a37ea None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:35.871815 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-59174b93-9b5e-4445-a607-3fd7399a37ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:36.005259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 201/402] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:36.010605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea884096-6b4c-4713-809e-b0b55cf4451b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:36.015004 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 202/403] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:36.047991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59174b93-9b5e-4445-a607-3fd7399a37ea None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:36.100720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:36.151707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:36.210095 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea884096-6b4c-4713-809e-b0b55cf4451b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:36.272778 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59174b93-9b5e-4445-a607-3fd7399a37ea None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:36.280836 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76eb792-bb1b-4016-bd0a-d457c3b97593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:36.282414 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76eb792-bb1b-4016-bd0a-d457c3b97593 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:36.283067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76eb792-bb1b-4016-bd0a-d457c3b97593 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:36.283820 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76eb792-bb1b-4016-bd0a-d457c3b97593 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:36.286323 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76eb792-bb1b-4016-bd0a-d457c3b97593 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:36.289480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76eb792-bb1b-4016-bd0a-d457c3b97593 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:36.293559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 202/404] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:36 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:36.295472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76eb792-bb1b-4016-bd0a-d457c3b97593 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:36.336034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e393b0-021d-4833-a65e-a4252d674da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:36.336889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e393b0-021d-4833-a65e-a4252d674da2 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:36.337179 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e393b0-021d-4833-a65e-a4252d674da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:36.337447 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e393b0-021d-4833-a65e-a4252d674da2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:36.352460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e393b0-021d-4833-a65e-a4252d674da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-e9e393b0-021d-4833-a65e-a4252d674da2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:36.359065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:36.361945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:36.364266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:36.364266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:36.364266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:36.364266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:36.364266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:36.364266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:36.364266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:36.364266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:36.364266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:36.364266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:36.364266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:36.364266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:36.368496 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 203/405] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:55:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:55:36.369873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e393b0-021d-4833-a65e-a4252d674da2 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:36.551608 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76eb792-bb1b-4016-bd0a-d457c3b97593 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:36.554489 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e393b0-021d-4833-a65e-a4252d674da2 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:36.567685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:36.577740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:36.617008 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc45ed-e303-4d48-86ba-ad296f21771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:36.617830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc45ed-e303-4d48-86ba-ad296f21771f None admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:36.618179 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc45ed-e303-4d48-86ba-ad296f21771f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:36.618572 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc45ed-e303-4d48-86ba-ad296f21771f None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654/groups/1fb99f71fcc84a98b705dc924e7a5e57/roles/3b3abbcf8ee04f0387cfdede5812d226` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:36.623611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc45ed-e303-4d48-86ba-ad296f21771f None admin] RBAC: Authorizing `identity:create_grant(project_id=d8b578718bf04a31bc5b638315420654, group_id=1fb99f71fcc84a98b705dc924e7a5e57, role_id=3b3abbcf8ee04f0387cfdede5812d226)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:36.632798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc45ed-e303-4d48-86ba-ad296f21771f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:36.650232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba16356-4c56-4400-904d-530c9b637232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:36.651075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba16356-4c56-4400-904d-530c9b637232 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:36.651221 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba16356-4c56-4400-904d-530c9b637232 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:36.651603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba16356-4c56-4400-904d-530c9b637232 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:36.665232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba16356-4c56-4400-904d-530c9b637232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-7ba16356-4c56-4400-904d-530c9b637232 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:36.671335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:36.675242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:36.676977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:36.676977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:36.676977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:36.676977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:36.676977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:36.676977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:36.676977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:36.676977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:36.676977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:36.676977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:36.676977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:55:36.676977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:36.679664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 203/406] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:55:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:36.679664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba16356-4c56-4400-904d-530c9b637232 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:36.787676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 204/407] 10.222.0.98 () {58 vars in 1442 bytes} [Tue Jul 26 14:55:36 2022] PUT /identity/v3/projects/d8b578718bf04a31bc5b638315420654/groups/1fb99f71fcc84a98b705dc924e7a5e57/roles/3b3abbcf8ee04f0387cfdede5812d226 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:55:36.787676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc45ed-e303-4d48-86ba-ad296f21771f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:36.879682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba16356-4c56-4400-904d-530c9b637232 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:36.992038 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92a11e-7190-46c5-a66a-deb9397d38eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:36.992896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92a11e-7190-46c5-a66a-deb9397d38eb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:36.993276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92a11e-7190-46c5-a66a-deb9397d38eb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:36.993650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92a11e-7190-46c5-a66a-deb9397d38eb None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:36.994693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92a11e-7190-46c5-a66a-deb9397d38eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:36.995159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92a11e-7190-46c5-a66a-deb9397d38eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:36.996704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92a11e-7190-46c5-a66a-deb9397d38eb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:37.025515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 204/408] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:55:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:37.048202 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92a11e-7190-46c5-a66a-deb9397d38eb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:37.062190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc45ed-e303-4d48-86ba-ad296f21771f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:37.135660 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:37.157645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201afd8b-643d-4511-b1c7-f4c330520d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:37.159575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201afd8b-643d-4511-b1c7-f4c330520d3f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:37.160524 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201afd8b-643d-4511-b1c7-f4c330520d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:37.161212 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201afd8b-643d-4511-b1c7-f4c330520d3f None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:37.162912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201afd8b-643d-4511-b1c7-f4c330520d3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:37.164103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201afd8b-643d-4511-b1c7-f4c330520d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:37.168152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201afd8b-643d-4511-b1c7-f4c330520d3f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:37.188556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 205/409] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:37.198458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201afd8b-643d-4511-b1c7-f4c330520d3f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:37.281172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:37.301588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92a11e-7190-46c5-a66a-deb9397d38eb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:37.378029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41379a80-c0e2-4494-abdd-fc946d8475e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:37.379218 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41379a80-c0e2-4494-abdd-fc946d8475e0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:37.379937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41379a80-c0e2-4494-abdd-fc946d8475e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:37.380396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41379a80-c0e2-4494-abdd-fc946d8475e0 None admin] PATH_INFO: `/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:37.383235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41379a80-c0e2-4494-abdd-fc946d8475e0 None admin] RBAC: Authorizing `identity:get_group(group_id=1fb99f71fcc84a98b705dc924e7a5e57)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:37.386467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41379a80-c0e2-4494-abdd-fc946d8475e0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:37.391226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 205/410] 10.222.0.98 () {56 vars in 1180 bytes} [Tue Jul 26 14:55:37 2022] GET /identity/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57 => generated 226 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:37.401300 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41379a80-c0e2-4494-abdd-fc946d8475e0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:37.576552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201afd8b-643d-4511-b1c7-f4c330520d3f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:37.641722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:37.650717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41379a80-c0e2-4494-abdd-fc946d8475e0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:37.702420 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4a8c1-092d-4c56-ae1e-b02df15c84b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:37.703109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4a8c1-092d-4c56-ae1e-b02df15c84b3 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:37.703687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4a8c1-092d-4c56-ae1e-b02df15c84b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:37.703971 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4a8c1-092d-4c56-ae1e-b02df15c84b3 None admin] PATH_INFO: `/v3/groups/499b1619daa3411281927edb83934c25` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:37.711328 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4a8c1-092d-4c56-ae1e-b02df15c84b3 None admin] RBAC: Authorizing `identity:get_group(group_id=499b1619daa3411281927edb83934c25)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:37.712852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4a8c1-092d-4c56-ae1e-b02df15c84b3 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:37.715084 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 206/411] 10.222.0.98 () {56 vars in 1180 bytes} [Tue Jul 26 14:55:37 2022] GET /identity/v3/groups/499b1619daa3411281927edb83934c25 => generated 229 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:37.721093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4a8c1-092d-4c56-ae1e-b02df15c84b3 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:37.732707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddeba8-e019-49b9-970d-5fcee883eee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:37.733837 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddeba8-e019-49b9-970d-5fcee883eee4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:37.734339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddeba8-e019-49b9-970d-5fcee883eee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:37.735399 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddeba8-e019-49b9-970d-5fcee883eee4 None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:37.739536 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddeba8-e019-49b9-970d-5fcee883eee4 None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:37.742329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddeba8-e019-49b9-970d-5fcee883eee4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:37.745854 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 206/412] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:37 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:37.758516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddeba8-e019-49b9-970d-5fcee883eee4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:38.000281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddeba8-e019-49b9-970d-5fcee883eee4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:38.026778 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:38.060656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4a8c1-092d-4c56-ae1e-b02df15c84b3 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:38.081326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c929d-cc7e-492a-a391-07df8324eca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:38.082621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c929d-cc7e-492a-a391-07df8324eca4 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:38.083081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c929d-cc7e-492a-a391-07df8324eca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:38.083933 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c929d-cc7e-492a-a391-07df8324eca4 None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8/groups/1fb99f71fcc84a98b705dc924e7a5e57/roles/3b3abbcf8ee04f0387cfdede5812d226` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:38.088634 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c929d-cc7e-492a-a391-07df8324eca4 None admin] RBAC: Authorizing `identity:create_grant(project_id=03c5e81f100d42b1bcc655353fbecbc8, group_id=1fb99f71fcc84a98b705dc924e7a5e57, role_id=3b3abbcf8ee04f0387cfdede5812d226)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:38.092664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c929d-cc7e-492a-a391-07df8324eca4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:38.129699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f89a95-4260-4fae-83e6-e242148abfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:38.130433 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f89a95-4260-4fae-83e6-e242148abfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:38.130691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f89a95-4260-4fae-83e6-e242148abfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:38.130966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f89a95-4260-4fae-83e6-e242148abfd7 None admin] PATH_INFO: `/v3/projects/eae5d7650fd54c5a8c95f42eefe32a57` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:38.132231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f89a95-4260-4fae-83e6-e242148abfd7 None admin] RBAC: Authorizing `identity:get_project(project_id=eae5d7650fd54c5a8c95f42eefe32a57)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:38.133759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f89a95-4260-4fae-83e6-e242148abfd7 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:38.136845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 207/413] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:37 2022] GET /identity/v3/projects/eae5d7650fd54c5a8c95f42eefe32a57 => generated 344 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:38.136845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dea65-e531-4883-966e-318abad0d982 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:38.137179 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dea65-e531-4883-966e-318abad0d982 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:38.138405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dea65-e531-4883-966e-318abad0d982 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:38.141460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 208/414] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:38.143451 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dea65-e531-4883-966e-318abad0d982 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:38.178569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 207/415] 10.222.0.98 () {58 vars in 1442 bytes} [Tue Jul 26 14:55:37 2022] PUT /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8/groups/1fb99f71fcc84a98b705dc924e7a5e57/roles/3b3abbcf8ee04f0387cfdede5812d226 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:55:38.180678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11db1d-9f6e-45c0-b4ff-099c5788f232 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:38.181296 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11db1d-9f6e-45c0-b4ff-099c5788f232 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:38.181774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11db1d-9f6e-45c0-b4ff-099c5788f232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:38.207338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cf11db1d-9f6e-45c0-b4ff-099c5788f232 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:38.209379 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cf11db1d-9f6e-45c0-b4ff-099c5788f232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:38.255019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:38.287220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dea65-e531-4883-966e-318abad0d982 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:38.316855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 208/416] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:38.339778 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11db1d-9f6e-45c0-b4ff-099c5788f232 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:38.365604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64618316-28fc-4c74-82ae-7ef2d5f6c301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:38.366345 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64618316-28fc-4c74-82ae-7ef2d5f6c301 None admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:38.366658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64618316-28fc-4c74-82ae-7ef2d5f6c301 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:38.366938 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64618316-28fc-4c74-82ae-7ef2d5f6c301 None admin] PATH_INFO: `/v3/projects/eae5d7650fd54c5a8c95f42eefe32a57/groups/499b1619daa3411281927edb83934c25/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:38.372045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64618316-28fc-4c74-82ae-7ef2d5f6c301 None admin] RBAC: Authorizing `identity:create_grant(project_id=eae5d7650fd54c5a8c95f42eefe32a57, group_id=499b1619daa3411281927edb83934c25, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:38.373660 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64618316-28fc-4c74-82ae-7ef2d5f6c301 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:38.466410 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 209/417] 10.222.0.98 () {58 vars in 1442 bytes} [Tue Jul 26 14:55:38 2022] PUT /identity/v3/projects/eae5d7650fd54c5a8c95f42eefe32a57/groups/499b1619daa3411281927edb83934c25/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:55:38.503373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11db1d-9f6e-45c0-b4ff-099c5788f232 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:38.562589 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacdbe9-868c-471a-b354-5d54c6ba81c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:38.563232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacdbe9-868c-471a-b354-5d54c6ba81c9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:38.563514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacdbe9-868c-471a-b354-5d54c6ba81c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:38.563988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacdbe9-868c-471a-b354-5d54c6ba81c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:38.580140 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacdbe9-868c-471a-b354-5d54c6ba81c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-cbacdbe9-868c-471a-b354-5d54c6ba81c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:38.586493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:38.588074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:38.589112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:38.589112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:38.589112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:38.589112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:38.589112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:38.589112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:38.589112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:38.589112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:38.589112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:38.589112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:38.589112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:38.589112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:38.589112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 209/418] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:55:38.598353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64618316-28fc-4c74-82ae-7ef2d5f6c301 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:38.638790 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:38.760627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64618316-28fc-4c74-82ae-7ef2d5f6c301 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:38.814107 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0e3f1-3fdf-484b-96e5-db7a0d4a0416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:38.814995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0e3f1-3fdf-484b-96e5-db7a0d4a0416 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:38.815449 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0e3f1-3fdf-484b-96e5-db7a0d4a0416 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:38.815929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0e3f1-3fdf-484b-96e5-db7a0d4a0416 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:38.817304 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0e3f1-3fdf-484b-96e5-db7a0d4a0416 None admin] RBAC: Adding query filter params (name=member) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:38.817849 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0e3f1-3fdf-484b-96e5-db7a0d4a0416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:38.820653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0e3f1-3fdf-484b-96e5-db7a0d4a0416 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:38.845805 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 210/419] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:38.851957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacdbe9-868c-471a-b354-5d54c6ba81c9 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:38.883522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:39.021171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacdbe9-868c-471a-b354-5d54c6ba81c9 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:39.080537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcef5e-ae9d-4d95-a678-a45dd8a54979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:39.081436 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcef5e-ae9d-4d95-a678-a45dd8a54979 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:39.081858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcef5e-ae9d-4d95-a678-a45dd8a54979 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:39.082271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcef5e-ae9d-4d95-a678-a45dd8a54979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:39.198697 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcef5e-ae9d-4d95-a678-a45dd8a54979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:39.200336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcef5e-ae9d-4d95-a678-a45dd8a54979 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:39.228433 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:39.361603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 210/420] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:55:39.368072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0e3f1-3fdf-484b-96e5-db7a0d4a0416 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:39.456640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844a2b0-471a-4194-bac5-1bbc91236faf None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:39.456993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844a2b0-471a-4194-bac5-1bbc91236faf None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:39.457257 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844a2b0-471a-4194-bac5-1bbc91236faf None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:39.458796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 211/421] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:55:39.468053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14461b01-240b-4327-a27c-d9dd0c5aef4b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:39.468405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14461b01-240b-4327-a27c-d9dd0c5aef4b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:39.468775 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14461b01-240b-4327-a27c-d9dd0c5aef4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:39.490340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-14461b01-240b-4327-a27c-d9dd0c5aef4b None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:39.497068 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-14461b01-240b-4327-a27c-d9dd0c5aef4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:39.633152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:39.675194 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0e3f1-3fdf-484b-96e5-db7a0d4a0416 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:39.681700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 212/422] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:39.739980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd9bc3-7ab7-4071-b32d-2c9ca927ce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:39.740674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd9bc3-7ab7-4071-b32d-2c9ca927ce46 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:39.740968 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd9bc3-7ab7-4071-b32d-2c9ca927ce46 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:39.741246 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd9bc3-7ab7-4071-b32d-2c9ca927ce46 None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:39.742619 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd9bc3-7ab7-4071-b32d-2c9ca927ce46 None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:39.744192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd9bc3-7ab7-4071-b32d-2c9ca927ce46 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:39.746449 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 211/423] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:39 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:39.752818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14461b01-240b-4327-a27c-d9dd0c5aef4b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:39.770315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd9bc3-7ab7-4071-b32d-2c9ca927ce46 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:39.902268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:40.037798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd9bc3-7ab7-4071-b32d-2c9ca927ce46 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:40.081471 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14461b01-240b-4327-a27c-d9dd0c5aef4b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:40.111139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed81fba-be22-4516-84fa-69d581998f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:40.112253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed81fba-be22-4516-84fa-69d581998f70 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:40.112730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed81fba-be22-4516-84fa-69d581998f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:40.113203 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed81fba-be22-4516-84fa-69d581998f70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:40.151517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed81fba-be22-4516-84fa-69d581998f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-6ed81fba-be22-4516-84fa-69d581998f70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:40.158430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:40.159388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:40.160190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:40.160190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:40.160190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:40.160190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:40.160190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:40.160190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:40.160190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:40.160190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:40.160190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:40.160190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:40.160190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:55:40.160190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:40.162236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 212/424] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:40.169284 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569604ad-e4fe-4879-aba6-ea2ae488f09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:40.170108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569604ad-e4fe-4879-aba6-ea2ae488f09f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:40.170425 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569604ad-e4fe-4879-aba6-ea2ae488f09f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:40.170711 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569604ad-e4fe-4879-aba6-ea2ae488f09f None admin] PATH_INFO: `/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:40.172606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed81fba-be22-4516-84fa-69d581998f70 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:40.173377 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569604ad-e4fe-4879-aba6-ea2ae488f09f None admin] RBAC: Authorizing `identity:get_group(group_id=1fb99f71fcc84a98b705dc924e7a5e57)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:40.175011 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569604ad-e4fe-4879-aba6-ea2ae488f09f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:40.177195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 213/425] 10.222.0.98 () {56 vars in 1180 bytes} [Tue Jul 26 14:55:39 2022] GET /identity/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57 => generated 226 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:40.183419 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569604ad-e4fe-4879-aba6-ea2ae488f09f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:40.210720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:40.356589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed81fba-be22-4516-84fa-69d581998f70 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:40.401748 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccb35f-9ae7-4bf4-91c1-15d39a8047dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:40.402448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccb35f-9ae7-4bf4-91c1-15d39a8047dd None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:40.402748 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccb35f-9ae7-4bf4-91c1-15d39a8047dd None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:40.403015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccb35f-9ae7-4bf4-91c1-15d39a8047dd None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:40.403851 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccb35f-9ae7-4bf4-91c1-15d39a8047dd None admin] RBAC: Adding query filter params (name=member) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:40.404174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccb35f-9ae7-4bf4-91c1-15d39a8047dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:40.406820 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccb35f-9ae7-4bf4-91c1-15d39a8047dd None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:40.418278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 213/426] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:55:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:40.426097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144f177-ba00-40f6-ad29-f2786292561d None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:40.426449 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144f177-ba00-40f6-ad29-f2786292561d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:40.426703 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144f177-ba00-40f6-ad29-f2786292561d None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:40.427416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569604ad-e4fe-4879-aba6-ea2ae488f09f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:40.428537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 214/427] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:40.429359 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144f177-ba00-40f6-ad29-f2786292561d None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:40.456448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:40.495415 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32928179-11c6-4744-9370-7bcaaf59d274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:40.496483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32928179-11c6-4744-9370-7bcaaf59d274 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:40.496864 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32928179-11c6-4744-9370-7bcaaf59d274 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:40.497343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32928179-11c6-4744-9370-7bcaaf59d274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:40.498869 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32928179-11c6-4744-9370-7bcaaf59d274 None admin] RBAC: Adding query filter params (group.id=1fb99f71fcc84a98b705dc924e7a5e57, role.id=7555aed6a21441208a17dedef685336f, scope.project.id=03c5e81f100d42b1bcc655353fbecbc8) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:40.499403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32928179-11c6-4744-9370-7bcaaf59d274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:40.502730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32928179-11c6-4744-9370-7bcaaf59d274 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:40.514308 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 214/428] 10.222.0.98 () {56 vars in 1376 bytes} [Tue Jul 26 14:55:40 2022] GET /identity/v3/role_assignments?group.id=1fb99f71fcc84a98b705dc924e7a5e57&scope.project.id=03c5e81f100d42b1bcc655353fbecbc8&role.id=7555aed6a21441208a17dedef685336f => generated 611 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:40.518227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607b468-fce3-4925-a5e0-c2030480db7b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:40.518488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607b468-fce3-4925-a5e0-c2030480db7b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:40.518826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607b468-fce3-4925-a5e0-c2030480db7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:40.548764 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:40.553147 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1607b468-fce3-4925-a5e0-c2030480db7b None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:40.555734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1607b468-fce3-4925-a5e0-c2030480db7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:40.586818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144f177-ba00-40f6-ad29-f2786292561d None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:40.637032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab423bf-8447-4496-9ed2-291e27c8f4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:40.638608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab423bf-8447-4496-9ed2-291e27c8f4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:40.639366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab423bf-8447-4496-9ed2-291e27c8f4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:40.641154 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab423bf-8447-4496-9ed2-291e27c8f4a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:40.756649 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 215/429] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:40.792923 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607b468-fce3-4925-a5e0-c2030480db7b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:40.804118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab423bf-8447-4496-9ed2-291e27c8f4a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:40.806019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab423bf-8447-4496-9ed2-291e27c8f4a5 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:40.963496 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:41.003633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 215/430] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:41.012164 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab423bf-8447-4496-9ed2-291e27c8f4a5 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:41.033385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607b468-fce3-4925-a5e0-c2030480db7b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:41.062948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:41.131150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5a3aa-4568-4a35-91d3-f201a59143f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:41.132359 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a3aa-4568-4a35-91d3-f201a59143f9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:41.132916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a3aa-4568-4a35-91d3-f201a59143f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:41.133467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a3aa-4568-4a35-91d3-f201a59143f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:41.168956 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5a3aa-4568-4a35-91d3-f201a59143f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-89c5a3aa-4568-4a35-91d3-f201a59143f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:41.178386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:41.179729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:41.180525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:41.180525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:41.180525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:41.180525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:41.180525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:41.180525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:41.180525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:41.180525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:41.180525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:41.180525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:41.180525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:41.180525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:41.181346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 216/431] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:55:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:41.184346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2492b90-df9f-4906-8bef-74ffd627bc34 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:41.184346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2492b90-df9f-4906-8bef-74ffd627bc34 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:41.184346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2492b90-df9f-4906-8bef-74ffd627bc34 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:41.193528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 217/432] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:41 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:41.194984 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2492b90-df9f-4906-8bef-74ffd627bc34 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:41.228173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab423bf-8447-4496-9ed2-291e27c8f4a5 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:41.289951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2803228-ad7d-4b3d-b9a0-ef24171cd359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:41.291034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2803228-ad7d-4b3d-b9a0-ef24171cd359 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:41.291618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2803228-ad7d-4b3d-b9a0-ef24171cd359 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:41.292138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2803228-ad7d-4b3d-b9a0-ef24171cd359 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:41.293816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2803228-ad7d-4b3d-b9a0-ef24171cd359 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:41.295712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2803228-ad7d-4b3d-b9a0-ef24171cd359 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:41.299290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 216/433] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:41 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:41.301137 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d34770-d78b-4b2a-8330-19d30ea4d62a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:41.301682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d34770-d78b-4b2a-8330-19d30ea4d62a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:41.302167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d34770-d78b-4b2a-8330-19d30ea4d62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:41.323473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-55d34770-d78b-4b2a-8330-19d30ea4d62a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:41.325114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-55d34770-d78b-4b2a-8330-19d30ea4d62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:41.386953 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:41.433807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2492b90-df9f-4906-8bef-74ffd627bc34 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:41.460116 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 217/434] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:41.461146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d34770-d78b-4b2a-8330-19d30ea4d62a None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:41.525840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321283e2-76b0-4380-862b-ee8789178ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:41.527089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321283e2-76b0-4380-862b-ee8789178ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:41.527851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321283e2-76b0-4380-862b-ee8789178ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:41.528408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321283e2-76b0-4380-862b-ee8789178ee0 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:41.529805 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321283e2-76b0-4380-862b-ee8789178ee0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:41.530478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321283e2-76b0-4380-862b-ee8789178ee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:41.534896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321283e2-76b0-4380-862b-ee8789178ee0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:41.553366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 218/435] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:55:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:41.554801 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321283e2-76b0-4380-862b-ee8789178ee0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:41.599939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:41.609801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d34770-d78b-4b2a-8330-19d30ea4d62a None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:41.656882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50287d7-bd92-45ad-80a8-6ddab95ebe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:41.657917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50287d7-bd92-45ad-80a8-6ddab95ebe4f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:41.658094 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50287d7-bd92-45ad-80a8-6ddab95ebe4f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:41.658583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50287d7-bd92-45ad-80a8-6ddab95ebe4f None admin] PATH_INFO: `/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:41.660067 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50287d7-bd92-45ad-80a8-6ddab95ebe4f None admin] RBAC: Authorizing `identity:get_group(group_id=1fb99f71fcc84a98b705dc924e7a5e57)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:41.661550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50287d7-bd92-45ad-80a8-6ddab95ebe4f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:41.663535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 218/436] 10.222.0.98 () {56 vars in 1180 bytes} [Tue Jul 26 14:55:41 2022] GET /identity/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:41.664541 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50287d7-bd92-45ad-80a8-6ddab95ebe4f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:41.703937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321283e2-76b0-4380-862b-ee8789178ee0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:41.746858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:41.751159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25065477-8c5a-4261-85be-fc2cd0c422e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:41.752339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25065477-8c5a-4261-85be-fc2cd0c422e7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:41.752846 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25065477-8c5a-4261-85be-fc2cd0c422e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:41.753357 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25065477-8c5a-4261-85be-fc2cd0c422e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:41.774547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25065477-8c5a-4261-85be-fc2cd0c422e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-25065477-8c5a-4261-85be-fc2cd0c422e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:41.784844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:41.787044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:41.788630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:41.788630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:41.788630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:41.788630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:41.788630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:41.788630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:41.788630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:41.788630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:41.788630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:41.788630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:41.788630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:41.788630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:41.788630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 219/437] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:55:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:41.791312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25065477-8c5a-4261-85be-fc2cd0c422e7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:41.837772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50287d7-bd92-45ad-80a8-6ddab95ebe4f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:41.889606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7543b60-bcb3-4eee-847b-35c157968956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:41.890674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7543b60-bcb3-4eee-847b-35c157968956 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:41.891147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7543b60-bcb3-4eee-847b-35c157968956 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:41.891566 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7543b60-bcb3-4eee-847b-35c157968956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:41.935253 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:41.954966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25065477-8c5a-4261-85be-fc2cd0c422e7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:41.991503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7543b60-bcb3-4eee-847b-35c157968956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:41.995556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7543b60-bcb3-4eee-847b-35c157968956 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:42.026488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d050328-e4cd-4346-88b9-da8140b019d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:42.027491 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d050328-e4cd-4346-88b9-da8140b019d2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:42.027858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d050328-e4cd-4346-88b9-da8140b019d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:42.028262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d050328-e4cd-4346-88b9-da8140b019d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:42.029697 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d050328-e4cd-4346-88b9-da8140b019d2 None admin] RBAC: Adding query filter params (group.id=1fb99f71fcc84a98b705dc924e7a5e57, role.id=7555aed6a21441208a17dedef685336f, scope.project.id=d8b578718bf04a31bc5b638315420654) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:42.030211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d050328-e4cd-4346-88b9-da8140b019d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:42.033539 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d050328-e4cd-4346-88b9-da8140b019d2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:42.043824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 220/438] 10.222.0.98 () {56 vars in 1376 bytes} [Tue Jul 26 14:55:41 2022] GET /identity/v3/role_assignments?group.id=1fb99f71fcc84a98b705dc924e7a5e57&scope.project.id=d8b578718bf04a31bc5b638315420654&role.id=7555aed6a21441208a17dedef685336f => generated 611 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:42.047630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c15614-65db-4e0d-a214-578752d61507 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:42.047630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c15614-65db-4e0d-a214-578752d61507 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:42.048395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c15614-65db-4e0d-a214-578752d61507 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:42.051394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 221/439] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:42.053759 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c15614-65db-4e0d-a214-578752d61507 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:42.091126 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:42.229026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 219/440] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:42.232147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c0227-bc9e-4055-8889-816411d6cd5e None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:42.232616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c0227-bc9e-4055-8889-816411d6cd5e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:42.233076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c0227-bc9e-4055-8889-816411d6cd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:42.263680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a28c0227-bc9e-4055-8889-816411d6cd5e None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:42.264007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c15614-65db-4e0d-a214-578752d61507 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:42.265266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a28c0227-bc9e-4055-8889-816411d6cd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:42.332136 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e8557-91e5-4f20-974e-037078a53c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:42.332808 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e8557-91e5-4f20-974e-037078a53c1b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:42.333596 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e8557-91e5-4f20-974e-037078a53c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:42.333910 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e8557-91e5-4f20-974e-037078a53c1b None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:42.334937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e8557-91e5-4f20-974e-037078a53c1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:42.335242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e8557-91e5-4f20-974e-037078a53c1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:42.337046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e8557-91e5-4f20-974e-037078a53c1b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:42.352134 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 222/441] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:55:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:42.353453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e8557-91e5-4f20-974e-037078a53c1b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:42.388087 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:42.417408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 220/442] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:42.417408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c0227-bc9e-4055-8889-816411d6cd5e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:42.552995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e8557-91e5-4f20-974e-037078a53c1b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:42.564556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:42.629471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c0227-bc9e-4055-8889-816411d6cd5e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:42.631040 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c4b63-9d3c-4ec7-9ced-925d1ea689c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:42.632845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c4b63-9d3c-4ec7-9ced-925d1ea689c4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:42.633337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c4b63-9d3c-4ec7-9ced-925d1ea689c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:42.633835 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c4b63-9d3c-4ec7-9ced-925d1ea689c4 None admin] PATH_INFO: `/v3/projects/d8b578718bf04a31bc5b638315420654` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:42.636771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c4b63-9d3c-4ec7-9ced-925d1ea689c4 None admin] RBAC: Authorizing `identity:get_project(project_id=d8b578718bf04a31bc5b638315420654)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:42.639755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c4b63-9d3c-4ec7-9ced-925d1ea689c4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:42.642936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 223/443] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:42 2022] GET /identity/v3/projects/d8b578718bf04a31bc5b638315420654 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:42.644426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c4b63-9d3c-4ec7-9ced-925d1ea689c4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:42.676630 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce171f1-beb4-4789-8a8c-06fb25dc1b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:42.680502 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce171f1-beb4-4789-8a8c-06fb25dc1b8e None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:42.680502 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce171f1-beb4-4789-8a8c-06fb25dc1b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:42.680502 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce171f1-beb4-4789-8a8c-06fb25dc1b8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:42.799693 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce171f1-beb4-4789-8a8c-06fb25dc1b8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:42.802611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce171f1-beb4-4789-8a8c-06fb25dc1b8e None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:42.806340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:42.837555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c4b63-9d3c-4ec7-9ced-925d1ea689c4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:42.913578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda1988-9a5d-42b3-ae62-34f375585769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:42.915173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda1988-9a5d-42b3-ae62-34f375585769 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:42.915428 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda1988-9a5d-42b3-ae62-34f375585769 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:42.915974 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda1988-9a5d-42b3-ae62-34f375585769 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:42.918292 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:42.938201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda1988-9a5d-42b3-ae62-34f375585769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-3fda1988-9a5d-42b3-ae62-34f375585769 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:42.948899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:42.950005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:42.950949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:42.950949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:42.950949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:42.950949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:42.950949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:42.950949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:42.950949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:42.950949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:42.950949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:42.950949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:42.950949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:55:42.950949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:42.951706 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 224/444] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:55:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:42.953882 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda1988-9a5d-42b3-ae62-34f375585769 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:42.975984 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 221/445] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:42.977265 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce171f1-beb4-4789-8a8c-06fb25dc1b8e None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:43.131361 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda1988-9a5d-42b3-ae62-34f375585769 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:43.142173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce171f1-beb4-4789-8a8c-06fb25dc1b8e None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:43.195166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5ca3c-20bb-498b-94ae-b3c6504755c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:43.196202 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5ca3c-20bb-498b-94ae-b3c6504755c1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:43.196700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5ca3c-20bb-498b-94ae-b3c6504755c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:43.197181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5ca3c-20bb-498b-94ae-b3c6504755c1 None admin] PATH_INFO: `/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:43.199402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5ca3c-20bb-498b-94ae-b3c6504755c1 None admin] RBAC: Authorizing `identity:get_group(group_id=1fb99f71fcc84a98b705dc924e7a5e57)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:43.200250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01784acf-e93a-4c5f-b437-f39d1ecc75ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:43.200990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01784acf-e93a-4c5f-b437-f39d1ecc75ba None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:43.201354 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01784acf-e93a-4c5f-b437-f39d1ecc75ba None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:43.201705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01784acf-e93a-4c5f-b437-f39d1ecc75ba None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:43.202238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5ca3c-20bb-498b-94ae-b3c6504755c1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:43.202873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01784acf-e93a-4c5f-b437-f39d1ecc75ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:43.203594 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01784acf-e93a-4c5f-b437-f39d1ecc75ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:43.205150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01784acf-e93a-4c5f-b437-f39d1ecc75ba None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:43.214351 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 225/446] 10.222.0.98 () {56 vars in 1180 bytes} [Tue Jul 26 14:55:42 2022] GET /identity/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:43.214351 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5ca3c-20bb-498b-94ae-b3c6504755c1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:43.229538 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 222/447] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:43.230920 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01784acf-e93a-4c5f-b437-f39d1ecc75ba None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:43.242497 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:43.290315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:43.374014 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5ca3c-20bb-498b-94ae-b3c6504755c1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:43.379036 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01784acf-e93a-4c5f-b437-f39d1ecc75ba None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:43.435477 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f52e2-fe35-428d-9858-51cb08e653ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:43.436136 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f52e2-fe35-428d-9858-51cb08e653ec None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:43.436421 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f52e2-fe35-428d-9858-51cb08e653ec None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:43.436693 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f52e2-fe35-428d-9858-51cb08e653ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:43.437560 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59638266-b7c2-40b9-ab2d-0ab2dc820348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:43.438340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f52e2-fe35-428d-9858-51cb08e653ec None admin] RBAC: Adding query filter params (group.id=1fb99f71fcc84a98b705dc924e7a5e57, role.id=3b3abbcf8ee04f0387cfdede5812d226, scope.project.id=d8b578718bf04a31bc5b638315420654) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:43.438684 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638266-b7c2-40b9-ab2d-0ab2dc820348 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:43.438834 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f52e2-fe35-428d-9858-51cb08e653ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:43.439007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638266-b7c2-40b9-ab2d-0ab2dc820348 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:43.439339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638266-b7c2-40b9-ab2d-0ab2dc820348 None admin] PATH_INFO: `/v3/projects/03c5e81f100d42b1bcc655353fbecbc8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:43.440238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f52e2-fe35-428d-9858-51cb08e653ec None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:43.441311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59638266-b7c2-40b9-ab2d-0ab2dc820348 None admin] RBAC: Authorizing `identity:get_project(project_id=03c5e81f100d42b1bcc655353fbecbc8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:43.443120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59638266-b7c2-40b9-ab2d-0ab2dc820348 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:43.445840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 226/448] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:43 2022] GET /identity/v3/projects/03c5e81f100d42b1bcc655353fbecbc8 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:43.446849 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59638266-b7c2-40b9-ab2d-0ab2dc820348 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:43.447558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 223/449] 10.222.0.98 () {56 vars in 1376 bytes} [Tue Jul 26 14:55:43 2022] GET /identity/v3/role_assignments?group.id=1fb99f71fcc84a98b705dc924e7a5e57&scope.project.id=d8b578718bf04a31bc5b638315420654&role.id=3b3abbcf8ee04f0387cfdede5812d226 => generated 611 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:43.455392 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f52e2-fe35-428d-9858-51cb08e653ec None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:43.622853 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:43.625132 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:43.631487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f52e2-fe35-428d-9858-51cb08e653ec None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:43.662902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59638266-b7c2-40b9-ab2d-0ab2dc820348 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:43.690695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34815b91-20f3-448c-b44a-123e42b9d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:43.691741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34815b91-20f3-448c-b44a-123e42b9d88b None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:43.692205 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34815b91-20f3-448c-b44a-123e42b9d88b None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:43.692626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34815b91-20f3-448c-b44a-123e42b9d88b None admin] PATH_INFO: `/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:43.694617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34815b91-20f3-448c-b44a-123e42b9d88b None admin] RBAC: Authorizing `identity:get_group(group_id=1fb99f71fcc84a98b705dc924e7a5e57)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:43.697185 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34815b91-20f3-448c-b44a-123e42b9d88b None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:43.700520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 224/450] 10.222.0.98 () {56 vars in 1180 bytes} [Tue Jul 26 14:55:43 2022] GET /identity/v3/groups/1fb99f71fcc84a98b705dc924e7a5e57 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:43.706613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34815b91-20f3-448c-b44a-123e42b9d88b None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:43.731023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a5ecb-6252-4760-b06d-62c3bebb847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:43.731750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a5ecb-6252-4760-b06d-62c3bebb847a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:43.732101 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a5ecb-6252-4760-b06d-62c3bebb847a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:43.732378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a5ecb-6252-4760-b06d-62c3bebb847a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:43.856285 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a5ecb-6252-4760-b06d-62c3bebb847a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:43.859298 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a5ecb-6252-4760-b06d-62c3bebb847a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:43.920327 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34815b91-20f3-448c-b44a-123e42b9d88b None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:43.984989 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409d520-9517-4303-8a7f-4a42149540f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:43.985931 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409d520-9517-4303-8a7f-4a42149540f7 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:43.989755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409d520-9517-4303-8a7f-4a42149540f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:43.989755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409d520-9517-4303-8a7f-4a42149540f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:43.989755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409d520-9517-4303-8a7f-4a42149540f7 None admin] RBAC: Adding query filter params (group.id=1fb99f71fcc84a98b705dc924e7a5e57, role.id=3b3abbcf8ee04f0387cfdede5812d226, scope.project.id=03c5e81f100d42b1bcc655353fbecbc8) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:43.989755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409d520-9517-4303-8a7f-4a42149540f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:43.994424 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409d520-9517-4303-8a7f-4a42149540f7 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:43.999614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 225/451] 10.222.0.98 () {56 vars in 1376 bytes} [Tue Jul 26 14:55:43 2022] GET /identity/v3/role_assignments?group.id=1fb99f71fcc84a98b705dc924e7a5e57&scope.project.id=03c5e81f100d42b1bcc655353fbecbc8&role.id=3b3abbcf8ee04f0387cfdede5812d226 => generated 611 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:44.016991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:44.053426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 227/452] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:44.063527 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409d520-9517-4303-8a7f-4a42149540f7 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:44.133949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:44.286517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409d520-9517-4303-8a7f-4a42149540f7 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:44.358409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d419c6c-3237-4566-93d3-e4d68d9e0203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:44.360806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d419c6c-3237-4566-93d3-e4d68d9e0203 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:44.361325 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d419c6c-3237-4566-93d3-e4d68d9e0203 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:44.361821 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d419c6c-3237-4566-93d3-e4d68d9e0203 None admin] PATH_INFO: `/v3/projects/eae5d7650fd54c5a8c95f42eefe32a57` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:44.364757 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d419c6c-3237-4566-93d3-e4d68d9e0203 None admin] RBAC: Authorizing `identity:get_project(project_id=eae5d7650fd54c5a8c95f42eefe32a57)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:44.367827 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d419c6c-3237-4566-93d3-e4d68d9e0203 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:44.371411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 226/453] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:55:44 2022] GET /identity/v3/projects/eae5d7650fd54c5a8c95f42eefe32a57 => generated 344 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:44.379640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a5ecb-6252-4760-b06d-62c3bebb847a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:44.574231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a5ecb-6252-4760-b06d-62c3bebb847a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:44.619973 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caab22-11f4-4c92-a484-f923839aa1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:44.620711 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caab22-11f4-4c92-a484-f923839aa1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:44.621068 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caab22-11f4-4c92-a484-f923839aa1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:44.621418 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caab22-11f4-4c92-a484-f923839aa1b7 None admin] PATH_INFO: `/v3/groups/499b1619daa3411281927edb83934c25` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:44.623048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caab22-11f4-4c92-a484-f923839aa1b7 None admin] RBAC: Authorizing `identity:get_group(group_id=499b1619daa3411281927edb83934c25)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:44.625252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caab22-11f4-4c92-a484-f923839aa1b7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:44.627370 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 228/454] 10.222.0.98 () {56 vars in 1180 bytes} [Tue Jul 26 14:55:44 2022] GET /identity/v3/groups/499b1619daa3411281927edb83934c25 => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:44.634265 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d419c6c-3237-4566-93d3-e4d68d9e0203 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:44.813439 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:44.820686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d419c6c-3237-4566-93d3-e4d68d9e0203 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:44.890399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e789fc-19e1-47b2-92f8-1748eb960572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:44.891266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e789fc-19e1-47b2-92f8-1748eb960572 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:44.891713 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e789fc-19e1-47b2-92f8-1748eb960572 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:44.892096 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e789fc-19e1-47b2-92f8-1748eb960572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:44.893059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e789fc-19e1-47b2-92f8-1748eb960572 None admin] RBAC: Adding query filter params (group.id=499b1619daa3411281927edb83934c25, role.id=17054492864541709fda49dbf677a7a2, scope.project.id=eae5d7650fd54c5a8c95f42eefe32a57) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:44.893490 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e789fc-19e1-47b2-92f8-1748eb960572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:44.895366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e789fc-19e1-47b2-92f8-1748eb960572 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:44.903085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 227/455] 10.222.0.98 () {56 vars in 1376 bytes} [Tue Jul 26 14:55:44 2022] GET /identity/v3/role_assignments?group.id=499b1619daa3411281927edb83934c25&scope.project.id=eae5d7650fd54c5a8c95f42eefe32a57&role.id=17054492864541709fda49dbf677a7a2 => generated 611 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:55:48.285241 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107d0fa-b994-49c5-a365-a4c1156276b9 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:48.285807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107d0fa-b994-49c5-a365-a4c1156276b9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:48.286191 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107d0fa-b994-49c5-a365-a4c1156276b9 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:48.289263 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 229/456] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:48.297759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c8060-ddac-4c7b-bb4a-84bb360cded7 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:48.304304 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c8060-ddac-4c7b-bb4a-84bb360cded7 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:48.304304 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c8060-ddac-4c7b-bb4a-84bb360cded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:48.328674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-7f4c8060-ddac-4c7b-bb4a-84bb360cded7 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:48.330717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7f4c8060-ddac-4c7b-bb4a-84bb360cded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:48.450401 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 228/457] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:48.528979 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107d0fa-b994-49c5-a365-a4c1156276b9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:48.652369 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:48.772682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107d0fa-b994-49c5-a365-a4c1156276b9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:48.868649 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28636d81-2089-494b-89ca-2202d4d15084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:48.870042 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28636d81-2089-494b-89ca-2202d4d15084 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:48.870844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28636d81-2089-494b-89ca-2202d4d15084 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:48.871818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28636d81-2089-494b-89ca-2202d4d15084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:48.892350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399cd9c-11d6-4552-8437-e701f6056e7a None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:48.892350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399cd9c-11d6-4552-8437-e701f6056e7a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:48.892767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399cd9c-11d6-4552-8437-e701f6056e7a None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:48.894413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 229/458] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:48.903897 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623df38a-d982-4271-aacb-e4d4cdbe6251 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:48.904265 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623df38a-d982-4271-aacb-e4d4cdbe6251 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:48.904684 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623df38a-d982-4271-aacb-e4d4cdbe6251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:48.904994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28636d81-2089-494b-89ca-2202d4d15084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:48.907905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28636d81-2089-494b-89ca-2202d4d15084 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:48.939049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-28636d81-2089-494b-89ca-2202d4d15084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:48.939049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:48.939049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:48.939049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:48.939049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:48.939049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:48.939049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:48.939049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:48.939049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:48.939049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:48.939049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:48.939049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:48.939049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:55:48.939049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:55:48.939049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:48.940605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:48.942195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:55:48.942195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:55:48.942195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:48.942195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:48.942195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 230/459] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:48.951413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-623df38a-d982-4271-aacb-e4d4cdbe6251 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:48.953330 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-623df38a-d982-4271-aacb-e4d4cdbe6251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:48.956137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28636d81-2089-494b-89ca-2202d4d15084 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:49.091348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 230/460] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:49.139871 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623df38a-d982-4271-aacb-e4d4cdbe6251 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:49.190530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:49.259710 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:49.263574 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28636d81-2089-494b-89ca-2202d4d15084 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:49.336815 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d126c1-6a48-40e8-ab3a-fd00db6f6e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:49.339402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d126c1-6a48-40e8-ab3a-fd00db6f6e2e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:49.340159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d126c1-6a48-40e8-ab3a-fd00db6f6e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:49.341046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d126c1-6a48-40e8-ab3a-fd00db6f6e2e None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:49.343306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d126c1-6a48-40e8-ab3a-fd00db6f6e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:49.344208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d126c1-6a48-40e8-ab3a-fd00db6f6e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:49.344745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623df38a-d982-4271-aacb-e4d4cdbe6251 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:49.348174 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d126c1-6a48-40e8-ab3a-fd00db6f6e2e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:49.373496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 231/461] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:49.377500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc9705-5069-4a93-91fe-b76fcc807886 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:49.377500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc9705-5069-4a93-91fe-b76fcc807886 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:49.377500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc9705-5069-4a93-91fe-b76fcc807886 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:49.380214 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 232/462] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:49.381540 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc9705-5069-4a93-91fe-b76fcc807886 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:49.410720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a6b93-89b4-4194-a4df-fa938c479773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:49.411738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a6b93-89b4-4194-a4df-fa938c479773 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:49.412210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a6b93-89b4-4194-a4df-fa938c479773 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:49.412657 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a6b93-89b4-4194-a4df-fa938c479773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:49.431592 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a6b93-89b4-4194-a4df-fa938c479773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:49.434163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a6b93-89b4-4194-a4df-fa938c479773 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:49.463231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-9d5a6b93-89b4-4194-a4df-fa938c479773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:49.463231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:49.463231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:49.463231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:49.463231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:49.463231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:49.463231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:49.463231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:49.463231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:49.463231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:49.463231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:49.463231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:49.463231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:55:49.463231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:55:49.463231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:49.464902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:49.466504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:55:49.466504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:55:49.466504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:49.466504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:49.466504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 231/463] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:55:49.467904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c8348-c336-41de-aaa3-23740a5c60d3 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:49.472781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c8348-c336-41de-aaa3-23740a5c60d3 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:49.472781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c8348-c336-41de-aaa3-23740a5c60d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:49.499590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-ea2c8348-c336-41de-aaa3-23740a5c60d3 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:49.502142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ea2c8348-c336-41de-aaa3-23740a5c60d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:49.583707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc9705-5069-4a93-91fe-b76fcc807886 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:49.624033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 232/464] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:49.625976 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c8348-c336-41de-aaa3-23740a5c60d3 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:49.631445 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:49.671255 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708d6fa-bb22-4977-ad39-d24367c5023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:49.672840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708d6fa-bb22-4977-ad39-d24367c5023b None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:49.673513 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708d6fa-bb22-4977-ad39-d24367c5023b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:49.673962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708d6fa-bb22-4977-ad39-d24367c5023b None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:49.675196 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708d6fa-bb22-4977-ad39-d24367c5023b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:49.677741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708d6fa-bb22-4977-ad39-d24367c5023b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:49.789599 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c8348-c336-41de-aaa3-23740a5c60d3 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:49.818212 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 233/465] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:55:49 2022] POST /identity/v3/users => generated 248 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:55:49.820316 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708d6fa-bb22-4977-ad39-d24367c5023b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:49.857918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b2faf-70df-4989-b3e6-62dd92071128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:49.859744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b2faf-70df-4989-b3e6-62dd92071128 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:49.860295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b2faf-70df-4989-b3e6-62dd92071128 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:49.860774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b2faf-70df-4989-b3e6-62dd92071128 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:49.862209 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b2faf-70df-4989-b3e6-62dd92071128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:49.862733 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b2faf-70df-4989-b3e6-62dd92071128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:49.865299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b2faf-70df-4989-b3e6-62dd92071128 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:49.866038 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:49.892292 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 233/466] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:49.912336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b2faf-70df-4989-b3e6-62dd92071128 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:50.067449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708d6fa-bb22-4977-ad39-d24367c5023b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:50.117803 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:50.122299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90042a-bc28-4a51-a0bd-6dfbd382169c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:50.123037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90042a-bc28-4a51-a0bd-6dfbd382169c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:50.123486 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90042a-bc28-4a51-a0bd-6dfbd382169c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:50.123744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90042a-bc28-4a51-a0bd-6dfbd382169c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:50.142319 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90042a-bc28-4a51-a0bd-6dfbd382169c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:50.145673 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90042a-bc28-4a51-a0bd-6dfbd382169c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:50.188001 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b2faf-70df-4989-b3e6-62dd92071128 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:50.195067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-eb90042a-bc28-4a51-a0bd-6dfbd382169c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:50.195067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:50.195067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:50.195067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:50.195067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:50.195067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:50.195067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:50.195067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:50.195067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:50.195067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:50.195067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:50.195067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:50.195067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:55:50.195067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:55:50.195067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:50.196830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:50.198582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:55:50.198582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:55:50.198582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:50.198582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:50.200232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 234/467] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:50.209773 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90042a-bc28-4a51-a0bd-6dfbd382169c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:50.276004 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abb18f-0099-463b-896f-3b35e56d8513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:50.277392 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abb18f-0099-463b-896f-3b35e56d8513 None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:50.277842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abb18f-0099-463b-896f-3b35e56d8513 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:50.278306 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abb18f-0099-463b-896f-3b35e56d8513 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:50.279597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abb18f-0099-463b-896f-3b35e56d8513 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:50.282876 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abb18f-0099-463b-896f-3b35e56d8513 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:50.337013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:50.403349 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90042a-bc28-4a51-a0bd-6dfbd382169c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:50.428291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 234/468] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:55:49 2022] POST /identity/v3/users => generated 248 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:55:50.430099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b22b92-b94c-4a50-bf91-d9193a1ae666 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:50.430515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b22b92-b94c-4a50-bf91-d9193a1ae666 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:50.430869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b22b92-b94c-4a50-bf91-d9193a1ae666 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:50.434787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 235/469] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:50.442447 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019fcc1-6fde-4c4c-8b28-81b5c8bf4c48 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:50.443339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019fcc1-6fde-4c4c-8b28-81b5c8bf4c48 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:50.444038 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019fcc1-6fde-4c4c-8b28-81b5c8bf4c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:50.493226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fb870-e7ea-474e-b888-630ca3d8fcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:50.498056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fb870-e7ea-474e-b888-630ca3d8fcad None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:50.498056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fb870-e7ea-474e-b888-630ca3d8fcad None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:50.498056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fb870-e7ea-474e-b888-630ca3d8fcad None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:50.498056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fb870-e7ea-474e-b888-630ca3d8fcad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:50.498056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fb870-e7ea-474e-b888-630ca3d8fcad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:50.500006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fb870-e7ea-474e-b888-630ca3d8fcad None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:50.524399 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 235/470] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:50.529227 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-c019fcc1-6fde-4c4c-8b28-81b5c8bf4c48 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:50.533192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c019fcc1-6fde-4c4c-8b28-81b5c8bf4c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:50.533584 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fb870-e7ea-474e-b888-630ca3d8fcad None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:50.638152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 236/471] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:55:50.640355 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02382b4c-6894-4dd6-848b-3fe4c80a9683 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:50.640682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02382b4c-6894-4dd6-848b-3fe4c80a9683 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:50.640961 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02382b4c-6894-4dd6-848b-3fe4c80a9683 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:50.643031 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 237/472] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:50.654397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d094e1-b9f5-4380-8076-0a48f1fbe6dd None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:50.654928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d094e1-b9f5-4380-8076-0a48f1fbe6dd None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:50.655407 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d094e1-b9f5-4380-8076-0a48f1fbe6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:50.704631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a2d094e1-b9f5-4380-8076-0a48f1fbe6dd None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:50.707254 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a2d094e1-b9f5-4380-8076-0a48f1fbe6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:50.749865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fb870-e7ea-474e-b888-630ca3d8fcad None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:50.792739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:50.803417 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbacce8-7aa8-4532-a723-f211f7f937cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:50.803691 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbacce8-7aa8-4532-a723-f211f7f937cc None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:50.803867 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbacce8-7aa8-4532-a723-f211f7f937cc None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:50.804137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbacce8-7aa8-4532-a723-f211f7f937cc None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:50.804929 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbacce8-7aa8-4532-a723-f211f7f937cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:50.806455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbacce8-7aa8-4532-a723-f211f7f937cc None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:50.813249 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:50.845879 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 238/473] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:50.846895 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d094e1-b9f5-4380-8076-0a48f1fbe6dd None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:50.971521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 236/474] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:55:50 2022] POST /identity/v3/users => generated 246 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:55:50.973325 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbacce8-7aa8-4532-a723-f211f7f937cc None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:51.158751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d094e1-b9f5-4380-8076-0a48f1fbe6dd None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:51.178173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbacce8-7aa8-4532-a723-f211f7f937cc None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:51.231457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad5cc1-a290-4be4-8046-0d7e1d10d649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:51.232086 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5cc1-a290-4be4-8046-0d7e1d10d649 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:51.232409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5cc1-a290-4be4-8046-0d7e1d10d649 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:51.232685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5cc1-a290-4be4-8046-0d7e1d10d649 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:51.234125 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad5cc1-a290-4be4-8046-0d7e1d10d649 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:51.238388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad5cc1-a290-4be4-8046-0d7e1d10d649 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:51.275728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f6417-c4fb-40ea-83f8-1d0016836153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:51.276929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f6417-c4fb-40ea-83f8-1d0016836153 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:51.277423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f6417-c4fb-40ea-83f8-1d0016836153 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:51.278007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f6417-c4fb-40ea-83f8-1d0016836153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:51.282726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.sql.core [None req-d6ad5cc1-a290-4be4-8046-0d7e1d10d649 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 14:55:51.282726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 14:55:51.282726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [parameters: {'id': '3a1699f2321e4e87b76bfd759dc120e1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 14:55:51.282726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80488) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 14:55:51.301025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f6417-c4fb-40ea-83f8-1d0016836153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:51.303827 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f6417-c4fb-40ea-83f8-1d0016836153 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:51.330912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-d6ad5cc1-a290-4be4-8046-0d7e1d10d649 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 14:55:51.330912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:51.330912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:55:51.330912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:55:51.330912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:55:51.330912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:55:51.330912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:55:51.330912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:55:51.330912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:55:51.330912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:55:51.330912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:55:51.330912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:55:51.330912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:55:51.330912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result.read() Jul 26 14:55:51.330912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return ref.to_dict() Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:55:51.331881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application yield resource Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise self.value Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application session.commit() Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 14:55:51.332844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.session.flush() Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application compat.raise_( Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 14:55:51.333727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:55:51.334712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result.read() Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:55:51.335640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [parameters: {'id': '3a1699f2321e4e87b76bfd759dc120e1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:51.336427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 14:55:51.337676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:51.344554 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 237/475] 10.222.0.98 () {60 vars in 1131 bytes} [Tue Jul 26 14:55:50 2022] POST /identity/v3/roles => generated 144 bytes in 366 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:51.344554 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad5cc1-a290-4be4-8046-0d7e1d10d649 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:51.344799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-362f6417-c4fb-40ea-83f8-1d0016836153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:51.344799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:51.344799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:51.344799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:51.344799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:51.344799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:51.344799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:51.344799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:51.344799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:51.344799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:51.344799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:51.344799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:51.344799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:55:51.344799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:55:51.344799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:51.346283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:51.347960 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:55:51.347960 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:55:51.347960 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:51.347960 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:51.350550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 239/476] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 504 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:51.356118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f6417-c4fb-40ea-83f8-1d0016836153 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:51.442807 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:51.471192 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:51.667431 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad5cc1-a290-4be4-8046-0d7e1d10d649 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:51.699605 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f6417-c4fb-40ea-83f8-1d0016836153 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:51.757389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54750e0-9439-4e71-8a47-536a7d7a0643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:51.758395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54750e0-9439-4e71-8a47-536a7d7a0643 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:51.758891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54750e0-9439-4e71-8a47-536a7d7a0643 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:51.759369 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54750e0-9439-4e71-8a47-536a7d7a0643 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:51.783108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54750e0-9439-4e71-8a47-536a7d7a0643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-d54750e0-9439-4e71-8a47-536a7d7a0643 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:51.794780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:51.796751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:51.798301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:51.798301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:51.798301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:51.798301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:51.798301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:51.798301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:51.798301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:51.798301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:51.798301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:51.798301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:51.798301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:55:51.798301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:51.798301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 238/477] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:55:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 455 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:51.807873 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54750e0-9439-4e71-8a47-536a7d7a0643 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:51.835885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1cc93-32cf-4a25-9ea0-8c088684974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:51.836997 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1cc93-32cf-4a25-9ea0-8c088684974b None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:51.837427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1cc93-32cf-4a25-9ea0-8c088684974b None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:51.837863 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1cc93-32cf-4a25-9ea0-8c088684974b None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:51.839169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1cc93-32cf-4a25-9ea0-8c088684974b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:51.839652 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1cc93-32cf-4a25-9ea0-8c088684974b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:51.851330 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1cc93-32cf-4a25-9ea0-8c088684974b None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:51.882294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 240/478] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:51.895166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1cc93-32cf-4a25-9ea0-8c088684974b None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:52.038596 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54750e0-9439-4e71-8a47-536a7d7a0643 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:52.057112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:52.109521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0370c-971c-40cb-9c7b-241aa99e4508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:52.110702 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0370c-971c-40cb-9c7b-241aa99e4508 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:52.111206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0370c-971c-40cb-9c7b-241aa99e4508 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:52.111835 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0370c-971c-40cb-9c7b-241aa99e4508 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:52.113465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0370c-971c-40cb-9c7b-241aa99e4508 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:52.114048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0370c-971c-40cb-9c7b-241aa99e4508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:52.116881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0370c-971c-40cb-9c7b-241aa99e4508 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:52.136990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 239/479] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:55:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:52.237980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:52.264775 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1cc93-32cf-4a25-9ea0-8c088684974b None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:52.352847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cfb51-5fc7-425f-8867-9bdba6b30f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:52.353931 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cfb51-5fc7-425f-8867-9bdba6b30f12 None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:52.354443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cfb51-5fc7-425f-8867-9bdba6b30f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:52.354928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cfb51-5fc7-425f-8867-9bdba6b30f12 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:52.356170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cfb51-5fc7-425f-8867-9bdba6b30f12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:52.363258 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cfb51-5fc7-425f-8867-9bdba6b30f12 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:52.477548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 241/480] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:55:51 2022] POST /identity/v3/users => generated 249 bytes in 583 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:55:53.453015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486f54f-29bb-4a48-b69b-7a8ba7124839 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:53.454016 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486f54f-29bb-4a48-b69b-7a8ba7124839 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:53.454252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486f54f-29bb-4a48-b69b-7a8ba7124839 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:53.457666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 240/481] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:53.464388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637e539-0905-4833-b588-b9f27b596258 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:53.464882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637e539-0905-4833-b588-b9f27b596258 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:53.465368 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637e539-0905-4833-b588-b9f27b596258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:53.510886 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-8637e539-0905-4833-b588-b9f27b596258 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:53.512977 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8637e539-0905-4833-b588-b9f27b596258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:53.701085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 242/482] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:53.769311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486f54f-29bb-4a48-b69b-7a8ba7124839 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:54.016585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486f54f-29bb-4a48-b69b-7a8ba7124839 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:54.114969 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d79f2-898f-4fb7-b17d-01d8b60e3786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:54.116148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d79f2-898f-4fb7-b17d-01d8b60e3786 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:54.116636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d79f2-898f-4fb7-b17d-01d8b60e3786 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:54.117122 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d79f2-898f-4fb7-b17d-01d8b60e3786 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:54.146319 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d79f2-898f-4fb7-b17d-01d8b60e3786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-029d79f2-898f-4fb7-b17d-01d8b60e3786 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:54.163764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:54.167229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:54.170432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:54.170432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:54.170432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:54.170432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:54.170432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:54.170432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:54.170432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:54.170432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:54.170432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:54.170432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:54.170432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:55:54.170432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:54.170432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 241/483] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:55:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:54.178403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637e539-0905-4833-b588-b9f27b596258 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:54.390498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:54.431926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637e539-0905-4833-b588-b9f27b596258 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:54.533610 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ec644-2cbf-43b3-a2be-4a63d3399970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:54.534762 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ec644-2cbf-43b3-a2be-4a63d3399970 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:54.535268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ec644-2cbf-43b3-a2be-4a63d3399970 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:54.535762 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ec644-2cbf-43b3-a2be-4a63d3399970 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:54.537146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ec644-2cbf-43b3-a2be-4a63d3399970 None admin] RBAC: Adding query filter params (name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:54.537737 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ec644-2cbf-43b3-a2be-4a63d3399970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:54.540494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ec644-2cbf-43b3-a2be-4a63d3399970 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:54.557692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 243/484] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:55:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:54.567077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d79f2-898f-4fb7-b17d-01d8b60e3786 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:54.685204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:54.790339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8d0fc-0800-4029-8bb2-92af99d6709f None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:54.791361 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8d0fc-0800-4029-8bb2-92af99d6709f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:54.792234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8d0fc-0800-4029-8bb2-92af99d6709f None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:54.802765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 244/485] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:54 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:54.805510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4360be-1140-41d4-bdf5-b3ed46ebe5d8 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:54.806419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4360be-1140-41d4-bdf5-b3ed46ebe5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:54.807221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4360be-1140-41d4-bdf5-b3ed46ebe5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:54.835463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d79f2-898f-4fb7-b17d-01d8b60e3786 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:54.841643 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-4a4360be-1140-41d4-bdf5-b3ed46ebe5d8 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:54.844395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4a4360be-1140-41d4-bdf5-b3ed46ebe5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:54.951918 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43709f7b-d9d2-402c-838e-02aa6fd4a4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:54.953105 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43709f7b-d9d2-402c-838e-02aa6fd4a4df None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:54.953734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43709f7b-d9d2-402c-838e-02aa6fd4a4df None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:54.954239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43709f7b-d9d2-402c-838e-02aa6fd4a4df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:54.983769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43709f7b-d9d2-402c-838e-02aa6fd4a4df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:54.984173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 245/486] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:55:54.985319 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43709f7b-d9d2-402c-838e-02aa6fd4a4df None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:55.012187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-43709f7b-d9d2-402c-838e-02aa6fd4a4df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:55.012187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:55.012187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:55.012187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:55.012187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:55.012187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:55.012187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:55.012187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:55.012187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:55.012187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:55.012187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:55.012187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:55.012187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:55:55.012187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:55:55.012187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:55.015264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:55.017247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:55:55.017247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:55:55.017247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:55.017247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:55.019868 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 242/487] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 453 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:55.028371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4360be-1140-41d4-bdf5-b3ed46ebe5d8 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:55.082602 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43709f7b-d9d2-402c-838e-02aa6fd4a4df None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:55.270677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:55.296580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4360be-1140-41d4-bdf5-b3ed46ebe5d8 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:55.314773 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:55.359517 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43709f7b-d9d2-402c-838e-02aa6fd4a4df None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:55.372944 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1c674-531e-4cd7-a1fa-794ab74919fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:55.374891 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1c674-531e-4cd7-a1fa-794ab74919fc None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:55.375450 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1c674-531e-4cd7-a1fa-794ab74919fc None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:55.375940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1c674-531e-4cd7-a1fa-794ab74919fc None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:55.377348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1c674-531e-4cd7-a1fa-794ab74919fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:55.377899 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1c674-531e-4cd7-a1fa-794ab74919fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:55.381482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1c674-531e-4cd7-a1fa-794ab74919fc None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:55.409814 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 246/488] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:55.412878 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7b44a-fdf8-4aae-89e4-33e1af947ac7 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:55.413355 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7b44a-fdf8-4aae-89e4-33e1af947ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:55.413942 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7b44a-fdf8-4aae-89e4-33e1af947ac7 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:55.416984 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 247/489] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:55.418562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7b44a-fdf8-4aae-89e4-33e1af947ac7 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:55.454952 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84088292-4682-4261-a789-70910d96e174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:55.456364 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84088292-4682-4261-a789-70910d96e174 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:55.456864 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84088292-4682-4261-a789-70910d96e174 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:55.457373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84088292-4682-4261-a789-70910d96e174 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:55.473841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84088292-4682-4261-a789-70910d96e174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-84088292-4682-4261-a789-70910d96e174 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:55.480727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:55.481699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:55.482647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:55.482647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:55.482647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:55.482647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:55.482647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:55.482647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:55.482647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:55.482647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:55.482647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:55.482647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:55.482647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:55:55.482647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:55.489809 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 243/490] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:55:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:55:55.489809 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ee241-8a06-4791-a620-7fdf38cd04ba None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:55.489809 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ee241-8a06-4791-a620-7fdf38cd04ba None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:55.489809 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ee241-8a06-4791-a620-7fdf38cd04ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:55.522943 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-988ee241-8a06-4791-a620-7fdf38cd04ba None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:55.524661 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-988ee241-8a06-4791-a620-7fdf38cd04ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:55.621533 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7b44a-fdf8-4aae-89e4-33e1af947ac7 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:55.662266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:55.669909 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe21874-1ce7-414b-b8fa-a5756b6bd325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:55.678935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe21874-1ce7-414b-b8fa-a5756b6bd325 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:55.678935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe21874-1ce7-414b-b8fa-a5756b6bd325 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:55.678935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe21874-1ce7-414b-b8fa-a5756b6bd325 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:55.682047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 244/491] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:55.683629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe21874-1ce7-414b-b8fa-a5756b6bd325 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:55.683747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ee241-8a06-4791-a620-7fdf38cd04ba None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:55.685609 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe21874-1ce7-414b-b8fa-a5756b6bd325 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-dbe21874-1ce7-414b-b8fa-a5756b6bd325 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:55:55.705366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:55.706452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:55.707370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:55.707370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:55.707370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:55:55.707370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:55:55.707370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:55:55.707370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:55:55.707370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:55:55.707370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:55:55.707370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:55:55.707370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:55.710283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 248/492] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:55.722580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe21874-1ce7-414b-b8fa-a5756b6bd325 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:55.835668 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:55.875633 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ee241-8a06-4791-a620-7fdf38cd04ba None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:55.926226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d30306-cae4-4c63-b545-6ae54e7d88b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:55.927187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d30306-cae4-4c63-b545-6ae54e7d88b7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:55.927749 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d30306-cae4-4c63-b545-6ae54e7d88b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:55.928093 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d30306-cae4-4c63-b545-6ae54e7d88b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:55.929383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d30306-cae4-4c63-b545-6ae54e7d88b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:55.929872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d30306-cae4-4c63-b545-6ae54e7d88b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:55.932345 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d30306-cae4-4c63-b545-6ae54e7d88b7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:55.944334 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 245/493] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:55:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:55.945297 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d30306-cae4-4c63-b545-6ae54e7d88b7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:56.003087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe21874-1ce7-414b-b8fa-a5756b6bd325 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:56.073594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d30306-cae4-4c63-b545-6ae54e7d88b7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:56.079192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9c5a1-a782-4edd-a046-e45322ab8c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:56.080857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9c5a1-a782-4edd-a046-e45322ab8c53 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:56.081634 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9c5a1-a782-4edd-a046-e45322ab8c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:56.082436 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9c5a1-a782-4edd-a046-e45322ab8c53 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:56.084420 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9c5a1-a782-4edd-a046-e45322ab8c53 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:56.085636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9c5a1-a782-4edd-a046-e45322ab8c53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:56.089114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9c5a1-a782-4edd-a046-e45322ab8c53 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:56.123889 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cb27e-f306-408d-a18b-2a1c9e0fc7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:56.125083 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cb27e-f306-408d-a18b-2a1c9e0fc7ac None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:56.125547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cb27e-f306-408d-a18b-2a1c9e0fc7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:56.125988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cb27e-f306-408d-a18b-2a1c9e0fc7ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:56.128969 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:56.141741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cb27e-f306-408d-a18b-2a1c9e0fc7ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-ea0cb27e-f306-408d-a18b-2a1c9e0fc7ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:56.147180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:56.148895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:56.150430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:56.150430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:56.150430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:56.150430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:56.150430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:56.150430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:56.150430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:56.150430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:56.150430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:56.150430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:56.150430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:55:56.150430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:56.150430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 246/494] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:55:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:56.150430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cb27e-f306-408d-a18b-2a1c9e0fc7ac None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:56.202086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 249/495] 10.222.0.98 () {56 vars in 1137 bytes} [Tue Jul 26 14:55:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:56.204622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9c5a1-a782-4edd-a046-e45322ab8c53 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:56.312244 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:56.353393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cb27e-f306-408d-a18b-2a1c9e0fc7ac None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:56.425489 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3a19e-5f2a-4a69-b6ce-13a23ac9bbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:56.426634 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3a19e-5f2a-4a69-b6ce-13a23ac9bbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:56.427119 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3a19e-5f2a-4a69-b6ce-13a23ac9bbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:56.427599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3a19e-5f2a-4a69-b6ce-13a23ac9bbd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:56.428302 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9c5a1-a782-4edd-a046-e45322ab8c53 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:56.455599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3a19e-5f2a-4a69-b6ce-13a23ac9bbd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:56.458423 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3a19e-5f2a-4a69-b6ce-13a23ac9bbd9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:56.490448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-f6f3a19e-5f2a-4a69-b6ce-13a23ac9bbd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:56.490448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:56.490448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:56.490448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:56.490448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:56.490448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:56.490448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:56.490448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:56.490448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:56.490448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:56.490448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:56.490448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:56.490448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:55:56.490448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:55:56.490448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:56.492070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:56.493783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:55:56.493783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:55:56.493783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:56.493783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:56.493783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 247/496] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:56.494323 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3a19e-5f2a-4a69-b6ce-13a23ac9bbd9 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:56.517611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbf8fa-c149-4fd6-a7d5-6981d74cb59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:56.518756 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf8fa-c149-4fd6-a7d5-6981d74cb59d None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:56.519278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf8fa-c149-4fd6-a7d5-6981d74cb59d None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:56.519839 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf8fa-c149-4fd6-a7d5-6981d74cb59d None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:56.521109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbf8fa-c149-4fd6-a7d5-6981d74cb59d None admin] RBAC: Adding query filter params (name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:56.521643 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbf8fa-c149-4fd6-a7d5-6981d74cb59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:56.524426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbf8fa-c149-4fd6-a7d5-6981d74cb59d None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:56.546492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 250/497] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:55:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:56.546492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d287b-5cc2-41a9-a20d-badd9916d32b None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:56.546492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d287b-5cc2-41a9-a20d-badd9916d32b None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:56.546492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d287b-5cc2-41a9-a20d-badd9916d32b None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:56.550193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 251/498] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:56.554653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d287b-5cc2-41a9-a20d-badd9916d32b None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:56.591467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:56.688932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3a19e-5f2a-4a69-b6ce-13a23ac9bbd9 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:56.740149 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71618b10-a6a9-423e-b051-54b7352d6813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:56.741301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71618b10-a6a9-423e-b051-54b7352d6813 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:56.741990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71618b10-a6a9-423e-b051-54b7352d6813 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:56.742517 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71618b10-a6a9-423e-b051-54b7352d6813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:56.765323 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d287b-5cc2-41a9-a20d-badd9916d32b None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:56.787229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:56.834688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2281c3e-a29b-4231-9b9c-9da2638cfdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:56.835949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2281c3e-a29b-4231-9b9c-9da2638cfdd2 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:56.836269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2281c3e-a29b-4231-9b9c-9da2638cfdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:56.836607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2281c3e-a29b-4231-9b9c-9da2638cfdd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:56.837583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2281c3e-a29b-4231-9b9c-9da2638cfdd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:56.838087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2281c3e-a29b-4231-9b9c-9da2638cfdd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:56.839861 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2281c3e-a29b-4231-9b9c-9da2638cfdd2 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:56.859967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 252/499] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:56.862108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128ea9f-8054-4134-9063-a68ae5b5ed88 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:56.862598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128ea9f-8054-4134-9063-a68ae5b5ed88 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:56.863033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128ea9f-8054-4134-9063-a68ae5b5ed88 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:56.865731 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 253/500] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:55:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:56.866973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128ea9f-8054-4134-9063-a68ae5b5ed88 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:56.879812 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71618b10-a6a9-423e-b051-54b7352d6813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:56.881933 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71618b10-a6a9-423e-b051-54b7352d6813 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:56.965396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:57.023522 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128ea9f-8054-4134-9063-a68ae5b5ed88 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:57.048776 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 248/501] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:57.051003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67b23c-f2b3-405e-b68c-2ac9772459c5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:57.051512 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67b23c-f2b3-405e-b68c-2ac9772459c5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:57.052013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67b23c-f2b3-405e-b68c-2ac9772459c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:57.078104 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032e9c7-b847-4b37-bed4-da924fa0eb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:57.078786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2e67b23c-f2b3-405e-b68c-2ac9772459c5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:57.079174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032e9c7-b847-4b37-bed4-da924fa0eb9b None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:57.079635 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032e9c7-b847-4b37-bed4-da924fa0eb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:57.080097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032e9c7-b847-4b37-bed4-da924fa0eb9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:57.080746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2e67b23c-f2b3-405e-b68c-2ac9772459c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:57.106170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032e9c7-b847-4b37-bed4-da924fa0eb9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:57.106170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032e9c7-b847-4b37-bed4-da924fa0eb9b None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:57.130732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-b032e9c7-b847-4b37-bed4-da924fa0eb9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:57.130732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:57.130732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:57.130732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:57.130732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:57.130732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:57.130732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:57.130732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:57.130732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:57.130732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:57.130732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:57.130732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:57.130732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:55:57.130732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:55:57.130732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:57.132448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:57.133745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:55:57.133745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:55:57.133745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:57.133745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:57.133745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 254/502] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:57.134026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032e9c7-b847-4b37-bed4-da924fa0eb9b None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:57.183398 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:57.209731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 249/503] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:57.211193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1336be-42dc-4930-95ec-aeceebabeebf None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:57.211483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1336be-42dc-4930-95ec-aeceebabeebf None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:57.211761 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1336be-42dc-4930-95ec-aeceebabeebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:57.236525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-6f1336be-42dc-4930-95ec-aeceebabeebf None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:57.237970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6f1336be-42dc-4930-95ec-aeceebabeebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:57.341366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032e9c7-b847-4b37-bed4-da924fa0eb9b None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:57.351877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 250/504] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:55:57.366426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1336be-42dc-4930-95ec-aeceebabeebf None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:57.375633 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:57.418775 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9f696-3942-4bbb-b4f6-f9a6505f7ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:57.421356 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9f696-3942-4bbb-b4f6-f9a6505f7ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:57.421911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9f696-3942-4bbb-b4f6-f9a6505f7ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:57.422412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9f696-3942-4bbb-b4f6-f9a6505f7ab6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:57.438532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9f696-3942-4bbb-b4f6-f9a6505f7ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:57.441445 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9f696-3942-4bbb-b4f6-f9a6505f7ab6 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-65b9f696-3942-4bbb-b4f6-f9a6505f7ab6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:55:57.468432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:57.469529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:57.471216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:57.471216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:57.471216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:55:57.471216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:55:57.471216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:55:57.471216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:55:57.471216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:55:57.471216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:55:57.471216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:55:57.471216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:57.471216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 255/505] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:55:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:57.472171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9f696-3942-4bbb-b4f6-f9a6505f7ab6 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:57.527075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1336be-42dc-4930-95ec-aeceebabeebf None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:57.575692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4dc8d-eed9-4736-9038-76e32d455a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:57.576687 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4dc8d-eed9-4736-9038-76e32d455a2d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:57.577366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4dc8d-eed9-4736-9038-76e32d455a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:57.577758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4dc8d-eed9-4736-9038-76e32d455a2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:57.590135 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:57.591107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4dc8d-eed9-4736-9038-76e32d455a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:57.593783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4dc8d-eed9-4736-9038-76e32d455a2d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:57.611147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9f696-3942-4bbb-b4f6-f9a6505f7ab6 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:57.625640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-1ba4dc8d-eed9-4736-9038-76e32d455a2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:57.625640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:57.625640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:57.625640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:57.625640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:57.625640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:57.625640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:57.625640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:57.625640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:57.625640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:57.625640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:57.625640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:57.625640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:55:57.625640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:55:57.625640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:57.626750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:57.627734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:55:57.627734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:55:57.627734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:57.627734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:57.628566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 251/506] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:57.630424 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4dc8d-eed9-4736-9038-76e32d455a2d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:57.653875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed8806-7325-4f42-a0ee-c2d8c86e1de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:57.656286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed8806-7325-4f42-a0ee-c2d8c86e1de1 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:57.656286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed8806-7325-4f42-a0ee-c2d8c86e1de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:57.656625 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed8806-7325-4f42-a0ee-c2d8c86e1de1 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:57.657649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed8806-7325-4f42-a0ee-c2d8c86e1de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:57.658055 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed8806-7325-4f42-a0ee-c2d8c86e1de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:57.659890 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed8806-7325-4f42-a0ee-c2d8c86e1de1 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:57.675587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 256/507] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:57.675587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed8806-7325-4f42-a0ee-c2d8c86e1de1 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:57.739469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:57.809370 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4dc8d-eed9-4736-9038-76e32d455a2d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:57.837053 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed8806-7325-4f42-a0ee-c2d8c86e1de1 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:57.861117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3109043-32de-4def-aa66-2b7020f4fd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:57.861844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3109043-32de-4def-aa66-2b7020f4fd76 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:57.862125 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3109043-32de-4def-aa66-2b7020f4fd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:57.862435 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3109043-32de-4def-aa66-2b7020f4fd76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:57.877586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3109043-32de-4def-aa66-2b7020f4fd76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:57.880582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3109043-32de-4def-aa66-2b7020f4fd76 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:57.910580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-a3109043-32de-4def-aa66-2b7020f4fd76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:57.910580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:57.910580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:57.910580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:57.910580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:57.910580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:57.910580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:57.910580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:57.910580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:57.910580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:57.910580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:57.910580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:57.910580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:55:57.910580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:55:57.910580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:57.911544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:57.912391 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:55:57.912391 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:55:57.912391 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:57.912391 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:57.913004 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 252/508] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:57.914212 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3109043-32de-4def-aa66-2b7020f4fd76 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:57.916990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4583b-bac1-4499-8596-c3863a1dc26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:57.918136 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4583b-bac1-4499-8596-c3863a1dc26f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:57.918598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4583b-bac1-4499-8596-c3863a1dc26f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:57.919103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4583b-bac1-4499-8596-c3863a1dc26f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:57.942229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4583b-bac1-4499-8596-c3863a1dc26f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-88a4583b-bac1-4499-8596-c3863a1dc26f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:55:57.953321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:57.955358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:57.957190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:57.957190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:57.957190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:57.957190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:57.957190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:55:57.957190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:55:57.957190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:55:57.957190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:55:57.957190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:55:57.957190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:55:57.957190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:55:57.957190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:55:57.957190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 257/509] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:55:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:57.957190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4583b-bac1-4499-8596-c3863a1dc26f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:57.962573 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:58.089155 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3109043-32de-4def-aa66-2b7020f4fd76 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:58.103127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:58.131767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5fbf7-20bb-4cdf-8691-c357f36e7f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:58.132647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5fbf7-20bb-4cdf-8691-c357f36e7f4b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:58.133045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5fbf7-20bb-4cdf-8691-c357f36e7f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:58.133528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5fbf7-20bb-4cdf-8691-c357f36e7f4b None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:58.134630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5fbf7-20bb-4cdf-8691-c357f36e7f4b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:58.135050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5fbf7-20bb-4cdf-8691-c357f36e7f4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:58.136701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4583b-bac1-4499-8596-c3863a1dc26f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:58.137067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5fbf7-20bb-4cdf-8691-c357f36e7f4b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:58.186757 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95d074-af94-4710-bee3-b2e0c8d534ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:58.187532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95d074-af94-4710-bee3-b2e0c8d534ee None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:58.187952 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95d074-af94-4710-bee3-b2e0c8d534ee None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:58.188346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95d074-af94-4710-bee3-b2e0c8d534ee None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:58.189266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95d074-af94-4710-bee3-b2e0c8d534ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:58.189708 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95d074-af94-4710-bee3-b2e0c8d534ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:58.190633 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 253/510] 10.222.0.98 () {56 vars in 1137 bytes} [Tue Jul 26 14:55:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:58.191552 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5fbf7-20bb-4cdf-8691-c357f36e7f4b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:58.196708 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95d074-af94-4710-bee3-b2e0c8d534ee None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:58.219316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 258/511] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:58.220741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95d074-af94-4710-bee3-b2e0c8d534ee None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:58.316456 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:58.368355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5fbf7-20bb-4cdf-8691-c357f36e7f4b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:58.368693 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95d074-af94-4710-bee3-b2e0c8d534ee None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:58.417872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa741cb-a442-4b6f-b5d6-5516dc173201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:58.418583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa741cb-a442-4b6f-b5d6-5516dc173201 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:58.418879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa741cb-a442-4b6f-b5d6-5516dc173201 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:58.419230 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa741cb-a442-4b6f-b5d6-5516dc173201 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:58.428798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b813cd3-d063-41e1-b76f-c818fea7db9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:58.429751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b813cd3-d063-41e1-b76f-c818fea7db9f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:58.430180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b813cd3-d063-41e1-b76f-c818fea7db9f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:58.430663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b813cd3-d063-41e1-b76f-c818fea7db9f None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:58.431876 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b813cd3-d063-41e1-b76f-c818fea7db9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:58.432209 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa741cb-a442-4b6f-b5d6-5516dc173201 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:58.432404 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b813cd3-d063-41e1-b76f-c818fea7db9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:58.434470 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa741cb-a442-4b6f-b5d6-5516dc173201 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:58.434987 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b813cd3-d063-41e1-b76f-c818fea7db9f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-baa741cb-a442-4b6f-b5d6-5516dc173201 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:55:58.458195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:58.460440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:58.462240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:58.462240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:58.462240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:55:58.462240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:55:58.462240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:55:58.462240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:55:58.462240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:55:58.462240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:55:58.462240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:55:58.462240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:58.462240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 254/512] 10.222.0.98 () {56 vars in 1093 bytes} [Tue Jul 26 14:55:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:58.463293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 259/513] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:58.464367 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b813cd3-d063-41e1-b76f-c818fea7db9f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:58.465575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa741cb-a442-4b6f-b5d6-5516dc173201 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:58.513462 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:58.631705 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa741cb-a442-4b6f-b5d6-5516dc173201 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:58.653276 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b813cd3-d063-41e1-b76f-c818fea7db9f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:58.682961 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01180386-7517-4387-a778-6967b9c4e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:58.683785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180386-7517-4387-a778-6967b9c4e91b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:58.684191 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180386-7517-4387-a778-6967b9c4e91b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:58.684587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180386-7517-4387-a778-6967b9c4e91b None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:58.685779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01180386-7517-4387-a778-6967b9c4e91b None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:58.687064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01180386-7517-4387-a778-6967b9c4e91b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:58.687260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:58.688610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01180386-7517-4387-a778-6967b9c4e91b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:58.703598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 255/514] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:55:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:58.705511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01180386-7517-4387-a778-6967b9c4e91b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:58.706843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca99e0-ed87-4e89-82f5-08803f068228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:58.707621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca99e0-ed87-4e89-82f5-08803f068228 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:58.708009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca99e0-ed87-4e89-82f5-08803f068228 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:58.708427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca99e0-ed87-4e89-82f5-08803f068228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:58.815351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca99e0-ed87-4e89-82f5-08803f068228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:58.817097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca99e0-ed87-4e89-82f5-08803f068228 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:58.844704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:58.859396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01180386-7517-4387-a778-6967b9c4e91b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:58.917025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff896e2d-9998-4448-825c-54312efdb271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:58.917444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff896e2d-9998-4448-825c-54312efdb271 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:58.917878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff896e2d-9998-4448-825c-54312efdb271 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:58.918285 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff896e2d-9998-4448-825c-54312efdb271 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:58.927474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff896e2d-9998-4448-825c-54312efdb271 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:58.929034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff896e2d-9998-4448-825c-54312efdb271 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:58.943469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-ff896e2d-9998-4448-825c-54312efdb271 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:55:58.943469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:58.943469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:58.943469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:58.943469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:58.943469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:58.943469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:58.943469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:58.943469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:58.943469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:58.943469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:58.943469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:58.943469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:55:58.943469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:55:58.943469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:58.945371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:58.947226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:55:58.947226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:55:58.947226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:55:58.947226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:55:58.947226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:55:58.947226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:55:58.947226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:55:58.947226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:58.947226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 256/515] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:55:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:58.948272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff896e2d-9998-4448-825c-54312efdb271 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:58.999729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 260/516] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:59.001155 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca99e0-ed87-4e89-82f5-08803f068228 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:59.042610 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:59.121385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff896e2d-9998-4448-825c-54312efdb271 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:59.159125 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca99e0-ed87-4e89-82f5-08803f068228 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:59.169286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41d545-3e59-43ec-9cdd-1edbd0872db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:59.169956 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41d545-3e59-43ec-9cdd-1edbd0872db0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:59.170233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41d545-3e59-43ec-9cdd-1edbd0872db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:59.170547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41d545-3e59-43ec-9cdd-1edbd0872db0 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:59.171383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41d545-3e59-43ec-9cdd-1edbd0872db0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:59.171880 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41d545-3e59-43ec-9cdd-1edbd0872db0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:59.173543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41d545-3e59-43ec-9cdd-1edbd0872db0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:59.202715 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 257/517] 10.222.0.98 () {56 vars in 1133 bytes} [Tue Jul 26 14:55:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:59.203856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41d545-3e59-43ec-9cdd-1edbd0872db0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:59.217400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ea981-82a3-4b04-93e4-b58a5d65d2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:59.218192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ea981-82a3-4b04-93e4-b58a5d65d2e9 None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:59.218605 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ea981-82a3-4b04-93e4-b58a5d65d2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:59.219010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ea981-82a3-4b04-93e4-b58a5d65d2e9 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:59.219998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ea981-82a3-4b04-93e4-b58a5d65d2e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:59.222782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ea981-82a3-4b04-93e4-b58a5d65d2e9 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:59.224440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:59.380180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 261/518] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:55:58 2022] POST /identity/v3/users => generated 247 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:55:59.381043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ea981-82a3-4b04-93e4-b58a5d65d2e9 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:59.393834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41d545-3e59-43ec-9cdd-1edbd0872db0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:59.466429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb5b05-2c32-47ba-a838-e1328ea5a907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:59.466429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb5b05-2c32-47ba-a838-e1328ea5a907 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:59.466429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb5b05-2c32-47ba-a838-e1328ea5a907 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:59.466429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb5b05-2c32-47ba-a838-e1328ea5a907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:59.486083 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb5b05-2c32-47ba-a838-e1328ea5a907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:59.488569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb5b05-2c32-47ba-a838-e1328ea5a907 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:59.517716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-45eb5b05-2c32-47ba-a838-e1328ea5a907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:59.517716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:59.517716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:59.517716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:59.517716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:59.517716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:59.517716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:59.517716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:59.517716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:59.517716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:59.517716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:59.517716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:59.517716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:55:59.517716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:55:59.517716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:59.520117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:59.522273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:55:59.522273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:55:59.522273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:59.522273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:59.522273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 258/519] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:59.522273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb5b05-2c32-47ba-a838-e1328ea5a907 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:59.549491 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:59.583882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ea981-82a3-4b04-93e4-b58a5d65d2e9 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:59.645060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a42d5-97c8-4f68-ab5c-f685758df831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:59.646302 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a42d5-97c8-4f68-ab5c-f685758df831 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:59.647105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a42d5-97c8-4f68-ab5c-f685758df831 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:59.647432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a42d5-97c8-4f68-ab5c-f685758df831 None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:59.648734 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a42d5-97c8-4f68-ab5c-f685758df831 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:59.649063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a42d5-97c8-4f68-ab5c-f685758df831 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:59.651084 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a42d5-97c8-4f68-ab5c-f685758df831 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:59.658146 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:59.688064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 262/520] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:55:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:59.689388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a42d5-97c8-4f68-ab5c-f685758df831 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:59.743373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb5b05-2c32-47ba-a838-e1328ea5a907 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:59.804182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e9916-6d86-4260-8554-b88867343552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:59.805437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e9916-6d86-4260-8554-b88867343552 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:59.805931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e9916-6d86-4260-8554-b88867343552 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:59.806440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e9916-6d86-4260-8554-b88867343552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:59.832316 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e9916-6d86-4260-8554-b88867343552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:59.834905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e9916-6d86-4260-8554-b88867343552 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:59.862143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-786e9916-6d86-4260-8554-b88867343552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:59.862143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:55:59.862143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:55:59.862143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:55:59.862143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:55:59.862143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:55:59.862143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:55:59.862143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:55:59.862143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:55:59.862143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:55:59.862143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:55:59.862143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:55:59.862143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:55:59.862143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:55:59.862143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:55:59.871590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:55:59.875858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:55:59.875858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:55:59.875858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:55:59.875858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:55:59.875858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 259/521] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:55:59.875858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e9916-6d86-4260-8554-b88867343552 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:59.932844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a42d5-97c8-4f68-ab5c-f685758df831 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:00.005445 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c69d0-b213-4d0d-ab80-a87e41aa94bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:00.006746 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c69d0-b213-4d0d-ab80-a87e41aa94bb None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:00.006986 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c69d0-b213-4d0d-ab80-a87e41aa94bb None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:00.007458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c69d0-b213-4d0d-ab80-a87e41aa94bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:00.024963 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:00.080735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e9916-6d86-4260-8554-b88867343552 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:00.110533 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:00.145691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c69d0-b213-4d0d-ab80-a87e41aa94bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:00.148496 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c69d0-b213-4d0d-ab80-a87e41aa94bb None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:00.151626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1320c-9ef0-435e-b5da-7ea41a5a50c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:00.153124 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1320c-9ef0-435e-b5da-7ea41a5a50c5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:00.154636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1320c-9ef0-435e-b5da-7ea41a5a50c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:00.155546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1320c-9ef0-435e-b5da-7ea41a5a50c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:00.156750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1320c-9ef0-435e-b5da-7ea41a5a50c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:00.157684 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1320c-9ef0-435e-b5da-7ea41a5a50c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:00.161195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1320c-9ef0-435e-b5da-7ea41a5a50c5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:00.188808 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 260/522] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:00.189576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1320c-9ef0-435e-b5da-7ea41a5a50c5 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:00.383671 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 263/523] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:55:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:00.385544 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c69d0-b213-4d0d-ab80-a87e41aa94bb None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:00.438249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1320c-9ef0-435e-b5da-7ea41a5a50c5 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:00.466124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:00.512297 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261683bc-c7cf-48c5-9b48-5c9b3cec6536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:00.513981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261683bc-c7cf-48c5-9b48-5c9b3cec6536 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:00.514632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261683bc-c7cf-48c5-9b48-5c9b3cec6536 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:00.515264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261683bc-c7cf-48c5-9b48-5c9b3cec6536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:00.516838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261683bc-c7cf-48c5-9b48-5c9b3cec6536 None admin] RBAC: Adding query filter params (role.id=ce31429587b44a7aafb4f600c011be4a, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=4d85dc9f9f15480db927e617c992e1a1) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:00.517388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261683bc-c7cf-48c5-9b48-5c9b3cec6536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:00.520041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261683bc-c7cf-48c5-9b48-5c9b3cec6536 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:00.531955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 261/524] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:00 2022] GET /identity/v3/role_assignments?user.id=4d85dc9f9f15480db927e617c992e1a1&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=ce31429587b44a7aafb4f600c011be4a => generated 259 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:00.533343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261683bc-c7cf-48c5-9b48-5c9b3cec6536 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:00.613797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:00.623753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c69d0-b213-4d0d-ab80-a87e41aa94bb None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:00.679135 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e39a3-4534-4a26-bdc8-da6a831a50a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:00.680223 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e39a3-4534-4a26-bdc8-da6a831a50a8 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:00.680764 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e39a3-4534-4a26-bdc8-da6a831a50a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:00.681234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e39a3-4534-4a26-bdc8-da6a831a50a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:00.682170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e39a3-4534-4a26-bdc8-da6a831a50a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:00.682710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e39a3-4534-4a26-bdc8-da6a831a50a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:00.684370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e39a3-4534-4a26-bdc8-da6a831a50a8 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:00.703808 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 264/525] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:00.705109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e39a3-4534-4a26-bdc8-da6a831a50a8 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:00.751081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261683bc-c7cf-48c5-9b48-5c9b3cec6536 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:00.842748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3ea79-af77-433c-9fbb-584ae7be730a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:00.844264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3ea79-af77-433c-9fbb-584ae7be730a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:00.844993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3ea79-af77-433c-9fbb-584ae7be730a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:00.845723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3ea79-af77-433c-9fbb-584ae7be730a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:00.860201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3ea79-af77-433c-9fbb-584ae7be730a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:00.863098 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3ea79-af77-433c-9fbb-584ae7be730a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-b4d3ea79-af77-433c-9fbb-584ae7be730a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:00.898968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:00.900701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:00.902430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:00.902430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:00.902430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:00.902430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:00.902430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:00.902430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:00.902430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:00.902430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:00.902430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:56:00.902430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:00.906651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 262/526] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:00.908488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3ea79-af77-433c-9fbb-584ae7be730a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:00.935771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:00.944121 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e39a3-4534-4a26-bdc8-da6a831a50a8 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:01.026018 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fac31a-a65b-46e5-b8fb-13fdd5551e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:01.027240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fac31a-a65b-46e5-b8fb-13fdd5551e13 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:01.027749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fac31a-a65b-46e5-b8fb-13fdd5551e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:01.028246 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fac31a-a65b-46e5-b8fb-13fdd5551e13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:01.050486 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fac31a-a65b-46e5-b8fb-13fdd5551e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:01.053352 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fac31a-a65b-46e5-b8fb-13fdd5551e13 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:01.086230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-d1fac31a-a65b-46e5-b8fb-13fdd5551e13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:01.086230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:01.086230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:01.086230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:01.086230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:01.086230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:01.086230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:01.086230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:01.086230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:01.086230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:01.086230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:01.086230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:01.086230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:01.086230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:01.086230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:01.088211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:01.090239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:01.090239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:01.090239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:01.090239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:01.095126 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 265/527] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:01.096790 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fac31a-a65b-46e5-b8fb-13fdd5551e13 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:01.156153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:01.169123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3ea79-af77-433c-9fbb-584ae7be730a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:01.247163 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359e920-e702-4dd8-a2cc-47e527af11a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:01.249456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359e920-e702-4dd8-a2cc-47e527af11a2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:01.250227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359e920-e702-4dd8-a2cc-47e527af11a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:01.250912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359e920-e702-4dd8-a2cc-47e527af11a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:01.266062 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359e920-e702-4dd8-a2cc-47e527af11a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:01.269488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359e920-e702-4dd8-a2cc-47e527af11a2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:01.294476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-1359e920-e702-4dd8-a2cc-47e527af11a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:01.294476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:01.294476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:01.294476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:01.294476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:01.294476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:01.294476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:01.294476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:01.294476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:01.294476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:01.294476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:01.294476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:01.294476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:01.294476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:01.294476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:01.297181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:01.299069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:01.299069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:01.299069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:01.299069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:01.299069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:01.299069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:01.299069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:01.299069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:01.307000 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 263/528] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:01.308950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359e920-e702-4dd8-a2cc-47e527af11a2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:01.335122 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fac31a-a65b-46e5-b8fb-13fdd5551e13 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:01.415290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd48aec-6576-432a-8329-85ed1ceca2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:01.417196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd48aec-6576-432a-8329-85ed1ceca2cb None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:01.418850 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd48aec-6576-432a-8329-85ed1ceca2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:01.420125 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd48aec-6576-432a-8329-85ed1ceca2cb None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:01.422403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd48aec-6576-432a-8329-85ed1ceca2cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:01.423285 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd48aec-6576-432a-8329-85ed1ceca2cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:01.427397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd48aec-6576-432a-8329-85ed1ceca2cb None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:01.485874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 266/529] 10.222.0.98 () {56 vars in 1139 bytes} [Tue Jul 26 14:56:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:01.487965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd48aec-6576-432a-8329-85ed1ceca2cb None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:01.516016 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:01.552306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359e920-e702-4dd8-a2cc-47e527af11a2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:01.639440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d467181-3234-46f3-82fe-b2f51ee3c127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:01.640742 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d467181-3234-46f3-82fe-b2f51ee3c127 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:01.641458 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d467181-3234-46f3-82fe-b2f51ee3c127 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:01.642064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d467181-3234-46f3-82fe-b2f51ee3c127 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:01.643314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d467181-3234-46f3-82fe-b2f51ee3c127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:01.643951 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d467181-3234-46f3-82fe-b2f51ee3c127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:01.645819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d467181-3234-46f3-82fe-b2f51ee3c127 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:01.670565 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 264/530] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:01.671883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d467181-3234-46f3-82fe-b2f51ee3c127 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:01.702274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:01.749555 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd48aec-6576-432a-8329-85ed1ceca2cb None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:01.873127 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710ed5-efb6-4532-91ad-d4a2f2766c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:01.874594 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710ed5-efb6-4532-91ad-d4a2f2766c3b None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:01.875546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710ed5-efb6-4532-91ad-d4a2f2766c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:01.876138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710ed5-efb6-4532-91ad-d4a2f2766c3b None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:01.877683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13710ed5-efb6-4532-91ad-d4a2f2766c3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:01.878501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13710ed5-efb6-4532-91ad-d4a2f2766c3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:01.880733 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13710ed5-efb6-4532-91ad-d4a2f2766c3b None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:01.908805 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 267/531] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:01.910395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710ed5-efb6-4532-91ad-d4a2f2766c3b None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:01.915561 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d467181-3234-46f3-82fe-b2f51ee3c127 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:01.973971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5c98-5e91-4e4d-8afb-3e2c327d0432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:01.974666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5c98-5e91-4e4d-8afb-3e2c327d0432 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:01.974952 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5c98-5e91-4e4d-8afb-3e2c327d0432 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:01.975232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5c98-5e91-4e4d-8afb-3e2c327d0432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:02.026441 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:02.068913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf5c98-5e91-4e4d-8afb-3e2c327d0432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:02.070757 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf5c98-5e91-4e4d-8afb-3e2c327d0432 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:02.080809 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710ed5-efb6-4532-91ad-d4a2f2766c3b None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:02.092127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:02.135892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998763bc-92ae-40ee-9248-0c846581b14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:02.137994 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998763bc-92ae-40ee-9248-0c846581b14b None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:02.138947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998763bc-92ae-40ee-9248-0c846581b14b None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:02.139592 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998763bc-92ae-40ee-9248-0c846581b14b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:02.150131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998763bc-92ae-40ee-9248-0c846581b14b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:02.152082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998763bc-92ae-40ee-9248-0c846581b14b None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:02.174602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-998763bc-92ae-40ee-9248-0c846581b14b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:02.174602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:02.174602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:02.174602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:02.174602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:02.174602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:02.174602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:02.174602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:02.174602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:02.174602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:02.174602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:02.174602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:02.174602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:02.174602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:02.174602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:02.175620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:02.176485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:02.176485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:02.176485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:02.176485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:02.176485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:02.176485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:02.176485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:02.176485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:02.179351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 268/532] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:02.180516 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998763bc-92ae-40ee-9248-0c846581b14b None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:02.219118 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 265/533] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:56:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:02.224925 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5c98-5e91-4e4d-8afb-3e2c327d0432 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:02.360738 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5c98-5e91-4e4d-8afb-3e2c327d0432 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:02.388907 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:02.406547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998763bc-92ae-40ee-9248-0c846581b14b None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:02.433620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2415539-cba8-4812-bafc-b41eab3f8397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:02.435534 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2415539-cba8-4812-bafc-b41eab3f8397 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:02.436671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2415539-cba8-4812-bafc-b41eab3f8397 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:02.438206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2415539-cba8-4812-bafc-b41eab3f8397 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:02.440356 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2415539-cba8-4812-bafc-b41eab3f8397 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:02.440906 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2415539-cba8-4812-bafc-b41eab3f8397 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:02.443899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2415539-cba8-4812-bafc-b41eab3f8397 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:02.446524 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:02.458252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e03a9e-0aca-461f-a31f-4280cf19fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:02.458946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e03a9e-0aca-461f-a31f-4280cf19fd89 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:02.459233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e03a9e-0aca-461f-a31f-4280cf19fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:02.459516 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e03a9e-0aca-461f-a31f-4280cf19fd89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:02.460343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e03a9e-0aca-461f-a31f-4280cf19fd89 None admin] RBAC: Adding query filter params (role.id=ce31429587b44a7aafb4f600c011be4a, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=96d09fca7f864129ab0dcb90fb5d24e3) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:02.460658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e03a9e-0aca-461f-a31f-4280cf19fd89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:02.462172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e03a9e-0aca-461f-a31f-4280cf19fd89 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:02.476469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 269/534] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:02 2022] GET /identity/v3/role_assignments?user.id=96d09fca7f864129ab0dcb90fb5d24e3&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=ce31429587b44a7aafb4f600c011be4a => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:02.476469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e03a9e-0aca-461f-a31f-4280cf19fd89 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:02.486547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 266/535] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:02.488411 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b19d9c-873d-4354-a939-7adc03d69202 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:02.488850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b19d9c-873d-4354-a939-7adc03d69202 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:02.489259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b19d9c-873d-4354-a939-7adc03d69202 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:02.496500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 267/536] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:02.500225 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b19d9c-873d-4354-a939-7adc03d69202 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:02.703761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e03a9e-0aca-461f-a31f-4280cf19fd89 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:02.724785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b19d9c-873d-4354-a939-7adc03d69202 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:02.759427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9abed8-e00a-491e-996f-d0ae691daad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:02.760512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9abed8-e00a-491e-996f-d0ae691daad8 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:02.760957 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9abed8-e00a-491e-996f-d0ae691daad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:02.761388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9abed8-e00a-491e-996f-d0ae691daad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:02.781162 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9abed8-e00a-491e-996f-d0ae691daad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:02.783703 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9abed8-e00a-491e-996f-d0ae691daad8 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:02.795016 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57798ccb-5eac-442c-bb7f-11f05276732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:02.796439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57798ccb-5eac-442c-bb7f-11f05276732a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:02.797112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57798ccb-5eac-442c-bb7f-11f05276732a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:02.797828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57798ccb-5eac-442c-bb7f-11f05276732a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:02.799671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57798ccb-5eac-442c-bb7f-11f05276732a None admin] RBAC: Adding query filter params (role.id=ce31429587b44a7aafb4f600c011be4a, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=a4a6c0e7ca434010980d7cac1800dbe9) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:02.800479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57798ccb-5eac-442c-bb7f-11f05276732a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:02.803485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57798ccb-5eac-442c-bb7f-11f05276732a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:02.812696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-cf9abed8-e00a-491e-996f-d0ae691daad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:02.812696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:02.812696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:02.812696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:02.812696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:02.812696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:02.812696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:02.812696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:02.812696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:02.812696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:02.812696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:02.812696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:02.812696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:02.812696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:02.812696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:02.814231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:02.815799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:02.815799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:02.815799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:02.815799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:02.826411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 270/538] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:02.826411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ea6e5-ef55-4a31-9606-b53735a35b93 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:02.826411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ea6e5-ef55-4a31-9606-b53735a35b93 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:02.826411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ea6e5-ef55-4a31-9606-b53735a35b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:02.827278 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 268/538] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:02 2022] GET /identity/v3/role_assignments?user.id=a4a6c0e7ca434010980d7cac1800dbe9&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=ce31429587b44a7aafb4f600c011be4a => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:02.828160 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57798ccb-5eac-442c-bb7f-11f05276732a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:02.862443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a30ea6e5-ef55-4a31-9606-b53735a35b93 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:02.862443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a30ea6e5-ef55-4a31-9606-b53735a35b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:02.926397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:02.958631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 271/539] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:02.982419 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:03.001200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ea6e5-ef55-4a31-9606-b53735a35b93 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:03.223629 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57798ccb-5eac-442c-bb7f-11f05276732a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:03.306807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fecc1-d21d-477b-8512-463b398caa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:03.308523 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fecc1-d21d-477b-8512-463b398caa7c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:03.309141 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fecc1-d21d-477b-8512-463b398caa7c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:03.312061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fecc1-d21d-477b-8512-463b398caa7c None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:03.313098 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fecc1-d21d-477b-8512-463b398caa7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:03.313593 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fecc1-d21d-477b-8512-463b398caa7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:03.316376 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fecc1-d21d-477b-8512-463b398caa7c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:03.321247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ea6e5-ef55-4a31-9606-b53735a35b93 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:03.346784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 269/540] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:03.352574 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fecc1-d21d-477b-8512-463b398caa7c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:03.410333 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f4db-8222-44a6-a2bf-ac2fd84a60d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:03.411817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f4db-8222-44a6-a2bf-ac2fd84a60d5 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:03.412528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f4db-8222-44a6-a2bf-ac2fd84a60d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:03.413240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f4db-8222-44a6-a2bf-ac2fd84a60d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:03.435646 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137f4db-8222-44a6-a2bf-ac2fd84a60d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-2137f4db-8222-44a6-a2bf-ac2fd84a60d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:03.446568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:03.448601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:03.451014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:03.451014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:03.451014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:03.451014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:03.451014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:03.451014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:03.451014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:03.451014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:03.451014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:03.451014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:03.451014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:03.451014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:03.456287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 272/541] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:03.465899 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f4db-8222-44a6-a2bf-ac2fd84a60d5 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:03.643153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:03.645878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:03.650937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fecc1-d21d-477b-8512-463b398caa7c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:03.709954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2faa7-39ab-4091-9515-73011a55528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:03.711029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2faa7-39ab-4091-9515-73011a55528d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:03.711499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2faa7-39ab-4091-9515-73011a55528d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:03.711962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2faa7-39ab-4091-9515-73011a55528d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:03.735991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2faa7-39ab-4091-9515-73011a55528d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:03.737557 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2faa7-39ab-4091-9515-73011a55528d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:03.761583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-18b2faa7-39ab-4091-9515-73011a55528d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:03.761583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:03.761583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:03.761583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:03.761583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:03.761583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:03.761583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:03.761583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:03.761583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:03.761583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:03.761583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:03.761583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:03.761583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:03.761583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:03.761583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:03.763841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:03.766570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:03.766570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:03.766570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:03.766570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:03.766570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:03.766570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:03.766570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:03.766570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:03.766570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 270/542] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:03.780193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2faa7-39ab-4091-9515-73011a55528d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:03.858600 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f4db-8222-44a6-a2bf-ac2fd84a60d5 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:03.955941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6978b-3996-48b1-a5dc-ff2114ffb338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:03.957632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6978b-3996-48b1-a5dc-ff2114ffb338 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:03.958654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6978b-3996-48b1-a5dc-ff2114ffb338 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:03.959202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6978b-3996-48b1-a5dc-ff2114ffb338 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:03.960620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6978b-3996-48b1-a5dc-ff2114ffb338 None admin] RBAC: Adding query filter params (name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:03.961228 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6978b-3996-48b1-a5dc-ff2114ffb338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:03.963880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6978b-3996-48b1-a5dc-ff2114ffb338 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:03.985831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 273/543] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:56:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:03.988331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c5905-83da-4633-ba23-a5addc7be8cb None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:03.988940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c5905-83da-4633-ba23-a5addc7be8cb None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:03.989499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c5905-83da-4633-ba23-a5addc7be8cb None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:03.991902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2faa7-39ab-4091-9515-73011a55528d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:03.998319 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 274/544] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:03.999730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c5905-83da-4633-ba23-a5addc7be8cb None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:04.083477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c57c3-61f2-4fac-94c4-c738d9bb38d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:04.085073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c57c3-61f2-4fac-94c4-c738d9bb38d8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:04.085573 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c57c3-61f2-4fac-94c4-c738d9bb38d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:04.086597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c57c3-61f2-4fac-94c4-c738d9bb38d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:04.088884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c57c3-61f2-4fac-94c4-c738d9bb38d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:04.089814 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c57c3-61f2-4fac-94c4-c738d9bb38d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:04.093680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c57c3-61f2-4fac-94c4-c738d9bb38d8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:04.124352 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 271/545] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:04.126577 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017b837-e6d9-4ae1-8d52-be3ef6a9fd62 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:04.127076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017b837-e6d9-4ae1-8d52-be3ef6a9fd62 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:04.127613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017b837-e6d9-4ae1-8d52-be3ef6a9fd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:04.157609 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3017b837-e6d9-4ae1-8d52-be3ef6a9fd62 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:04.159547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3017b837-e6d9-4ae1-8d52-be3ef6a9fd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:04.190946 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:04.227736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:04.239772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c5905-83da-4633-ba23-a5addc7be8cb None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:04.314473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc7928-b1e2-4a0b-8e81-213d130164c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:04.314948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 272/546] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:04.316652 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017b837-e6d9-4ae1-8d52-be3ef6a9fd62 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:04.317705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc7928-b1e2-4a0b-8e81-213d130164c3 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:04.319300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc7928-b1e2-4a0b-8e81-213d130164c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:04.320057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc7928-b1e2-4a0b-8e81-213d130164c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:04.345155 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc7928-b1e2-4a0b-8e81-213d130164c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:04.349251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc7928-b1e2-4a0b-8e81-213d130164c3 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:04.379201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-3ebc7928-b1e2-4a0b-8e81-213d130164c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:04.379201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:04.379201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:04.379201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:04.379201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:04.379201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:04.379201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:04.379201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:04.379201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:04.379201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:04.379201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:04.379201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:04.379201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:04.379201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:04.379201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:04.380503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:04.382167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:04.382167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:04.382167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:04.382167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:04.385632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 275/547] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:04.393425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc7928-b1e2-4a0b-8e81-213d130164c3 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:04.561400 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017b837-e6d9-4ae1-8d52-be3ef6a9fd62 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:04.601095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc7928-b1e2-4a0b-8e81-213d130164c3 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:04.628645 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffa3c2-87c8-447a-8154-6e6981cf2858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:04.630072 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffa3c2-87c8-447a-8154-6e6981cf2858 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:04.631184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffa3c2-87c8-447a-8154-6e6981cf2858 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:04.631822 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffa3c2-87c8-447a-8154-6e6981cf2858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:04.633370 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffa3c2-87c8-447a-8154-6e6981cf2858 None admin] RBAC: Adding query filter params (role.id=ce31429587b44a7aafb4f600c011be4a, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=e44d2d2b50484fb89b0688ff28615d05) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:04.634547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffa3c2-87c8-447a-8154-6e6981cf2858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:04.638959 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffa3c2-87c8-447a-8154-6e6981cf2858 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:04.649665 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 273/548] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:04 2022] GET /identity/v3/role_assignments?user.id=e44d2d2b50484fb89b0688ff28615d05&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=ce31429587b44a7aafb4f600c011be4a => generated 259 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:04.651270 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffa3c2-87c8-447a-8154-6e6981cf2858 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:04.729958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e3d00-f8ef-40a8-8fe3-7ac1dc82d16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:04.731130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e3d00-f8ef-40a8-8fe3-7ac1dc82d16d None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:04.732227 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e3d00-f8ef-40a8-8fe3-7ac1dc82d16d None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:04.733558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e3d00-f8ef-40a8-8fe3-7ac1dc82d16d None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:04.736612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:04.739144 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e3d00-f8ef-40a8-8fe3-7ac1dc82d16d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:04.739762 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e3d00-f8ef-40a8-8fe3-7ac1dc82d16d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:04.744575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e3d00-f8ef-40a8-8fe3-7ac1dc82d16d None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:04.805765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 276/549] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:04.807782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e3d00-f8ef-40a8-8fe3-7ac1dc82d16d None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:04.846727 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:04.961009 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffa3c2-87c8-447a-8154-6e6981cf2858 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:05.068507 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdeb82-c96f-4cf4-b7dc-e9d7d7e09c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:05.070111 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdeb82-c96f-4cf4-b7dc-e9d7d7e09c8d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:05.070762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdeb82-c96f-4cf4-b7dc-e9d7d7e09c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:05.071465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdeb82-c96f-4cf4-b7dc-e9d7d7e09c8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:05.124717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdeb82-c96f-4cf4-b7dc-e9d7d7e09c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-2dfdeb82-c96f-4cf4-b7dc-e9d7d7e09c8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:05.131504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:05.132503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:05.133339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:05.133339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:05.133339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:05.133339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:05.133339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:05.133339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:05.133339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:05.133339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:05.133339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:05.133339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:05.133339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:05.133339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:05.136894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 274/550] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 486 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:05.146777 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdeb82-c96f-4cf4-b7dc-e9d7d7e09c8d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:05.180673 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e3d00-f8ef-40a8-8fe3-7ac1dc82d16d None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:05.287006 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3122e62-6550-49ab-b223-9a9875f9ea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:05.287948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3122e62-6550-49ab-b223-9a9875f9ea36 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:05.288381 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3122e62-6550-49ab-b223-9a9875f9ea36 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:05.288783 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3122e62-6550-49ab-b223-9a9875f9ea36 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:05.312342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3122e62-6550-49ab-b223-9a9875f9ea36 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:05.315065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3122e62-6550-49ab-b223-9a9875f9ea36 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-b3122e62-6550-49ab-b223-9a9875f9ea36 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:05.338097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:05.339912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:05.342672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:05.342672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:05.342672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:05.342672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:05.342672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:05.342672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:05.342672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:05.342672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:05.342672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:56:05.342672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:05.342672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 277/551] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:56:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 534 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:56:05.359700 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3122e62-6550-49ab-b223-9a9875f9ea36 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:05.424104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:05.497367 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:05.514095 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdeb82-c96f-4cf4-b7dc-e9d7d7e09c8d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:05.558342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3122e62-6550-49ab-b223-9a9875f9ea36 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:05.606871 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c4d8a-7b5d-468d-b9c5-21a165b2b203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:05.607944 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c4d8a-7b5d-468d-b9c5-21a165b2b203 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:05.608506 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c4d8a-7b5d-468d-b9c5-21a165b2b203 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:05.609000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c4d8a-7b5d-468d-b9c5-21a165b2b203 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:05.610109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c4d8a-7b5d-468d-b9c5-21a165b2b203 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:05.610809 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c4d8a-7b5d-468d-b9c5-21a165b2b203 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:05.612548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c4d8a-7b5d-468d-b9c5-21a165b2b203 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:05.639731 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 278/552] 10.222.0.98 () {56 vars in 1135 bytes} [Tue Jul 26 14:56:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:56:05.649855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c4d8a-7b5d-468d-b9c5-21a165b2b203 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:05.651647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72358b-07f8-4de5-a69d-9641ab1841dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:05.652645 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72358b-07f8-4de5-a69d-9641ab1841dd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:05.653144 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72358b-07f8-4de5-a69d-9641ab1841dd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:05.654247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72358b-07f8-4de5-a69d-9641ab1841dd None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:05.655678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72358b-07f8-4de5-a69d-9641ab1841dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:05.656399 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72358b-07f8-4de5-a69d-9641ab1841dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:05.658796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72358b-07f8-4de5-a69d-9641ab1841dd None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:05.681587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 275/553] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:56:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 529 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:05.700712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72358b-07f8-4de5-a69d-9641ab1841dd None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:05.839843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c4d8a-7b5d-468d-b9c5-21a165b2b203 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:05.884138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:05.900263 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cfbb4-0f89-4351-b13f-10ab16b3c7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:05.902520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cfbb4-0f89-4351-b13f-10ab16b3c7ac None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:05.902520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cfbb4-0f89-4351-b13f-10ab16b3c7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:05.903127 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cfbb4-0f89-4351-b13f-10ab16b3c7ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:06.021135 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cfbb4-0f89-4351-b13f-10ab16b3c7ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:06.024591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cfbb4-0f89-4351-b13f-10ab16b3c7ac None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:06.088003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72358b-07f8-4de5-a69d-9641ab1841dd None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:06.168085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d3aca-2c37-440e-8f8e-1653d2b8b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:06.169304 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d3aca-2c37-440e-8f8e-1653d2b8b287 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:06.169812 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d3aca-2c37-440e-8f8e-1653d2b8b287 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:06.170237 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d3aca-2c37-440e-8f8e-1653d2b8b287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:06.178431 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:06.191161 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d3aca-2c37-440e-8f8e-1653d2b8b287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:06.193972 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d3aca-2c37-440e-8f8e-1653d2b8b287 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:06.213247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-d49d3aca-2c37-440e-8f8e-1653d2b8b287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:06.213247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:06.213247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:06.213247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:06.213247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:06.213247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:06.213247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:06.213247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:06.213247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:06.213247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:06.213247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:06.213247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:06.213247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:06.213247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:06.213247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:06.215344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:06.218065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:06.218065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:06.218065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:06.218065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:06.218065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 276/554] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 516 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:06.218065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc7f4a-56fa-4877-9892-3763f9b2b253 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:06.218065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc7f4a-56fa-4877-9892-3763f9b2b253 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:06.218065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc7f4a-56fa-4877-9892-3763f9b2b253 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:06.226400 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 277/555] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:06.230121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc7f4a-56fa-4877-9892-3763f9b2b253 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:06.275262 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 279/556] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:56:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:06.278125 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c39be8-3223-41d1-bc8e-ce753f69a4b2 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:06.279446 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c39be8-3223-41d1-bc8e-ce753f69a4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:06.280248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c39be8-3223-41d1-bc8e-ce753f69a4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:06.320047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-26c39be8-3223-41d1-bc8e-ce753f69a4b2 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:06.322776 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-26c39be8-3223-41d1-bc8e-ce753f69a4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:06.361501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:06.411868 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc7f4a-56fa-4877-9892-3763f9b2b253 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:06.457497 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 280/557] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:06.458964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c39be8-3223-41d1-bc8e-ce753f69a4b2 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:06.469701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864ba65-ffbf-4ec6-b8ca-682eba4db3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:06.470787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864ba65-ffbf-4ec6-b8ca-682eba4db3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:06.471297 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864ba65-ffbf-4ec6-b8ca-682eba4db3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:06.471788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864ba65-ffbf-4ec6-b8ca-682eba4db3c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:06.472713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864ba65-ffbf-4ec6-b8ca-682eba4db3c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:06.473275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864ba65-ffbf-4ec6-b8ca-682eba4db3c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:06.476454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864ba65-ffbf-4ec6-b8ca-682eba4db3c2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:06.497993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 278/558] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:06.499343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce27dda-7989-454f-a2cc-84d33163e0ff None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:06.499687 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce27dda-7989-454f-a2cc-84d33163e0ff None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:06.499964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce27dda-7989-454f-a2cc-84d33163e0ff None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:06.504471 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 279/559] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:06.504471 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce27dda-7989-454f-a2cc-84d33163e0ff None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:06.611250 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:06.688882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c39be8-3223-41d1-bc8e-ce753f69a4b2 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:06.695472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce27dda-7989-454f-a2cc-84d33163e0ff None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:06.758307 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445beee-a032-4fa6-b3bf-f3924d750320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:06.759219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445beee-a032-4fa6-b3bf-f3924d750320 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:06.761159 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445beee-a032-4fa6-b3bf-f3924d750320 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:06.761662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445beee-a032-4fa6-b3bf-f3924d750320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:06.770669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12375c5-8c50-44cb-9bed-e9dc0edfb79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:06.771738 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12375c5-8c50-44cb-9bed-e9dc0edfb79d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:06.772218 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12375c5-8c50-44cb-9bed-e9dc0edfb79d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:06.772685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12375c5-8c50-44cb-9bed-e9dc0edfb79d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:06.780393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445beee-a032-4fa6-b3bf-f3924d750320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:06.782801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445beee-a032-4fa6-b3bf-f3924d750320 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:06.791820 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12375c5-8c50-44cb-9bed-e9dc0edfb79d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-a12375c5-8c50-44cb-9bed-e9dc0edfb79d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:06.800444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:06.802299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:06.804484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:06.804484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:06.804484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:06.804484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:06.804484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:06.804484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:06.804484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:06.804484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:06.804484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:06.804484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:06.804484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:06.804484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:06.805738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-8445beee-a032-4fa6-b3bf-f3924d750320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:06.805738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:06.805738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:06.805738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:06.805738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:06.805738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:06.805738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:06.805738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:06.805738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:06.805738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:06.805738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:06.805738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:06.805738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:06.805738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:06.805738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:06.807431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:06.812840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:06.812840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:06.812840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:06.812840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:06.813664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 280/560] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:06.813664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12375c5-8c50-44cb-9bed-e9dc0edfb79d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:06.814128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 281/561] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:06.814128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638161f-7262-4b76-a7c8-b74583568c02 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:06.814128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638161f-7262-4b76-a7c8-b74583568c02 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:06.814128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638161f-7262-4b76-a7c8-b74583568c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:06.848859 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a638161f-7262-4b76-a7c8-b74583568c02 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:06.850236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a638161f-7262-4b76-a7c8-b74583568c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:06.855781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:06.958608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 282/562] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:06.964358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638161f-7262-4b76-a7c8-b74583568c02 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:07.016664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12375c5-8c50-44cb-9bed-e9dc0edfb79d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:07.031050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:07.075169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf48b7b-640d-45e1-a4b9-18e7d1f03f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:07.076060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf48b7b-640d-45e1-a4b9-18e7d1f03f1e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:07.076344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf48b7b-640d-45e1-a4b9-18e7d1f03f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:07.076880 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf48b7b-640d-45e1-a4b9-18e7d1f03f1e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:07.091639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf48b7b-640d-45e1-a4b9-18e7d1f03f1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:07.094565 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf48b7b-640d-45e1-a4b9-18e7d1f03f1e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-cbf48b7b-640d-45e1-a4b9-18e7d1f03f1e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:07.123092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:07.125025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:07.128623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:07.128623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:07.128623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:07.128623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:07.128623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:07.128623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:07.128623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:07.128623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:07.128623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:56:07.128623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:07.128623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 281/563] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:56:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:07.128623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf48b7b-640d-45e1-a4b9-18e7d1f03f1e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:07.159235 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638161f-7262-4b76-a7c8-b74583568c02 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:07.232003 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de9c96-df99-47bd-9011-782dd498936d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:07.232885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de9c96-df99-47bd-9011-782dd498936d None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:07.233252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de9c96-df99-47bd-9011-782dd498936d None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:07.233535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de9c96-df99-47bd-9011-782dd498936d None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:07.234345 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de9c96-df99-47bd-9011-782dd498936d None admin] RBAC: Adding query filter params (name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:07.234686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de9c96-df99-47bd-9011-782dd498936d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:07.236150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de9c96-df99-47bd-9011-782dd498936d None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:07.243229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:07.255090 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 283/564] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:56:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:07.255090 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de9c96-df99-47bd-9011-782dd498936d None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:07.344395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf48b7b-640d-45e1-a4b9-18e7d1f03f1e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:07.406553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f426c-901d-45bf-b186-768395a8a0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:07.407559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f426c-901d-45bf-b186-768395a8a0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:07.408013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f426c-901d-45bf-b186-768395a8a0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:07.408455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f426c-901d-45bf-b186-768395a8a0d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:07.409659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f426c-901d-45bf-b186-768395a8a0d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:07.410151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f426c-901d-45bf-b186-768395a8a0d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:07.412651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f426c-901d-45bf-b186-768395a8a0d3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:07.444774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 282/565] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:07.444774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f426c-901d-45bf-b186-768395a8a0d3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:07.480792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de9c96-df99-47bd-9011-782dd498936d None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:07.501409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:07.552296 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a96f3-46c0-4497-b6bf-7799c5522497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:07.553151 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a96f3-46c0-4497-b6bf-7799c5522497 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:07.553707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a96f3-46c0-4497-b6bf-7799c5522497 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:07.554176 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a96f3-46c0-4497-b6bf-7799c5522497 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:07.569068 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a96f3-46c0-4497-b6bf-7799c5522497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-371a96f3-46c0-4497-b6bf-7799c5522497 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:07.579250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:07.580943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:07.583316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:07.583316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:07.583316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:07.583316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:07.583316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:07.583316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:07.583316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:07.583316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:07.583316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:07.583316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:07.583316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:07.583316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:07.583316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 284/566] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:07.583316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a96f3-46c0-4497-b6bf-7799c5522497 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:07.639109 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f426c-901d-45bf-b186-768395a8a0d3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:07.708196 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e6452-f7b1-448e-aeb8-66f0567a433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:07.709822 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e6452-f7b1-448e-aeb8-66f0567a433e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:07.710307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e6452-f7b1-448e-aeb8-66f0567a433e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:07.711199 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e6452-f7b1-448e-aeb8-66f0567a433e None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:07.712715 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e6452-f7b1-448e-aeb8-66f0567a433e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:07.713559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e6452-f7b1-448e-aeb8-66f0567a433e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:07.718306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e6452-f7b1-448e-aeb8-66f0567a433e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:07.719510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:07.754941 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 283/567] 10.222.0.98 () {56 vars in 1137 bytes} [Tue Jul 26 14:56:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:07.757094 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e6452-f7b1-448e-aeb8-66f0567a433e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:07.802108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a96f3-46c0-4497-b6bf-7799c5522497 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:07.871908 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163db05-afd7-4621-8333-1292d237ebe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:07.872783 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163db05-afd7-4621-8333-1292d237ebe6 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:07.873086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163db05-afd7-4621-8333-1292d237ebe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:07.873556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163db05-afd7-4621-8333-1292d237ebe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:07.891419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163db05-afd7-4621-8333-1292d237ebe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:07.893741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163db05-afd7-4621-8333-1292d237ebe6 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:07.915741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-3163db05-afd7-4621-8333-1292d237ebe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:07.915741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:07.915741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:07.915741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:07.915741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:07.915741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:07.915741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:07.915741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:07.915741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:07.915741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:07.915741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:07.915741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:07.915741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:07.915741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:07.915741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:07.917511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:07.919469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:07.919469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:07.919469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:07.919469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:07.922594 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 285/568] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:07.925866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163db05-afd7-4621-8333-1292d237ebe6 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:07.936365 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:07.966602 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e6452-f7b1-448e-aeb8-66f0567a433e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:08.053309 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1af5c5-b7ea-4a74-b03c-9d43981ab5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:08.054405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1af5c5-b7ea-4a74-b03c-9d43981ab5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:08.054910 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1af5c5-b7ea-4a74-b03c-9d43981ab5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:08.055403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1af5c5-b7ea-4a74-b03c-9d43981ab5a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:08.065552 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1af5c5-b7ea-4a74-b03c-9d43981ab5a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:08.067103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1af5c5-b7ea-4a74-b03c-9d43981ab5a0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:08.081231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-ac1af5c5-b7ea-4a74-b03c-9d43981ab5a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:08.081231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:08.081231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:08.081231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:08.081231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:08.081231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:08.081231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:08.081231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:08.081231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:08.081231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:08.081231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:08.081231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:08.081231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:08.081231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:08.081231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:08.082234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:08.083485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:08.083485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:08.083485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:08.083485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:08.083485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:08.083485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:08.083485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:08.083485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:08.083485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 284/569] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:08.083485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1af5c5-b7ea-4a74-b03c-9d43981ab5a0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:08.121323 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163db05-afd7-4621-8333-1292d237ebe6 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:08.146451 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:08.189721 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c7ff5-7905-4268-81a1-52f35313e3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:08.190853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c7ff5-7905-4268-81a1-52f35313e3ec None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:08.191372 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c7ff5-7905-4268-81a1-52f35313e3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:08.191754 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c7ff5-7905-4268-81a1-52f35313e3ec None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:08.192992 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c7ff5-7905-4268-81a1-52f35313e3ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:08.193492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c7ff5-7905-4268-81a1-52f35313e3ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:08.195709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c7ff5-7905-4268-81a1-52f35313e3ec None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:08.211966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 286/570] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:56:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:08.213198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c7ff5-7905-4268-81a1-52f35313e3ec None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:08.305757 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1af5c5-b7ea-4a74-b03c-9d43981ab5a0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:08.371880 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39af11a-8da8-43cb-bebc-16e85acc9a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:08.372671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39af11a-8da8-43cb-bebc-16e85acc9a5d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:08.373040 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39af11a-8da8-43cb-bebc-16e85acc9a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:08.373425 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39af11a-8da8-43cb-bebc-16e85acc9a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:08.388412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39af11a-8da8-43cb-bebc-16e85acc9a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:08.389045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c7ff5-7905-4268-81a1-52f35313e3ec None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:08.390165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39af11a-8da8-43cb-bebc-16e85acc9a5d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:08.398134 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:08.411223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-a39af11a-8da8-43cb-bebc-16e85acc9a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:08.411223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:08.411223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:08.411223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:08.411223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:08.411223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:08.411223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:08.411223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:08.411223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:08.411223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:08.411223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:08.411223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:08.411223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:08.411223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:08.411223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:08.419074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:08.421115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:08.421115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:08.421115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:08.421115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:08.421115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 285/571] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:08.421115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39af11a-8da8-43cb-bebc-16e85acc9a5d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:08.441895 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f51f0-2f93-465e-8ea9-ebd4301523d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:08.442579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f51f0-2f93-465e-8ea9-ebd4301523d8 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:08.442875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f51f0-2f93-465e-8ea9-ebd4301523d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:08.443138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f51f0-2f93-465e-8ea9-ebd4301523d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:08.443936 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f51f0-2f93-465e-8ea9-ebd4301523d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:08.444240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f51f0-2f93-465e-8ea9-ebd4301523d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:08.445795 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f51f0-2f93-465e-8ea9-ebd4301523d8 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:08.460781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 287/572] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:08.461748 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f51f0-2f93-465e-8ea9-ebd4301523d8 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:08.526139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:08.580382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39af11a-8da8-43cb-bebc-16e85acc9a5d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:08.632150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc9411-7760-4306-be05-c7f5d5aff56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:08.633111 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc9411-7760-4306-be05-c7f5d5aff56e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:08.633568 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc9411-7760-4306-be05-c7f5d5aff56e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:08.633897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc9411-7760-4306-be05-c7f5d5aff56e None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:08.635221 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc9411-7760-4306-be05-c7f5d5aff56e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:08.635726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc9411-7760-4306-be05-c7f5d5aff56e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:08.638768 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc9411-7760-4306-be05-c7f5d5aff56e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:08.654692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f51f0-2f93-465e-8ea9-ebd4301523d8 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:08.666256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 286/573] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:08.666256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756f165-01b4-4382-9647-c5c316814365 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:08.666256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756f165-01b4-4382-9647-c5c316814365 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:08.666256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756f165-01b4-4382-9647-c5c316814365 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:08.666978 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 287/574] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:08.668423 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756f165-01b4-4382-9647-c5c316814365 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:08.736676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f7073-0392-497b-a46c-e6e3e98b5dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:08.737793 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f7073-0392-497b-a46c-e6e3e98b5dec None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:08.738314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f7073-0392-497b-a46c-e6e3e98b5dec None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:08.738852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f7073-0392-497b-a46c-e6e3e98b5dec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:08.753866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f7073-0392-497b-a46c-e6e3e98b5dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:08.755456 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f7073-0392-497b-a46c-e6e3e98b5dec None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:08.775983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-600f7073-0392-497b-a46c-e6e3e98b5dec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:08.775983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:08.775983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:08.775983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:08.775983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:08.775983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:08.775983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:08.775983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:08.775983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:08.775983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:08.775983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:08.775983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:08.775983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:08.775983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:08.775983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:08.778598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:08.780301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:08.780301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:08.780301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:08.780301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:08.780301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 288/575] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:08.781231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f7073-0392-497b-a46c-e6e3e98b5dec None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:08.791000 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:08.881984 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756f165-01b4-4382-9647-c5c316814365 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:08.935256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:08.957151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813ca3f-53be-4ac9-a54d-1188aa8d6312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:08.958263 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813ca3f-53be-4ac9-a54d-1188aa8d6312 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:08.958811 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813ca3f-53be-4ac9-a54d-1188aa8d6312 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:08.959004 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f7073-0392-497b-a46c-e6e3e98b5dec None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:08.959316 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813ca3f-53be-4ac9-a54d-1188aa8d6312 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:08.960699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813ca3f-53be-4ac9-a54d-1188aa8d6312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:08.961256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813ca3f-53be-4ac9-a54d-1188aa8d6312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:08.964968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813ca3f-53be-4ac9-a54d-1188aa8d6312 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:08.991569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 288/576] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:08.993006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813ca3f-53be-4ac9-a54d-1188aa8d6312 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:09.026315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d5d69-9596-4a1a-8239-c8ea209eecf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:09.027472 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d5d69-9596-4a1a-8239-c8ea209eecf2 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:09.028015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d5d69-9596-4a1a-8239-c8ea209eecf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:09.028709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d5d69-9596-4a1a-8239-c8ea209eecf2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:09.043679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d5d69-9596-4a1a-8239-c8ea209eecf2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:09.046467 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d5d69-9596-4a1a-8239-c8ea209eecf2 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-797d5d69-9596-4a1a-8239-c8ea209eecf2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:09.070729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:09.072485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:09.074590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:09.074590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:09.074590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:09.074590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:09.074590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:09.074590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:09.074590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:09.074590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:09.074590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:56:09.074590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:09.074590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 289/577] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:56:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:09.075972 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce37b2d-e3ee-47cb-ab50-5d67820b7b03 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:09.076294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce37b2d-e3ee-47cb-ab50-5d67820b7b03 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:09.078894 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce37b2d-e3ee-47cb-ab50-5d67820b7b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:09.108091 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-6ce37b2d-e3ee-47cb-ab50-5d67820b7b03 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:09.109374 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6ce37b2d-e3ee-47cb-ab50-5d67820b7b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:09.190499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813ca3f-53be-4ac9-a54d-1188aa8d6312 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:09.222180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:09.240155 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 290/578] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:09.246470 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce37b2d-e3ee-47cb-ab50-5d67820b7b03 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:09.250875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a7c88-012b-46c2-b9ce-2de84eb8c75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:09.252228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a7c88-012b-46c2-b9ce-2de84eb8c75b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:09.252711 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a7c88-012b-46c2-b9ce-2de84eb8c75b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:09.253247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a7c88-012b-46c2-b9ce-2de84eb8c75b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:09.254853 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a7c88-012b-46c2-b9ce-2de84eb8c75b None admin] RBAC: Adding query filter params (role.id=ce31429587b44a7aafb4f600c011be4a, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=013ae8b88160433db6876f84947f0d8c) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:09.255392 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a7c88-012b-46c2-b9ce-2de84eb8c75b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:09.257882 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a7c88-012b-46c2-b9ce-2de84eb8c75b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:09.268035 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 289/579] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:08 2022] GET /identity/v3/role_assignments?user.id=013ae8b88160433db6876f84947f0d8c&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=ce31429587b44a7aafb4f600c011be4a => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:09.269553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a7c88-012b-46c2-b9ce-2de84eb8c75b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:09.409227 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:09.455938 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce37b2d-e3ee-47cb-ab50-5d67820b7b03 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:09.504639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a7c88-012b-46c2-b9ce-2de84eb8c75b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:09.518973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8870a80-9606-4d0f-b552-a6bce62e7cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:09.519996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8870a80-9606-4d0f-b552-a6bce62e7cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:09.520477 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8870a80-9606-4d0f-b552-a6bce62e7cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:09.520947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8870a80-9606-4d0f-b552-a6bce62e7cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:09.522188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8870a80-9606-4d0f-b552-a6bce62e7cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:09.522735 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8870a80-9606-4d0f-b552-a6bce62e7cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:09.525090 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8870a80-9606-4d0f-b552-a6bce62e7cf1 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:09.553272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 291/580] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:09.554725 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8870a80-9606-4d0f-b552-a6bce62e7cf1 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:09.596446 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10126a72-448e-45ec-9d4f-ac004e87b2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:09.597559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10126a72-448e-45ec-9d4f-ac004e87b2ef None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:09.598057 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10126a72-448e-45ec-9d4f-ac004e87b2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:09.598665 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10126a72-448e-45ec-9d4f-ac004e87b2ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:09.612638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10126a72-448e-45ec-9d4f-ac004e87b2ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:09.615157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10126a72-448e-45ec-9d4f-ac004e87b2ef None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:09.640747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-10126a72-448e-45ec-9d4f-ac004e87b2ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:09.640747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:09.640747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:09.640747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:09.640747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:09.640747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:09.640747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:09.640747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:09.640747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:09.640747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:09.640747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:09.640747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:09.640747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:09.640747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:09.640747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:09.642669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:09.645331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:09.645331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:09.645331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:09.645331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:09.645331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:09.645331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:09.645331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:09.645331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:09.650898 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 290/581] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:09.652257 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10126a72-448e-45ec-9d4f-ac004e87b2ef None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:09.749457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:09.781444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8870a80-9606-4d0f-b552-a6bce62e7cf1 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:09.852843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae09187-d770-4100-b4ba-462319ce98b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:09.853957 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae09187-d770-4100-b4ba-462319ce98b5 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:09.854435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae09187-d770-4100-b4ba-462319ce98b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:09.854926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae09187-d770-4100-b4ba-462319ce98b5 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:09.856486 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae09187-d770-4100-b4ba-462319ce98b5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:09.857202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae09187-d770-4100-b4ba-462319ce98b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:09.859927 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae09187-d770-4100-b4ba-462319ce98b5 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:09.865398 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:09.874614 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10126a72-448e-45ec-9d4f-ac004e87b2ef None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:09.900220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 292/582] 10.222.0.98 () {56 vars in 1137 bytes} [Tue Jul 26 14:56:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:09.901774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae09187-d770-4100-b4ba-462319ce98b5 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:09.943735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd94c1-bc30-4eb1-a2df-ad053208690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:09.944847 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd94c1-bc30-4eb1-a2df-ad053208690f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:09.945349 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd94c1-bc30-4eb1-a2df-ad053208690f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:09.945835 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd94c1-bc30-4eb1-a2df-ad053208690f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:09.968982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd94c1-bc30-4eb1-a2df-ad053208690f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-05dd94c1-bc30-4eb1-a2df-ad053208690f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:09.979612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:09.980762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:09.982171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:09.982171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:09.982171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:09.982171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:09.982171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:09.982171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:09.982171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:09.982171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:09.982171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:09.982171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:09.982171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:09.982171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:09.983389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 291/583] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:09.984881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd94c1-bc30-4eb1-a2df-ad053208690f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:10.113425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae09187-d770-4100-b4ba-462319ce98b5 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:10.198869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b54ce-f2ee-4e1e-9132-c800a7313e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:10.201110 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b54ce-f2ee-4e1e-9132-c800a7313e9d None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:10.202077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b54ce-f2ee-4e1e-9132-c800a7313e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:10.202619 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b54ce-f2ee-4e1e-9132-c800a7313e9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:10.211810 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd94c1-bc30-4eb1-a2df-ad053208690f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:10.214230 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:10.220972 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b54ce-f2ee-4e1e-9132-c800a7313e9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:10.221830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b54ce-f2ee-4e1e-9132-c800a7313e9d None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-636b54ce-f2ee-4e1e-9132-c800a7313e9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:10.250268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:10.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:10.252272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:10.252272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:10.252272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:10.252272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:10.252272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:10.252272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:10.252272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:10.252272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:10.252272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:56:10.252272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:10.252809 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 293/584] 10.222.0.98 () {56 vars in 1093 bytes} [Tue Jul 26 14:56:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:10.254170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b54ce-f2ee-4e1e-9132-c800a7313e9d None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:10.290386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bc45d-9121-4135-8830-e887d3db0842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:10.291222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bc45d-9121-4135-8830-e887d3db0842 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:10.291650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bc45d-9121-4135-8830-e887d3db0842 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:10.292111 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bc45d-9121-4135-8830-e887d3db0842 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:10.293287 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bc45d-9121-4135-8830-e887d3db0842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:10.294411 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bc45d-9121-4135-8830-e887d3db0842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:10.296360 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bc45d-9121-4135-8830-e887d3db0842 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:10.324225 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 292/585] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:10.326114 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bc45d-9121-4135-8830-e887d3db0842 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:10.366644 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:10.444273 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b54ce-f2ee-4e1e-9132-c800a7313e9d None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:10.522985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bc45d-9121-4135-8830-e887d3db0842 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:10.529164 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f64bd-25dc-4617-8510-05a4d3199bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:10.530333 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f64bd-25dc-4617-8510-05a4d3199bdd None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:10.530759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f64bd-25dc-4617-8510-05a4d3199bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:10.531295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f64bd-25dc-4617-8510-05a4d3199bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:10.556371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f64bd-25dc-4617-8510-05a4d3199bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:10.559843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f64bd-25dc-4617-8510-05a4d3199bdd None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:10.590618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-b19f64bd-25dc-4617-8510-05a4d3199bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:10.590618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:10.590618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:10.590618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:10.590618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:10.590618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:10.590618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:10.590618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:10.590618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:10.590618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:10.590618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:10.590618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:10.590618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:10.590618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:10.590618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:10.591709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:10.592686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:10.592686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:10.592686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:10.592686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:10.592928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 294/586] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:10.594449 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f64bd-25dc-4617-8510-05a4d3199bdd None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:10.608651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5b3d8-7d58-481c-bb67-ea453ea051f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:10.609674 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5b3d8-7d58-481c-bb67-ea453ea051f4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:10.610190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5b3d8-7d58-481c-bb67-ea453ea051f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:10.610720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5b3d8-7d58-481c-bb67-ea453ea051f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:10.611786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5b3d8-7d58-481c-bb67-ea453ea051f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:10.613406 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5b3d8-7d58-481c-bb67-ea453ea051f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:10.615262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5b3d8-7d58-481c-bb67-ea453ea051f4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:10.627797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 293/587] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:56:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:10.629715 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5b3d8-7d58-481c-bb67-ea453ea051f4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:10.671223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:10.815961 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f64bd-25dc-4617-8510-05a4d3199bdd None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:10.818956 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5b3d8-7d58-481c-bb67-ea453ea051f4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:10.832612 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:10.884841 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cef07-a4de-4542-b67d-caeac5961dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:10.887704 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cef07-a4de-4542-b67d-caeac5961dad None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:10.888100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cef07-a4de-4542-b67d-caeac5961dad None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:10.889132 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cef07-a4de-4542-b67d-caeac5961dad None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:10.890464 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cef07-a4de-4542-b67d-caeac5961dad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:10.891009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cef07-a4de-4542-b67d-caeac5961dad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:10.893831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cef07-a4de-4542-b67d-caeac5961dad None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:10.907115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58e9f0-5834-4b4e-b52f-703ab8fb6191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:10.908439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58e9f0-5834-4b4e-b52f-703ab8fb6191 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:10.909002 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58e9f0-5834-4b4e-b52f-703ab8fb6191 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:10.909514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58e9f0-5834-4b4e-b52f-703ab8fb6191 None admin] PATH_INFO: `/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/4d85dc9f9f15480db927e617c992e1a1/roles/ce31429587b44a7aafb4f600c011be4a` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:10.928889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 295/588] 10.222.0.98 () {56 vars in 1133 bytes} [Tue Jul 26 14:56:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:10.928889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cef07-a4de-4542-b67d-caeac5961dad None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:10.943716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58e9f0-5834-4b4e-b52f-703ab8fb6191 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f750777b75f49a19a5019c4fc2c00f5, user_id=4d85dc9f9f15480db927e617c992e1a1, role_id=ce31429587b44a7aafb4f600c011be4a)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:10.946954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58e9f0-5834-4b4e-b52f-703ab8fb6191 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:11.052091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 294/589] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:56:10 2022] PUT /identity/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/4d85dc9f9f15480db927e617c992e1a1/roles/ce31429587b44a7aafb4f600c011be4a => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:56:11.063911 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58e9f0-5834-4b4e-b52f-703ab8fb6191 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:11.132920 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cef07-a4de-4542-b67d-caeac5961dad None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:11.209807 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383852f-feea-48a7-a487-b94459673a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:11.211581 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383852f-feea-48a7-a487-b94459673a2b None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:11.212383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383852f-feea-48a7-a487-b94459673a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:11.213270 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383852f-feea-48a7-a487-b94459673a2b None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:11.215206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383852f-feea-48a7-a487-b94459673a2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:11.216126 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383852f-feea-48a7-a487-b94459673a2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:11.218472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:11.220957 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383852f-feea-48a7-a487-b94459673a2b None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:11.245427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 296/590] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:11.248257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383852f-feea-48a7-a487-b94459673a2b None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:11.278819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58e9f0-5834-4b4e-b52f-703ab8fb6191 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:11.306210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:11.352175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68a047-b762-4897-ad41-8f6ba5f1e4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:11.352175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68a047-b762-4897-ad41-8f6ba5f1e4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:11.352175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68a047-b762-4897-ad41-8f6ba5f1e4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:11.352175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68a047-b762-4897-ad41-8f6ba5f1e4b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:11.374538 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68a047-b762-4897-ad41-8f6ba5f1e4b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:11.377264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68a047-b762-4897-ad41-8f6ba5f1e4b3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:11.403936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-7d68a047-b762-4897-ad41-8f6ba5f1e4b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:11.403936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:11.403936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:11.403936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:11.403936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:11.403936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:11.403936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:11.403936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:11.403936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:11.403936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:11.403936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:11.403936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:11.403936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:11.403936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:11.403936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:11.405635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:11.408885 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:11.408885 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:11.408885 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:11.408885 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:11.408885 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 295/591] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:11.412044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68a047-b762-4897-ad41-8f6ba5f1e4b3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:11.457810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383852f-feea-48a7-a487-b94459673a2b None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:11.550329 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f55e90-d4bd-4e1c-8efc-883a0cfcbf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:11.551039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f55e90-d4bd-4e1c-8efc-883a0cfcbf6e None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:11.551358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f55e90-d4bd-4e1c-8efc-883a0cfcbf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:11.551649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f55e90-d4bd-4e1c-8efc-883a0cfcbf6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:11.579024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f55e90-d4bd-4e1c-8efc-883a0cfcbf6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:11.582038 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68a047-b762-4897-ad41-8f6ba5f1e4b3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:11.584320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f55e90-d4bd-4e1c-8efc-883a0cfcbf6e None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:11.616678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-72f55e90-d4bd-4e1c-8efc-883a0cfcbf6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:11.616678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:11.616678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:11.616678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:11.616678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:11.616678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:11.616678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:11.616678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:11.616678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:11.616678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:11.616678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:11.616678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:11.616678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:11.616678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:11.616678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:11.618471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:11.620862 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:11.620862 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:11.620862 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:11.620862 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:11.622825 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:11.625521 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 297/592] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:11.627559 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f55e90-d4bd-4e1c-8efc-883a0cfcbf6e None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:11.638318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9e924-dbf1-426e-b24a-a90fadc405f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:11.639344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9e924-dbf1-426e-b24a-a90fadc405f2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:11.639753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9e924-dbf1-426e-b24a-a90fadc405f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:11.642306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9e924-dbf1-426e-b24a-a90fadc405f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:11.652980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9e924-dbf1-426e-b24a-a90fadc405f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:11.656760 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9e924-dbf1-426e-b24a-a90fadc405f2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:11.674838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-73b9e924-dbf1-426e-b24a-a90fadc405f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:11.674838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:11.674838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:11.674838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:11.674838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:11.674838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:11.674838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:11.674838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:11.674838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:11.674838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:11.674838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:11.674838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:11.674838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:11.674838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:11.674838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:11.676621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:11.679039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:11.679039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:11.679039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:11.679039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:11.679039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:11.679039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:11.679039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:11.679039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:11.693839 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 296/593] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:11.693839 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9e924-dbf1-426e-b24a-a90fadc405f2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:11.804249 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:11.851895 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f55e90-d4bd-4e1c-8efc-883a0cfcbf6e None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:11.853047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9e924-dbf1-426e-b24a-a90fadc405f2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:11.920553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c878132-fbb6-47e2-9515-eb132b124d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:11.922116 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c878132-fbb6-47e2-9515-eb132b124d90 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:11.922312 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d1ea-9c21-4437-ba65-bc2c301881d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:11.923181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c878132-fbb6-47e2-9515-eb132b124d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:11.923544 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d1ea-9c21-4437-ba65-bc2c301881d2 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:11.924119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d1ea-9c21-4437-ba65-bc2c301881d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:11.924447 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c878132-fbb6-47e2-9515-eb132b124d90 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:11.924677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d1ea-9c21-4437-ba65-bc2c301881d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:11.926205 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935d1ea-9c21-4437-ba65-bc2c301881d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:11.926631 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c878132-fbb6-47e2-9515-eb132b124d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:11.926962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935d1ea-9c21-4437-ba65-bc2c301881d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:11.927613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c878132-fbb6-47e2-9515-eb132b124d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:11.929677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c878132-fbb6-47e2-9515-eb132b124d90 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:11.929822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935d1ea-9c21-4437-ba65-bc2c301881d2 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:11.953628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 297/594] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:11.955369 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c878132-fbb6-47e2-9515-eb132b124d90 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:11.962945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 298/595] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:11.964752 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d1ea-9c21-4437-ba65-bc2c301881d2 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:12.091330 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:12.164404 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d1ea-9c21-4437-ba65-bc2c301881d2 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:12.233534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b71e44-d036-4b42-afe8-08374f942809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:12.236500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b71e44-d036-4b42-afe8-08374f942809 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:12.237343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b71e44-d036-4b42-afe8-08374f942809 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:12.238002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b71e44-d036-4b42-afe8-08374f942809 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:12.239291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c878132-fbb6-47e2-9515-eb132b124d90 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:12.244920 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:12.253099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b71e44-d036-4b42-afe8-08374f942809 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:12.256409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b71e44-d036-4b42-afe8-08374f942809 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:12.279806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-14b71e44-d036-4b42-afe8-08374f942809 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:12.279806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:12.279806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:12.279806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:12.279806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:12.279806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:12.279806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:12.279806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:12.279806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:12.279806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:12.279806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:12.279806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:12.279806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:12.279806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:12.279806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:12.280782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:12.281654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:12.281654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:12.281654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:12.281654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:12.281654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:12.281654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:12.281654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:12.281654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:12.284286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 299/596] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:12.287689 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b71e44-d036-4b42-afe8-08374f942809 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:12.331686 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1e681-0566-4744-9aef-f972f42094f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:12.332818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1e681-0566-4744-9aef-f972f42094f8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:12.333325 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1e681-0566-4744-9aef-f972f42094f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:12.335292 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1e681-0566-4744-9aef-f972f42094f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:12.336060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1e681-0566-4744-9aef-f972f42094f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:12.336060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1e681-0566-4744-9aef-f972f42094f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:12.338929 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1e681-0566-4744-9aef-f972f42094f8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:12.381824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 298/597] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:12.381824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb38ebe-104b-4cd2-8819-91812975cfd7 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:12.381824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb38ebe-104b-4cd2-8819-91812975cfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:12.381824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb38ebe-104b-4cd2-8819-91812975cfd7 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:12.381824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 299/598] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:12.381824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb38ebe-104b-4cd2-8819-91812975cfd7 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:12.503714 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b71e44-d036-4b42-afe8-08374f942809 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:12.581969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b281b47-e3a3-4038-a37d-803275bc0fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:12.583076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b281b47-e3a3-4038-a37d-803275bc0fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:12.583525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b281b47-e3a3-4038-a37d-803275bc0fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:12.584020 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b281b47-e3a3-4038-a37d-803275bc0fd1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:12.608452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b281b47-e3a3-4038-a37d-803275bc0fd1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:12.611262 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b281b47-e3a3-4038-a37d-803275bc0fd1 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:12.614164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb38ebe-104b-4cd2-8819-91812975cfd7 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-4b281b47-e3a3-4038-a37d-803275bc0fd1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:12.628344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:12.630255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:12.632169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:12.632169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:12.632169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:12.632169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:12.632169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:12.632169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:12.632169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:12.632169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:12.632169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:56:12.632169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:12.632169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 300/599] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:12.632169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b281b47-e3a3-4038-a37d-803275bc0fd1 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:12.641401 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:12.703915 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f76e3-50ca-45cd-8de2-5ee8ae2d95fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:12.705242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f76e3-50ca-45cd-8de2-5ee8ae2d95fa None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:12.705520 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f76e3-50ca-45cd-8de2-5ee8ae2d95fa None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:12.705923 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f76e3-50ca-45cd-8de2-5ee8ae2d95fa None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:12.707206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f76e3-50ca-45cd-8de2-5ee8ae2d95fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:12.707789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f76e3-50ca-45cd-8de2-5ee8ae2d95fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:12.710253 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f76e3-50ca-45cd-8de2-5ee8ae2d95fa None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:12.735115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 300/600] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:12.737511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98770c3-2534-4daa-bcfc-7b4a273e86d0 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:12.738007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98770c3-2534-4daa-bcfc-7b4a273e86d0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:12.738520 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98770c3-2534-4daa-bcfc-7b4a273e86d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:12.770239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a98770c3-2534-4daa-bcfc-7b4a273e86d0 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:12.772221 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a98770c3-2534-4daa-bcfc-7b4a273e86d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:12.781726 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:12.905029 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b281b47-e3a3-4038-a37d-803275bc0fd1 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:12.955481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 301/601] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:12.957259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98770c3-2534-4daa-bcfc-7b4a273e86d0 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:12.971880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b9d1a-0396-493d-b406-5455057bd271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:12.973087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b9d1a-0396-493d-b406-5455057bd271 None admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:12.973624 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b9d1a-0396-493d-b406-5455057bd271 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:12.974146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b9d1a-0396-493d-b406-5455057bd271 None admin] PATH_INFO: `/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/96d09fca7f864129ab0dcb90fb5d24e3/roles/ce31429587b44a7aafb4f600c011be4a` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:12.995080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b9d1a-0396-493d-b406-5455057bd271 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f750777b75f49a19a5019c4fc2c00f5, user_id=96d09fca7f864129ab0dcb90fb5d24e3, role_id=ce31429587b44a7aafb4f600c011be4a)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:12.996792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b9d1a-0396-493d-b406-5455057bd271 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:13.114754 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 301/602] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:56:12 2022] PUT /identity/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/96d09fca7f864129ab0dcb90fb5d24e3/roles/ce31429587b44a7aafb4f600c011be4a => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:56:13.116163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b9d1a-0396-493d-b406-5455057bd271 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:13.182128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:13.191336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98770c3-2534-4daa-bcfc-7b4a273e86d0 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:13.280727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b350822-ca68-443a-a27d-b8c14e0066ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:13.281815 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b350822-ca68-443a-a27d-b8c14e0066ec None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:13.282469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b350822-ca68-443a-a27d-b8c14e0066ec None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:13.283595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b350822-ca68-443a-a27d-b8c14e0066ec None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:13.284692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b350822-ca68-443a-a27d-b8c14e0066ec None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:13.285340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b350822-ca68-443a-a27d-b8c14e0066ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:13.288272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b350822-ca68-443a-a27d-b8c14e0066ec None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:13.332272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 302/603] 10.222.0.98 () {56 vars in 1139 bytes} [Tue Jul 26 14:56:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:13.332272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b350822-ca68-443a-a27d-b8c14e0066ec None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:13.398944 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b9d1a-0396-493d-b406-5455057bd271 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:13.426190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:13.500334 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4333d7-ca33-45b1-b1cf-b98719956f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:13.501483 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4333d7-ca33-45b1-b1cf-b98719956f48 None admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:13.501963 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4333d7-ca33-45b1-b1cf-b98719956f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:13.502531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4333d7-ca33-45b1-b1cf-b98719956f48 None admin] PATH_INFO: `/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/a4a6c0e7ca434010980d7cac1800dbe9/roles/ce31429587b44a7aafb4f600c011be4a` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:13.550589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4333d7-ca33-45b1-b1cf-b98719956f48 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f750777b75f49a19a5019c4fc2c00f5, user_id=a4a6c0e7ca434010980d7cac1800dbe9, role_id=ce31429587b44a7aafb4f600c011be4a)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:13.553576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4333d7-ca33-45b1-b1cf-b98719956f48 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:13.618576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b350822-ca68-443a-a27d-b8c14e0066ec None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:13.694677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 302/604] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:56:13 2022] PUT /identity/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/a4a6c0e7ca434010980d7cac1800dbe9/roles/ce31429587b44a7aafb4f600c011be4a => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:56:13.694677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4333d7-ca33-45b1-b1cf-b98719956f48 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:13.728281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da25968-c205-4acb-8e05-c240e323bf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:13.729538 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da25968-c205-4acb-8e05-c240e323bf39 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:13.730115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da25968-c205-4acb-8e05-c240e323bf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:13.731376 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da25968-c205-4acb-8e05-c240e323bf39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:13.786605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da25968-c205-4acb-8e05-c240e323bf39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-2da25968-c205-4acb-8e05-c240e323bf39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:13.802695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:13.804521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:13.806185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:13.806185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:13.806185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:13.806185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:13.806185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:13.806185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:13.806185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:13.806185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:13.806185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:13.806185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:13.806185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:13.806185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:13.806185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 303/605] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 473 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:13.812572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da25968-c205-4acb-8e05-c240e323bf39 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:13.894966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:14.065972 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4333d7-ca33-45b1-b1cf-b98719956f48 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:14.158983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da25968-c205-4acb-8e05-c240e323bf39 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:14.161443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed11c7-e926-4e3f-a877-30984ccfa0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:14.163122 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed11c7-e926-4e3f-a877-30984ccfa0aa None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:14.164021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed11c7-e926-4e3f-a877-30984ccfa0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:14.164793 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed11c7-e926-4e3f-a877-30984ccfa0aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:14.187099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed11c7-e926-4e3f-a877-30984ccfa0aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:14.190842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed11c7-e926-4e3f-a877-30984ccfa0aa None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:14.222943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-03ed11c7-e926-4e3f-a877-30984ccfa0aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:14.222943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:14.222943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:14.222943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:14.222943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:14.222943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:14.222943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:14.222943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:14.222943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:14.222943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:14.222943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:14.222943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:14.222943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:14.222943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:14.222943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:14.224632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:14.226272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:14.226272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:14.226272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:14.226272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:14.230321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 303/606] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 540 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:14.239152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaccee4-ddee-4b2b-afaa-fae2594ceba3 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:14.239651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaccee4-ddee-4b2b-afaa-fae2594ceba3 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:14.240140 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaccee4-ddee-4b2b-afaa-fae2594ceba3 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:14.243593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 304/607] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:14.244948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aea30f-2059-42e2-bfdf-e46b2fc09aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:14.245177 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaccee4-ddee-4b2b-afaa-fae2594ceba3 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:14.247375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aea30f-2059-42e2-bfdf-e46b2fc09aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:14.248195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aea30f-2059-42e2-bfdf-e46b2fc09aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:14.249039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aea30f-2059-42e2-bfdf-e46b2fc09aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:14.250646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aea30f-2059-42e2-bfdf-e46b2fc09aa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:14.251437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aea30f-2059-42e2-bfdf-e46b2fc09aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:14.253677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aea30f-2059-42e2-bfdf-e46b2fc09aa3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:14.267197 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 304/608] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:56:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:14.268997 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829abad-2c78-4b35-8ad2-a74a5188d919 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:14.269719 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829abad-2c78-4b35-8ad2-a74a5188d919 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:14.270285 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829abad-2c78-4b35-8ad2-a74a5188d919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:14.280063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:14.301891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e829abad-2c78-4b35-8ad2-a74a5188d919 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:14.304738 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e829abad-2c78-4b35-8ad2-a74a5188d919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:14.463576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaccee4-ddee-4b2b-afaa-fae2594ceba3 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:14.472994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 305/609] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:14.475076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829abad-2c78-4b35-8ad2-a74a5188d919 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:14.498273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:14.534888 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218899e-df5b-469d-a0fd-2a13c7d5167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:14.535883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218899e-df5b-469d-a0fd-2a13c7d5167f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:14.536351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218899e-df5b-469d-a0fd-2a13c7d5167f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:14.536827 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218899e-df5b-469d-a0fd-2a13c7d5167f None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:14.538050 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218899e-df5b-469d-a0fd-2a13c7d5167f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:14.538822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218899e-df5b-469d-a0fd-2a13c7d5167f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:14.541365 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218899e-df5b-469d-a0fd-2a13c7d5167f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:14.567809 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 305/610] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:14.569125 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218899e-df5b-469d-a0fd-2a13c7d5167f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:14.663484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829abad-2c78-4b35-8ad2-a74a5188d919 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:14.676717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:14.712837 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e6ce9-0c6c-4658-81e2-9d2e8e9f8931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:14.713521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e6ce9-0c6c-4658-81e2-9d2e8e9f8931 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:14.714313 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e6ce9-0c6c-4658-81e2-9d2e8e9f8931 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:14.715109 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e6ce9-0c6c-4658-81e2-9d2e8e9f8931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:14.740966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218899e-df5b-469d-a0fd-2a13c7d5167f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:14.741761 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e6ce9-0c6c-4658-81e2-9d2e8e9f8931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:14.744424 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e6ce9-0c6c-4658-81e2-9d2e8e9f8931 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:14.767598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-788e6ce9-0c6c-4658-81e2-9d2e8e9f8931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:14.767598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:14.767598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:14.767598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:14.767598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:14.767598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:14.767598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:14.767598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:14.767598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:14.767598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:14.767598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:14.767598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:14.767598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:14.767598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:14.767598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:14.769525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:14.772303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:14.772303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:14.772303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:14.772303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:14.772303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 306/611] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:14.772303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e6ce9-0c6c-4658-81e2-9d2e8e9f8931 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:14.820766 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea280ef9-938b-4f1b-9ef5-01af9c1ad31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:14.822147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280ef9-938b-4f1b-9ef5-01af9c1ad31f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:14.823138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280ef9-938b-4f1b-9ef5-01af9c1ad31f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:14.823354 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280ef9-938b-4f1b-9ef5-01af9c1ad31f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:14.847250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea280ef9-938b-4f1b-9ef5-01af9c1ad31f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-ea280ef9-938b-4f1b-9ef5-01af9c1ad31f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:14.857690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:14.860633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:14.863438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:14.863438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:14.863438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:14.863438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:14.863438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:14.863438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:14.863438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:14.863438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:14.863438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:14.863438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:14.863438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:14.863438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:14.872344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 306/612] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:14.872344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea280ef9-938b-4f1b-9ef5-01af9c1ad31f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:14.911562 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:15.015099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e6ce9-0c6c-4658-81e2-9d2e8e9f8931 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:15.103989 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c985b45-fc27-47d4-9a76-e9b3d0bb194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:15.105995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c985b45-fc27-47d4-9a76-e9b3d0bb194b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:15.106878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c985b45-fc27-47d4-9a76-e9b3d0bb194b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:15.107663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c985b45-fc27-47d4-9a76-e9b3d0bb194b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:15.125628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c985b45-fc27-47d4-9a76-e9b3d0bb194b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:15.129812 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c985b45-fc27-47d4-9a76-e9b3d0bb194b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:15.141300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea280ef9-938b-4f1b-9ef5-01af9c1ad31f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:15.157999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-0c985b45-fc27-47d4-9a76-e9b3d0bb194b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:15.157999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:15.157999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:15.157999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:15.157999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:15.157999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:15.157999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:15.157999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:15.157999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:15.157999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:15.157999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:15.157999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:15.157999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:15.157999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:15.157999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:15.159717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:15.162611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:15.162611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:15.162611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:15.162611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:15.162611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:15.162611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:15.162611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:15.162611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:15.175005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 307/613] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:15.175005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c985b45-fc27-47d4-9a76-e9b3d0bb194b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:15.212548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:15.229699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79a0d2-bd27-45a5-bfa6-3f9db06239f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:15.231420 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79a0d2-bd27-45a5-bfa6-3f9db06239f2 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:15.231927 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79a0d2-bd27-45a5-bfa6-3f9db06239f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:15.232430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79a0d2-bd27-45a5-bfa6-3f9db06239f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:15.234211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79a0d2-bd27-45a5-bfa6-3f9db06239f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:15.234786 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79a0d2-bd27-45a5-bfa6-3f9db06239f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:15.238724 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79a0d2-bd27-45a5-bfa6-3f9db06239f2 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:15.274766 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 307/614] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:15.277859 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79a0d2-bd27-45a5-bfa6-3f9db06239f2 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:15.408662 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c985b45-fc27-47d4-9a76-e9b3d0bb194b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:15.441296 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:15.473955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f8cb0-2a25-4e17-83da-0bfbf245ef10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:15.475571 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f8cb0-2a25-4e17-83da-0bfbf245ef10 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:15.476445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f8cb0-2a25-4e17-83da-0bfbf245ef10 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:15.477200 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f8cb0-2a25-4e17-83da-0bfbf245ef10 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:15.479454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f8cb0-2a25-4e17-83da-0bfbf245ef10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:15.480535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f8cb0-2a25-4e17-83da-0bfbf245ef10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:15.483850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f8cb0-2a25-4e17-83da-0bfbf245ef10 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:15.496826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79a0d2-bd27-45a5-bfa6-3f9db06239f2 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:15.506071 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 308/615] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:56:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:15.508064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f8cb0-2a25-4e17-83da-0bfbf245ef10 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:15.575628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931521cd-0e7e-4c98-ad71-2b211495ccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:15.576791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931521cd-0e7e-4c98-ad71-2b211495ccf2 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:15.577261 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931521cd-0e7e-4c98-ad71-2b211495ccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:15.577727 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931521cd-0e7e-4c98-ad71-2b211495ccf2 None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:15.579133 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931521cd-0e7e-4c98-ad71-2b211495ccf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:15.579650 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931521cd-0e7e-4c98-ad71-2b211495ccf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:15.582187 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931521cd-0e7e-4c98-ad71-2b211495ccf2 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:15.610418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 308/616] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:15.610418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931521cd-0e7e-4c98-ad71-2b211495ccf2 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:15.711104 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:15.744532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f8cb0-2a25-4e17-83da-0bfbf245ef10 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:15.799429 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931521cd-0e7e-4c98-ad71-2b211495ccf2 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:15.818259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b533ce-4898-462e-81ed-8ab79944f1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:15.820051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b533ce-4898-462e-81ed-8ab79944f1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:15.820878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b533ce-4898-462e-81ed-8ab79944f1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:15.821844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b533ce-4898-462e-81ed-8ab79944f1e4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:15.849148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b533ce-4898-462e-81ed-8ab79944f1e4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:15.852305 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b533ce-4898-462e-81ed-8ab79944f1e4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:15.873694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ae6d0-04d1-4a15-a828-cdd1d6ea1df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:15.874798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ae6d0-04d1-4a15-a828-cdd1d6ea1df7 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:15.875312 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ae6d0-04d1-4a15-a828-cdd1d6ea1df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:15.875791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ae6d0-04d1-4a15-a828-cdd1d6ea1df7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-39b533ce-4898-462e-81ed-8ab79944f1e4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:15.879069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:15.880939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:15.882823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:15.882823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:15.882823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:15.882823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:15.882823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:15.882823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:15.882823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:15.882823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:15.882823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:56:15.882823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:15.888315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 309/617] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:56:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:15.890273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b533ce-4898-462e-81ed-8ab79944f1e4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:15.899498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ae6d0-04d1-4a15-a828-cdd1d6ea1df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:15.902300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ae6d0-04d1-4a15-a828-cdd1d6ea1df7 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:15.936397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-bb4ae6d0-04d1-4a15-a828-cdd1d6ea1df7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:15.936397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:15.936397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:15.936397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:15.936397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:15.936397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:15.936397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:15.936397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:15.936397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:15.936397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:15.936397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:15.936397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:15.936397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:15.936397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:15.936397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:15.938287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:15.940458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:15.940458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:15.940458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:15.940458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:15.940458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 309/618] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:15.940458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ae6d0-04d1-4a15-a828-cdd1d6ea1df7 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:15.992030 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:16.114344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b533ce-4898-462e-81ed-8ab79944f1e4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:16.185982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:16.192212 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ae6d0-04d1-4a15-a828-cdd1d6ea1df7 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:16.196244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e389ca-4330-49b2-9bd7-cbf22f1c2818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:16.198646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e389ca-4330-49b2-9bd7-cbf22f1c2818 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:16.199291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e389ca-4330-49b2-9bd7-cbf22f1c2818 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:16.199836 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e389ca-4330-49b2-9bd7-cbf22f1c2818 None admin] PATH_INFO: `/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/e44d2d2b50484fb89b0688ff28615d05/roles/ce31429587b44a7aafb4f600c011be4a` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:16.234417 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e389ca-4330-49b2-9bd7-cbf22f1c2818 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f750777b75f49a19a5019c4fc2c00f5, user_id=e44d2d2b50484fb89b0688ff28615d05, role_id=ce31429587b44a7aafb4f600c011be4a)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:16.238039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e389ca-4330-49b2-9bd7-cbf22f1c2818 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:16.260033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf31e10-7c34-4c4b-909f-fcc185a40548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:16.261214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf31e10-7c34-4c4b-909f-fcc185a40548 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:16.262079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf31e10-7c34-4c4b-909f-fcc185a40548 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:16.262692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf31e10-7c34-4c4b-909f-fcc185a40548 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:16.264520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf31e10-7c34-4c4b-909f-fcc185a40548 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:16.265055 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf31e10-7c34-4c4b-909f-fcc185a40548 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:16.266838 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf31e10-7c34-4c4b-909f-fcc185a40548 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:16.291154 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 310/619] 10.222.0.98 () {56 vars in 1135 bytes} [Tue Jul 26 14:56:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:16.292273 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf31e10-7c34-4c4b-909f-fcc185a40548 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:16.376630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 310/620] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:56:15 2022] PUT /identity/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/e44d2d2b50484fb89b0688ff28615d05/roles/ce31429587b44a7aafb4f600c011be4a => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:56:16.378785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e389ca-4330-49b2-9bd7-cbf22f1c2818 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:16.554396 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf31e10-7c34-4c4b-909f-fcc185a40548 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:16.629613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea8396-6457-4a0e-8a91-5ed7377ff924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:16.630750 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea8396-6457-4a0e-8a91-5ed7377ff924 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:16.631263 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea8396-6457-4a0e-8a91-5ed7377ff924 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:16.631749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea8396-6457-4a0e-8a91-5ed7377ff924 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:16.633120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea8396-6457-4a0e-8a91-5ed7377ff924 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:16.633668 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea8396-6457-4a0e-8a91-5ed7377ff924 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:16.637266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea8396-6457-4a0e-8a91-5ed7377ff924 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:16.663138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 311/621] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:16.665912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315210d-b3e9-4fb6-92e4-dce18a3080ec None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:16.666455 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315210d-b3e9-4fb6-92e4-dce18a3080ec None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:16.666963 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315210d-b3e9-4fb6-92e4-dce18a3080ec None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:16.670536 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 312/622] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:16.672652 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315210d-b3e9-4fb6-92e4-dce18a3080ec None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:16.686551 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:16.707914 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:16.725041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e389ca-4330-49b2-9bd7-cbf22f1c2818 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:16.813953 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcb892-f9c6-4ac4-9fa4-55042aa2d372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:16.816393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcb892-f9c6-4ac4-9fa4-55042aa2d372 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:16.817208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcb892-f9c6-4ac4-9fa4-55042aa2d372 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:16.818017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcb892-f9c6-4ac4-9fa4-55042aa2d372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:16.839210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcb892-f9c6-4ac4-9fa4-55042aa2d372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:16.842718 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcb892-f9c6-4ac4-9fa4-55042aa2d372 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:16.868703 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315210d-b3e9-4fb6-92e4-dce18a3080ec None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:16.877509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-e2fcb892-f9c6-4ac4-9fa4-55042aa2d372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:16.877509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:16.877509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:16.877509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:16.877509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:16.877509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:16.877509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:16.877509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:16.877509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:16.877509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:16.877509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:16.877509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:16.877509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:16.877509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:16.877509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:16.879262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:16.881080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:16.881080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:16.881080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:16.881080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:16.885173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 311/623] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 507 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:16.888534 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12666025-c7bc-4fb9-bc2e-f29eab546752 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:16.889488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12666025-c7bc-4fb9-bc2e-f29eab546752 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:16.890311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12666025-c7bc-4fb9-bc2e-f29eab546752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:16.925362 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-12666025-c7bc-4fb9-bc2e-f29eab546752 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:16.928088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-12666025-c7bc-4fb9-bc2e-f29eab546752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:16.947724 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563282c5-18dd-4717-9274-78b3d2b9669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:16.948427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563282c5-18dd-4717-9274-78b3d2b9669b None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:16.948725 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563282c5-18dd-4717-9274-78b3d2b9669b None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:16.949548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563282c5-18dd-4717-9274-78b3d2b9669b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:16.961310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563282c5-18dd-4717-9274-78b3d2b9669b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:16.963618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563282c5-18dd-4717-9274-78b3d2b9669b None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-563282c5-18dd-4717-9274-78b3d2b9669b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:16.979021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:16.980907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:16.983481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:16.983481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:16.983481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:16.983481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:16.983481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:16.983481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:16.983481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:16.983481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:16.983481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:56:16.983481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:16.983481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 313/624] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:56:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:16.983481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563282c5-18dd-4717-9274-78b3d2b9669b None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:17.082532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 312/625] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:17.084373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12666025-c7bc-4fb9-bc2e-f29eab546752 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:17.154449 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:17.208105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563282c5-18dd-4717-9274-78b3d2b9669b None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:17.266386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:17.280919 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99d6e9-4dcc-49e4-b5c6-933e5a603a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:17.282032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99d6e9-4dcc-49e4-b5c6-933e5a603a2a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:17.282577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99d6e9-4dcc-49e4-b5c6-933e5a603a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:17.283707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99d6e9-4dcc-49e4-b5c6-933e5a603a2a None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:17.284521 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99d6e9-4dcc-49e4-b5c6-933e5a603a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:17.285188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99d6e9-4dcc-49e4-b5c6-933e5a603a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:17.287819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99d6e9-4dcc-49e4-b5c6-933e5a603a2a None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:17.318407 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 314/626] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:17.318407 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99d6e9-4dcc-49e4-b5c6-933e5a603a2a None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:17.337094 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12666025-c7bc-4fb9-bc2e-f29eab546752 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:17.431049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e71b5d-2b29-43f8-9c1e-071e8b7b5b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:17.432118 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e71b5d-2b29-43f8-9c1e-071e8b7b5b8b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:17.432700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e71b5d-2b29-43f8-9c1e-071e8b7b5b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:17.433154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e71b5d-2b29-43f8-9c1e-071e8b7b5b8b None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:17.435981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e71b5d-2b29-43f8-9c1e-071e8b7b5b8b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:17.436190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e71b5d-2b29-43f8-9c1e-071e8b7b5b8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:17.439421 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e71b5d-2b29-43f8-9c1e-071e8b7b5b8b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:17.476834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 313/627] 10.222.0.98 () {56 vars in 1137 bytes} [Tue Jul 26 14:56:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:17.479879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3648a-ef71-445b-9ff1-074c755b168b None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:17.479879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3648a-ef71-445b-9ff1-074c755b168b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:17.481279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3648a-ef71-445b-9ff1-074c755b168b None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:17.486870 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 314/628] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:17.488464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3648a-ef71-445b-9ff1-074c755b168b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:17.562090 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99d6e9-4dcc-49e4-b5c6-933e5a603a2a None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:17.646975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0c328-00ec-4b5a-9ea4-77eb86a96ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:17.648117 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0c328-00ec-4b5a-9ea4-77eb86a96ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:17.648661 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0c328-00ec-4b5a-9ea4-77eb86a96ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:17.649162 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0c328-00ec-4b5a-9ea4-77eb86a96ed9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:17.662693 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:17.670263 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0c328-00ec-4b5a-9ea4-77eb86a96ed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-74a0c328-00ec-4b5a-9ea4-77eb86a96ed9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:17.682288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:17.685964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:17.689906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:17.689906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:17.689906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:17.689906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:17.689906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:17.689906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:17.689906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:17.689906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:17.689906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:17.689906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:17.689906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:17.689906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:17.689906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 315/629] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:17.689906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0c328-00ec-4b5a-9ea4-77eb86a96ed9 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:17.749734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3648a-ef71-445b-9ff1-074c755b168b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:17.817830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:17.836259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a71728-ee12-4939-b384-c815b4618a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:17.837455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a71728-ee12-4939-b384-c815b4618a2c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:17.838186 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a71728-ee12-4939-b384-c815b4618a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:17.838709 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a71728-ee12-4939-b384-c815b4618a2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:17.852929 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a71728-ee12-4939-b384-c815b4618a2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:17.856954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a71728-ee12-4939-b384-c815b4618a2c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:17.883858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-59a71728-ee12-4939-b384-c815b4618a2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:17.883858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:17.883858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:17.883858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:17.883858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:17.883858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:17.883858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:17.883858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:17.883858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:17.883858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:17.883858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:17.883858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:17.883858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:17.883858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:17.883858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:17.885556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:17.888222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:17.888222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:17.888222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:17.888222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:17.888222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:17.888222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:17.888222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:17.888222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:17.888222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 315/630] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:17.890748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ae85a-2e8d-4ef6-94a7-215dda786f39 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:17.891049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ae85a-2e8d-4ef6-94a7-215dda786f39 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:17.891591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ae85a-2e8d-4ef6-94a7-215dda786f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:17.931623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-4e1ae85a-2e8d-4ef6-94a7-215dda786f39 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:17.934071 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4e1ae85a-2e8d-4ef6-94a7-215dda786f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:17.944936 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0c328-00ec-4b5a-9ea4-77eb86a96ed9 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:18.041149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ff40c-8f1a-4bdf-a231-cfd4940613cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:18.043230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ff40c-8f1a-4bdf-a231-cfd4940613cf None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:18.043732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ff40c-8f1a-4bdf-a231-cfd4940613cf None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:18.044264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ff40c-8f1a-4bdf-a231-cfd4940613cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:18.086151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 316/631] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:18.096240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ae85a-2e8d-4ef6-94a7-215dda786f39 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:18.189041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:18.196363 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ff40c-8f1a-4bdf-a231-cfd4940613cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:18.199927 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ff40c-8f1a-4bdf-a231-cfd4940613cf None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:18.333236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ae85a-2e8d-4ef6-94a7-215dda786f39 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:18.431672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 316/632] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:56:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:18.431672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ff40c-8f1a-4bdf-a231-cfd4940613cf None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:18.517902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:18.541779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e09ee-3a01-4adc-bdb6-d406c0d7c5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:18.546720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e09ee-3a01-4adc-bdb6-d406c0d7c5ea None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:18.546720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e09ee-3a01-4adc-bdb6-d406c0d7c5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:18.546720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e09ee-3a01-4adc-bdb6-d406c0d7c5ea None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:18.546720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e09ee-3a01-4adc-bdb6-d406c0d7c5ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:18.546720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e09ee-3a01-4adc-bdb6-d406c0d7c5ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:18.547366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e09ee-3a01-4adc-bdb6-d406c0d7c5ea None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:18.566019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 317/633] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:56:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:18.568219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e09ee-3a01-4adc-bdb6-d406c0d7c5ea None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:18.662888 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:18.670653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ff40c-8f1a-4bdf-a231-cfd4940613cf None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:18.740686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71237837-b6fe-419e-90e7-ec44f8f029ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:18.741429 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71237837-b6fe-419e-90e7-ec44f8f029ad None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:18.741698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71237837-b6fe-419e-90e7-ec44f8f029ad None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:18.741980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71237837-b6fe-419e-90e7-ec44f8f029ad None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:18.742988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71237837-b6fe-419e-90e7-ec44f8f029ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:18.743396 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71237837-b6fe-419e-90e7-ec44f8f029ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:18.745092 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71237837-b6fe-419e-90e7-ec44f8f029ad None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:18.748940 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e09ee-3a01-4adc-bdb6-d406c0d7c5ea None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:18.775569 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 317/634] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:18.776332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71237837-b6fe-419e-90e7-ec44f8f029ad None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:18.816718 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe6c82-dd9f-4818-bc2d-fac15c78ad73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:18.817392 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe6c82-dd9f-4818-bc2d-fac15c78ad73 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:18.817704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe6c82-dd9f-4818-bc2d-fac15c78ad73 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:18.817952 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe6c82-dd9f-4818-bc2d-fac15c78ad73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:18.844384 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe6c82-dd9f-4818-bc2d-fac15c78ad73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-7fbe6c82-dd9f-4818-bc2d-fac15c78ad73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:18.854169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:18.857258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:18.860477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:18.860477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:18.860477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:18.860477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:18.860477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:18.860477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:18.860477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:18.860477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:18.860477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:18.860477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:18.860477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:18.860477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:18.866581 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 318/635] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:18.868182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe6c82-dd9f-4818-bc2d-fac15c78ad73 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:18.961376 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:19.021347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71237837-b6fe-419e-90e7-ec44f8f029ad None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:19.076524 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe6c82-dd9f-4818-bc2d-fac15c78ad73 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:19.090873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df741d-5d2a-42df-9aaf-351ba207af6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:19.093086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df741d-5d2a-42df-9aaf-351ba207af6c None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:19.093086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df741d-5d2a-42df-9aaf-351ba207af6c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:19.093442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df741d-5d2a-42df-9aaf-351ba207af6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:19.115019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df741d-5d2a-42df-9aaf-351ba207af6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:19.117165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df741d-5d2a-42df-9aaf-351ba207af6c None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:19.141769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-d1df741d-5d2a-42df-9aaf-351ba207af6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:19.141769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:19.141769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:19.141769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:19.141769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:19.141769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:19.141769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:19.141769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:19.141769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:19.141769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:19.141769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:19.141769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:19.141769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:19.141769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:19.141769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:19.143833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:19.145499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:19.145499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:19.145499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:19.145499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:19.145499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 318/636] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:19.145499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df741d-5d2a-42df-9aaf-351ba207af6c None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:19.166917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:19.174708 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9e5ef-f347-4ce2-bbdc-d68a2018cb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:19.180621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9e5ef-f347-4ce2-bbdc-d68a2018cb87 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:19.181121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9e5ef-f347-4ce2-bbdc-d68a2018cb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:19.191140 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9e5ef-f347-4ce2-bbdc-d68a2018cb87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:19.204610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9e5ef-f347-4ce2-bbdc-d68a2018cb87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:19.206851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9e5ef-f347-4ce2-bbdc-d68a2018cb87 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:19.229393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-0ad9e5ef-f347-4ce2-bbdc-d68a2018cb87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:19.229393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:19.229393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:19.229393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:19.229393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:19.229393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:19.229393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:19.229393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:19.229393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:19.229393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:19.229393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:19.229393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:19.229393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:19.229393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:19.229393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:19.231474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:19.233207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:19.233207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:19.233207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:19.233207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:19.233595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 319/637] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:19.235172 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9e5ef-f347-4ce2-bbdc-d68a2018cb87 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:19.378844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df741d-5d2a-42df-9aaf-351ba207af6c None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:19.420480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:19.434298 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9e5ef-f347-4ce2-bbdc-d68a2018cb87 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:19.456959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d8512-9135-4182-a19e-e156de4d9c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:19.457857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d8512-9135-4182-a19e-e156de4d9c4b None admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:19.458274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d8512-9135-4182-a19e-e156de4d9c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:19.458720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d8512-9135-4182-a19e-e156de4d9c4b None admin] PATH_INFO: `/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/013ae8b88160433db6876f84947f0d8c/roles/ce31429587b44a7aafb4f600c011be4a` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:19.484710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d8512-9135-4182-a19e-e156de4d9c4b None admin] RBAC: Authorizing `identity:create_grant(project_id=7f750777b75f49a19a5019c4fc2c00f5, user_id=013ae8b88160433db6876f84947f0d8c, role_id=ce31429587b44a7aafb4f600c011be4a)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:19.486621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d8512-9135-4182-a19e-e156de4d9c4b None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:19.510623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007036e-555d-464f-be84-d86b1b55d610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:19.511755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007036e-555d-464f-be84-d86b1b55d610 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:19.512259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007036e-555d-464f-be84-d86b1b55d610 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:19.514732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007036e-555d-464f-be84-d86b1b55d610 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:19.516239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007036e-555d-464f-be84-d86b1b55d610 None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:19.516787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007036e-555d-464f-be84-d86b1b55d610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:19.519612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007036e-555d-464f-be84-d86b1b55d610 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:19.541939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 320/638] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:56:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:19.541939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007036e-555d-464f-be84-d86b1b55d610 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:19.572620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 319/639] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:56:19 2022] PUT /identity/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/013ae8b88160433db6876f84947f0d8c/roles/ce31429587b44a7aafb4f600c011be4a => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:56:19.574343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d8512-9135-4182-a19e-e156de4d9c4b None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:19.700633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:19.743757 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007036e-555d-464f-be84-d86b1b55d610 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:19.788443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d8512-9135-4182-a19e-e156de4d9c4b None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:19.824600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4ef6a-1e97-4f90-8e01-64491e38c4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:19.825176 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4ef6a-1e97-4f90-8e01-64491e38c4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:19.826455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4ef6a-1e97-4f90-8e01-64491e38c4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:19.827570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4ef6a-1e97-4f90-8e01-64491e38c4f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:19.829184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4ef6a-1e97-4f90-8e01-64491e38c4f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:19.829546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4ef6a-1e97-4f90-8e01-64491e38c4f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:19.833586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4ef6a-1e97-4f90-8e01-64491e38c4f3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:19.866540 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 321/640] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:19.868389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb5aba-8317-490c-b454-1b57d58c8ed8 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:19.868904 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb5aba-8317-490c-b454-1b57d58c8ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:19.869398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb5aba-8317-490c-b454-1b57d58c8ed8 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:19.872252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e3a7e-9e77-4a34-97ec-5cb859f0434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:19.873671 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e3a7e-9e77-4a34-97ec-5cb859f0434a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:19.874112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 322/641] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:19.874767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e3a7e-9e77-4a34-97ec-5cb859f0434a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:19.875373 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e3a7e-9e77-4a34-97ec-5cb859f0434a None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:19.875829 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb5aba-8317-490c-b454-1b57d58c8ed8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:19.876374 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e3a7e-9e77-4a34-97ec-5cb859f0434a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:19.877007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e3a7e-9e77-4a34-97ec-5cb859f0434a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:19.879278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e3a7e-9e77-4a34-97ec-5cb859f0434a None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:19.903198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 320/642] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:19.904697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e3a7e-9e77-4a34-97ec-5cb859f0434a None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:19.913924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:20.106508 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb5aba-8317-490c-b454-1b57d58c8ed8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:20.129536 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e3a7e-9e77-4a34-97ec-5cb859f0434a None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:20.172758 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:20.173694 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10cdaa-99b8-4556-884a-413654dea144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:20.174695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10cdaa-99b8-4556-884a-413654dea144 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:20.175376 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10cdaa-99b8-4556-884a-413654dea144 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:20.176044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10cdaa-99b8-4556-884a-413654dea144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:20.195712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10cdaa-99b8-4556-884a-413654dea144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:20.198504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10cdaa-99b8-4556-884a-413654dea144 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:20.199257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d606e1f-e872-4a8b-bfa8-72e71c34c9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:20.200557 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d606e1f-e872-4a8b-bfa8-72e71c34c9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:20.201239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d606e1f-e872-4a8b-bfa8-72e71c34c9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:20.201768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d606e1f-e872-4a8b-bfa8-72e71c34c9f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:20.214289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d606e1f-e872-4a8b-bfa8-72e71c34c9f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:20.218331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d606e1f-e872-4a8b-bfa8-72e71c34c9f0 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:20.231456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-1f10cdaa-99b8-4556-884a-413654dea144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:20.231456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:20.231456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:20.231456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:20.231456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:20.231456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:20.231456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:20.231456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:20.231456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:20.231456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:20.231456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:20.231456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:20.231456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:20.231456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:20.231456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:20.232797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:20.234176 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:20.234176 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:20.234176 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:20.234176 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:20.234176 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 323/643] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:20.236168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921e8f8-6b0a-4ed2-855b-0ac1bdd68e7d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:20.236811 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921e8f8-6b0a-4ed2-855b-0ac1bdd68e7d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:20.237328 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921e8f8-6b0a-4ed2-855b-0ac1bdd68e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:20.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-3d606e1f-e872-4a8b-bfa8-72e71c34c9f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:20.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:20.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:20.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:20.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:20.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:20.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:20.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:20.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:20.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:20.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:20.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:20.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:20.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:20.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:20.256278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:20.260832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:20.260832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:20.260832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:20.260832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:20.260832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:20.260832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:20.260832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:20.260832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:20.265384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 321/644] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:20.265384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d606e1f-e872-4a8b-bfa8-72e71c34c9f0 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:20.267679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d921e8f8-6b0a-4ed2-855b-0ac1bdd68e7d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:20.269963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d921e8f8-6b0a-4ed2-855b-0ac1bdd68e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:20.398905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:20.408294 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 324/645] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:20.410206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921e8f8-6b0a-4ed2-855b-0ac1bdd68e7d None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:20.481781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d606e1f-e872-4a8b-bfa8-72e71c34c9f0 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:20.551529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325ceb1-ed62-429a-90cc-9377d9a39cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:20.554425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325ceb1-ed62-429a-90cc-9377d9a39cbf None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:20.554425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325ceb1-ed62-429a-90cc-9377d9a39cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:20.554425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325ceb1-ed62-429a-90cc-9377d9a39cbf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:20.566931 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325ceb1-ed62-429a-90cc-9377d9a39cbf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:20.568718 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325ceb1-ed62-429a-90cc-9377d9a39cbf None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-e325ceb1-ed62-429a-90cc-9377d9a39cbf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:20.592184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:20.593236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:20.594198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:20.594198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:20.594198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:20.594198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:20.594198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:20.594198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:20.594198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:20.594198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:20.594198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:56:20.594198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:20.599354 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 322/646] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:56:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:20.600497 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325ceb1-ed62-429a-90cc-9377d9a39cbf None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:20.650070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921e8f8-6b0a-4ed2-855b-0ac1bdd68e7d None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:20.687475 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:20.725346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2df94-f4bd-4796-85a2-fc94635d7b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:20.726473 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2df94-f4bd-4796-85a2-fc94635d7b35 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:20.726979 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2df94-f4bd-4796-85a2-fc94635d7b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:20.727465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2df94-f4bd-4796-85a2-fc94635d7b35 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:20.728978 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2df94-f4bd-4796-85a2-fc94635d7b35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:20.729516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2df94-f4bd-4796-85a2-fc94635d7b35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:20.732917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2df94-f4bd-4796-85a2-fc94635d7b35 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:20.763981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 325/647] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:20.763981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2df94-f4bd-4796-85a2-fc94635d7b35 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:20.794244 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325ceb1-ed62-429a-90cc-9377d9a39cbf None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:20.858944 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d0775-7850-462c-bd74-6a5c5da4e50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:20.860054 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d0775-7850-462c-bd74-6a5c5da4e50c None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:20.860538 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d0775-7850-462c-bd74-6a5c5da4e50c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:20.861000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d0775-7850-462c-bd74-6a5c5da4e50c None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:20.862914 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d0775-7850-462c-bd74-6a5c5da4e50c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:20.863698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d0775-7850-462c-bd74-6a5c5da4e50c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:20.865958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d0775-7850-462c-bd74-6a5c5da4e50c None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:20.877605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:20.901012 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 323/648] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:20.901012 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d0775-7850-462c-bd74-6a5c5da4e50c None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:20.970533 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2df94-f4bd-4796-85a2-fc94635d7b35 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:21.050918 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36050e39-8807-4be5-b90c-a975cfa11325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:21.052057 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36050e39-8807-4be5-b90c-a975cfa11325 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:21.052692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36050e39-8807-4be5-b90c-a975cfa11325 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:21.052980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36050e39-8807-4be5-b90c-a975cfa11325 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:21.068531 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36050e39-8807-4be5-b90c-a975cfa11325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-36050e39-8807-4be5-b90c-a975cfa11325 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:21.077283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:21.086794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:21.088585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:21.088585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:21.088585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:21.088585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:21.088585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:21.088585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:21.088585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:21.088585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:21.088585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:21.088585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:21.088585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:21.088585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:21.088585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 326/649] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:21.088585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36050e39-8807-4be5-b90c-a975cfa11325 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:21.129074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:21.135607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d0775-7850-462c-bd74-6a5c5da4e50c None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:21.201520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd582a-da21-4f93-9c6b-0c440e3a410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:21.202039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd582a-da21-4f93-9c6b-0c440e3a410e None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:21.202959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd582a-da21-4f93-9c6b-0c440e3a410e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:21.202959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd582a-da21-4f93-9c6b-0c440e3a410e None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:21.204019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd582a-da21-4f93-9c6b-0c440e3a410e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:21.204329 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd582a-da21-4f93-9c6b-0c440e3a410e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:21.205968 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd582a-da21-4f93-9c6b-0c440e3a410e None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:21.239175 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 324/650] 10.222.0.98 () {56 vars in 1137 bytes} [Tue Jul 26 14:56:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:21.241216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd582a-da21-4f93-9c6b-0c440e3a410e None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:21.327639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36050e39-8807-4be5-b90c-a975cfa11325 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:21.365892 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:21.406333 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9a96e-6213-48ff-b2f8-7fe0edaac6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:21.407268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9a96e-6213-48ff-b2f8-7fe0edaac6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:21.407806 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9a96e-6213-48ff-b2f8-7fe0edaac6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:21.408232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9a96e-6213-48ff-b2f8-7fe0edaac6a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:21.423460 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9a96e-6213-48ff-b2f8-7fe0edaac6a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:21.426003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9a96e-6213-48ff-b2f8-7fe0edaac6a4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-c3f9a96e-6213-48ff-b2f8-7fe0edaac6a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:21.449926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:21.451693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:21.453758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:21.453758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:21.453758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:21.453758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:21.453758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:21.453758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:21.453758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:21.453758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:21.453758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:56:21.453758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:21.458193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd582a-da21-4f93-9c6b-0c440e3a410e None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:21.459005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 327/651] 10.222.0.98 () {56 vars in 1093 bytes} [Tue Jul 26 14:56:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:21.460896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9a96e-6213-48ff-b2f8-7fe0edaac6a4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:21.528538 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64eed3-5e4e-4f65-abd1-7761d14923df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:21.529687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64eed3-5e4e-4f65-abd1-7761d14923df None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:21.530147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64eed3-5e4e-4f65-abd1-7761d14923df None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:21.530641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64eed3-5e4e-4f65-abd1-7761d14923df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:21.532063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64eed3-5e4e-4f65-abd1-7761d14923df None admin] RBAC: Adding query filter params (role.id=ce31429587b44a7aafb4f600c011be4a, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=4d85dc9f9f15480db927e617c992e1a1) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:21.533802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64eed3-5e4e-4f65-abd1-7761d14923df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:21.535266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64eed3-5e4e-4f65-abd1-7761d14923df None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:21.550508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 325/652] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:21 2022] GET /identity/v3/role_assignments?user.id=4d85dc9f9f15480db927e617c992e1a1&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=ce31429587b44a7aafb4f600c011be4a => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:21.552646 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64eed3-5e4e-4f65-abd1-7761d14923df None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:21.604033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:21.668394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9a96e-6213-48ff-b2f8-7fe0edaac6a4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:21.737088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafb03d-3db1-4b09-ab40-24b5d9f0df56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:21.738225 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafb03d-3db1-4b09-ab40-24b5d9f0df56 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:21.738893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafb03d-3db1-4b09-ab40-24b5d9f0df56 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:21.739457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafb03d-3db1-4b09-ab40-24b5d9f0df56 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:21.741020 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafb03d-3db1-4b09-ab40-24b5d9f0df56 None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:21.741651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafb03d-3db1-4b09-ab40-24b5d9f0df56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:21.744458 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafb03d-3db1-4b09-ab40-24b5d9f0df56 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:21.753523 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64eed3-5e4e-4f65-abd1-7761d14923df None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:21.770976 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 328/653] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:56:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:21.772509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafb03d-3db1-4b09-ab40-24b5d9f0df56 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:21.843713 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1efaeb-cb53-49da-ac2f-a3cebafa152b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:21.845301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1efaeb-cb53-49da-ac2f-a3cebafa152b None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:21.846053 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1efaeb-cb53-49da-ac2f-a3cebafa152b None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:21.846767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1efaeb-cb53-49da-ac2f-a3cebafa152b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:21.871132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:22.006621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafb03d-3db1-4b09-ab40-24b5d9f0df56 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:22.034629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1efaeb-cb53-49da-ac2f-a3cebafa152b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:22.037755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1efaeb-cb53-49da-ac2f-a3cebafa152b None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:22.084307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae4ff4-46ec-47a6-b938-ada73bb181cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:22.085334 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae4ff4-46ec-47a6-b938-ada73bb181cc None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:22.085831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae4ff4-46ec-47a6-b938-ada73bb181cc None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:22.086637 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae4ff4-46ec-47a6-b938-ada73bb181cc None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:22.087861 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae4ff4-46ec-47a6-b938-ada73bb181cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:22.088361 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae4ff4-46ec-47a6-b938-ada73bb181cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:22.092201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae4ff4-46ec-47a6-b938-ada73bb181cc None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:22.098522 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:22.127364 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 329/654] 10.222.0.98 () {56 vars in 1133 bytes} [Tue Jul 26 14:56:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:22.129353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae4ff4-46ec-47a6-b938-ada73bb181cc None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:22.255748 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 326/655] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:56:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:22.257208 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1efaeb-cb53-49da-ac2f-a3cebafa152b None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:22.342840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:22.351958 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae4ff4-46ec-47a6-b938-ada73bb181cc None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:22.404681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1efaeb-cb53-49da-ac2f-a3cebafa152b None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:22.441517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:22.453685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b0bb1-9b6c-41fb-aa57-201c2b983005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:22.454921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b0bb1-9b6c-41fb-aa57-201c2b983005 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:22.456539 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b0bb1-9b6c-41fb-aa57-201c2b983005 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:22.457147 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b0bb1-9b6c-41fb-aa57-201c2b983005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:22.469083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0be1f-e0f8-421d-b50c-d4ad6ed04cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:22.470322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0be1f-e0f8-421d-b50c-d4ad6ed04cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:22.470949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0be1f-e0f8-421d-b50c-d4ad6ed04cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:22.471832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0be1f-e0f8-421d-b50c-d4ad6ed04cc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:22.480345 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b0bb1-9b6c-41fb-aa57-201c2b983005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:22.484277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b0bb1-9b6c-41fb-aa57-201c2b983005 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:22.524261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-810b0bb1-9b6c-41fb-aa57-201c2b983005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:22.524261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:22.524261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:22.524261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:22.524261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:22.524261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:22.524261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:22.524261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:22.524261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:22.524261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:22.524261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:22.524261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:22.524261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:22.524261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:22.524261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:22.525993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:22.528413 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:22.528413 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:22.528413 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:22.528413 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:22.528413 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 330/656] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:22.529726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b0bb1-9b6c-41fb-aa57-201c2b983005 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:22.591808 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0be1f-e0f8-421d-b50c-d4ad6ed04cc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:22.593465 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0be1f-e0f8-421d-b50c-d4ad6ed04cc9 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:22.758100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b0bb1-9b6c-41fb-aa57-201c2b983005 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:22.763499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 327/657] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:56:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:22.764525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0be1f-e0f8-421d-b50c-d4ad6ed04cc9 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:22.811166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:22.835802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346146a6-4978-4b01-af6e-b06caa566b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:22.837381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346146a6-4978-4b01-af6e-b06caa566b3e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:22.838143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346146a6-4978-4b01-af6e-b06caa566b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:22.838901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346146a6-4978-4b01-af6e-b06caa566b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:22.866811 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346146a6-4978-4b01-af6e-b06caa566b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:22.871416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346146a6-4978-4b01-af6e-b06caa566b3e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:22.905685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-346146a6-4978-4b01-af6e-b06caa566b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:22.905685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:22.905685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:22.905685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:22.905685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:22.905685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:22.905685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:22.905685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:22.905685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:22.905685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:22.905685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:22.905685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:22.905685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:22.905685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:22.905685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:22.907610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:22.909607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:22.909607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:22.909607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:22.909607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:22.912909 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 331/658] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:22.914824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346146a6-4978-4b01-af6e-b06caa566b3e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:22.923921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:22.945702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0be1f-e0f8-421d-b50c-d4ad6ed04cc9 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:22.992221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8d66e-48fe-4f58-bb65-b7a6437da37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:22.993157 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8d66e-48fe-4f58-bb65-b7a6437da37d None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:22.993589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8d66e-48fe-4f58-bb65-b7a6437da37d None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:22.993912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8d66e-48fe-4f58-bb65-b7a6437da37d None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:22.994742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8d66e-48fe-4f58-bb65-b7a6437da37d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:22.995702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8d66e-48fe-4f58-bb65-b7a6437da37d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:22.997300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8d66e-48fe-4f58-bb65-b7a6437da37d None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:23.015309 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 328/659] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:23.016421 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8d66e-48fe-4f58-bb65-b7a6437da37d None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:23.070975 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346146a6-4978-4b01-af6e-b06caa566b3e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:23.115123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3d425-a8a4-4fc6-923f-fcd771a57cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:23.115783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3d425-a8a4-4fc6-923f-fcd771a57cbe None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:23.116077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3d425-a8a4-4fc6-923f-fcd771a57cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:23.116351 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3d425-a8a4-4fc6-923f-fcd771a57cbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:23.132570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3d425-a8a4-4fc6-923f-fcd771a57cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:23.134167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3d425-a8a4-4fc6-923f-fcd771a57cbe None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:23.160051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-1ba3d425-a8a4-4fc6-923f-fcd771a57cbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:23.160051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:23.160051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:23.160051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:23.160051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:23.160051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:23.160051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:23.160051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:23.160051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:23.160051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:23.160051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:23.160051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:23.160051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:23.160051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:23.160051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:23.161015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:23.161913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:23.161913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:23.161913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:23.161913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:23.163712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 332/660] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:23.165201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e00590-1d1e-4b43-9697-072521f531f3 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:23.165661 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e00590-1d1e-4b43-9697-072521f531f3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:23.166069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e00590-1d1e-4b43-9697-072521f531f3 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:23.172746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 333/661] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:23.174013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e00590-1d1e-4b43-9697-072521f531f3 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:23.182214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:23.210390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8d66e-48fe-4f58-bb65-b7a6437da37d None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:23.276061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b16b4-69de-4f6e-b063-8e210238d368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:23.278617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b16b4-69de-4f6e-b063-8e210238d368 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:23.278617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b16b4-69de-4f6e-b063-8e210238d368 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:23.278617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b16b4-69de-4f6e-b063-8e210238d368 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:23.279892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b16b4-69de-4f6e-b063-8e210238d368 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:23.280395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b16b4-69de-4f6e-b063-8e210238d368 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:23.283022 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b16b4-69de-4f6e-b063-8e210238d368 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:23.287065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:23.301570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 329/662] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:23.302557 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b16b4-69de-4f6e-b063-8e210238d368 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:23.386796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e00590-1d1e-4b43-9697-072521f531f3 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:23.433455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd66811-eb76-4a00-9e90-e36281118307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:23.434131 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd66811-eb76-4a00-9e90-e36281118307 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:23.434437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd66811-eb76-4a00-9e90-e36281118307 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:23.434712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd66811-eb76-4a00-9e90-e36281118307 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:23.443865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd66811-eb76-4a00-9e90-e36281118307 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:23.445334 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd66811-eb76-4a00-9e90-e36281118307 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-7fd66811-eb76-4a00-9e90-e36281118307 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:23.460886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:23.462788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:23.465279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:23.465279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:23.465279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:23.465279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:23.465279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:23.465279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:23.465279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:23.465279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:23.465279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:56:23.465279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:23.467516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 334/663] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:23.468983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7b2b1-3f64-4752-84d7-7ae50c050791 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:23.469256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7b2b1-3f64-4752-84d7-7ae50c050791 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:23.469527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7b2b1-3f64-4752-84d7-7ae50c050791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:23.497755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-eee7b2b1-3f64-4752-84d7-7ae50c050791 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:23.499059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-eee7b2b1-3f64-4752-84d7-7ae50c050791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:23.534148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b16b4-69de-4f6e-b063-8e210238d368 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:23.602791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d46f-f711-4189-b846-2de2da4eb9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:23.603875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d46f-f711-4189-b846-2de2da4eb9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:23.604975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d46f-f711-4189-b846-2de2da4eb9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:23.605504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d46f-f711-4189-b846-2de2da4eb9e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:23.607651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9d46f-f711-4189-b846-2de2da4eb9e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:23.607651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9d46f-f711-4189-b846-2de2da4eb9e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:23.610236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9d46f-f711-4189-b846-2de2da4eb9e0 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:23.610626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 335/664] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:23.611992 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7b2b1-3f64-4752-84d7-7ae50c050791 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:23.641746 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 330/665] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:23.642845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d46f-f711-4189-b846-2de2da4eb9e0 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:23.647833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:23.675321 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:23.761116 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7b2b1-3f64-4752-84d7-7ae50c050791 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:23.810318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad249a3-c4ce-48f9-b97d-204795cba55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:23.811013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad249a3-c4ce-48f9-b97d-204795cba55e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:23.811307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad249a3-c4ce-48f9-b97d-204795cba55e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:23.811682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad249a3-c4ce-48f9-b97d-204795cba55e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:23.822971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad249a3-c4ce-48f9-b97d-204795cba55e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:23.825128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad249a3-c4ce-48f9-b97d-204795cba55e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:23.844400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d46f-f711-4189-b846-2de2da4eb9e0 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:23.847034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-3ad249a3-c4ce-48f9-b97d-204795cba55e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:23.847034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:23.847034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:23.847034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:23.847034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:23.847034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:23.847034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:23.847034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:23.847034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:23.847034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:23.847034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:23.847034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:23.847034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:23.847034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:23.847034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:23.848130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:23.849210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:23.849210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:23.849210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:23.849210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:23.849210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:23.849210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:23.849210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:23.849210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:23.855826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 336/666] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:23.856923 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad249a3-c4ce-48f9-b97d-204795cba55e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:23.914570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345b7f6-b6d6-41e1-b9c6-ab38dd2d960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:23.915581 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345b7f6-b6d6-41e1-b9c6-ab38dd2d960d None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:23.916078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345b7f6-b6d6-41e1-b9c6-ab38dd2d960d None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:23.916567 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345b7f6-b6d6-41e1-b9c6-ab38dd2d960d None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:23.918193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345b7f6-b6d6-41e1-b9c6-ab38dd2d960d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:23.918850 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345b7f6-b6d6-41e1-b9c6-ab38dd2d960d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:23.921301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345b7f6-b6d6-41e1-b9c6-ab38dd2d960d None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:23.948679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 331/667] 10.222.0.98 () {56 vars in 1139 bytes} [Tue Jul 26 14:56:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:23.950940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345b7f6-b6d6-41e1-b9c6-ab38dd2d960d None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:24.052650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad249a3-c4ce-48f9-b97d-204795cba55e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:24.056410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:24.064433 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:24.115804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d2b60-f10f-4a49-a491-3d7ee9a495ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:24.117200 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d2b60-f10f-4a49-a491-3d7ee9a495ed None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:24.117837 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d2b60-f10f-4a49-a491-3d7ee9a495ed None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:24.118565 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d2b60-f10f-4a49-a491-3d7ee9a495ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:24.136160 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d2b60-f10f-4a49-a491-3d7ee9a495ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:24.138991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345b7f6-b6d6-41e1-b9c6-ab38dd2d960d None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-0e7d2b60-f10f-4a49-a491-3d7ee9a495ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:24.141159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:24.143303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:24.144955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:24.144955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:24.144955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:24.144955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:24.144955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:24.144955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:24.144955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:24.144955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:24.144955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:24.144955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:24.144955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:24.144955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:24.144955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 337/668] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:24.144955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d2b60-f10f-4a49-a491-3d7ee9a495ed None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:24.228354 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b386fb-ed2a-4210-92c5-f1f646547a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:24.228929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b386fb-ed2a-4210-92c5-f1f646547a64 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:24.229204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b386fb-ed2a-4210-92c5-f1f646547a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:24.230251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b386fb-ed2a-4210-92c5-f1f646547a64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:24.238831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b386fb-ed2a-4210-92c5-f1f646547a64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:24.240531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b386fb-ed2a-4210-92c5-f1f646547a64 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:24.254917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-99b386fb-ed2a-4210-92c5-f1f646547a64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:24.254917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:24.254917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:24.254917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:24.254917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:24.254917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:24.254917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:24.254917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:24.254917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:24.254917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:24.254917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:24.254917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:24.254917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:24.254917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:24.254917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:24.256999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:24.259251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:24.259251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:24.259251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:24.259251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:24.259251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:24.259251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:24.259251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:24.259251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:24.259251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 332/669] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:24.259251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b386fb-ed2a-4210-92c5-f1f646547a64 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:24.331651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d2b60-f10f-4a49-a491-3d7ee9a495ed None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:24.402588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b042932-cc66-49b6-8211-8cd6184b6f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:24.403260 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b042932-cc66-49b6-8211-8cd6184b6f48 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:24.403577 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b042932-cc66-49b6-8211-8cd6184b6f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:24.403855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b042932-cc66-49b6-8211-8cd6184b6f48 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:24.404715 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b042932-cc66-49b6-8211-8cd6184b6f48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:24.405405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b042932-cc66-49b6-8211-8cd6184b6f48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:24.407357 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b042932-cc66-49b6-8211-8cd6184b6f48 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:24.426080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 338/670] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:24.427765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b042932-cc66-49b6-8211-8cd6184b6f48 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:24.445165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b386fb-ed2a-4210-92c5-f1f646547a64 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:24.485145 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:24.491366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:24.515039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7290d2-f9cb-4389-944e-8be1e3e002bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:24.515806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7290d2-f9cb-4389-944e-8be1e3e002bd None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:24.516184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7290d2-f9cb-4389-944e-8be1e3e002bd None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:24.516649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7290d2-f9cb-4389-944e-8be1e3e002bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:24.603739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b042932-cc66-49b6-8211-8cd6184b6f48 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:24.614938 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7290d2-f9cb-4389-944e-8be1e3e002bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:24.616458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7290d2-f9cb-4389-944e-8be1e3e002bd None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:24.647296 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab468031-f64b-4689-bf8b-522d3280b6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:24.648129 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab468031-f64b-4689-bf8b-522d3280b6ff None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:24.648501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab468031-f64b-4689-bf8b-522d3280b6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:24.648893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab468031-f64b-4689-bf8b-522d3280b6ff None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:24.649768 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab468031-f64b-4689-bf8b-522d3280b6ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:24.650172 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab468031-f64b-4689-bf8b-522d3280b6ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:24.652353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab468031-f64b-4689-bf8b-522d3280b6ff None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:24.670559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 339/671] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:56:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:24.671341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab468031-f64b-4689-bf8b-522d3280b6ff None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:24.760579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 333/672] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:56:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:24.762256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7290d2-f9cb-4389-944e-8be1e3e002bd None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:24.794080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:24.811455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:24.851061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab468031-f64b-4689-bf8b-522d3280b6ff None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:24.913115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09369577-fcd7-4031-b096-3b13c7523fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:24.913766 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09369577-fcd7-4031-b096-3b13c7523fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:24.914050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09369577-fcd7-4031-b096-3b13c7523fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:24.914327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09369577-fcd7-4031-b096-3b13c7523fd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:24.915393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09369577-fcd7-4031-b096-3b13c7523fd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:24.915784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09369577-fcd7-4031-b096-3b13c7523fd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:24.917842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09369577-fcd7-4031-b096-3b13c7523fd6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:24.929654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7290d2-f9cb-4389-944e-8be1e3e002bd None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:24.934338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 340/673] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:24.935819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539e85d-8aee-4403-a649-a2c4bc3d8fbe None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:24.936231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539e85d-8aee-4403-a649-a2c4bc3d8fbe None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:24.936638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539e85d-8aee-4403-a649-a2c4bc3d8fbe None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:24.938188 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 341/674] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:24.939655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539e85d-8aee-4403-a649-a2c4bc3d8fbe None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:24.987823 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289294f3-c4d0-4264-b661-1c2e12570aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:24.988537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289294f3-c4d0-4264-b661-1c2e12570aea None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:24.988883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289294f3-c4d0-4264-b661-1c2e12570aea None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:24.989155 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289294f3-c4d0-4264-b661-1c2e12570aea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:24.989963 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289294f3-c4d0-4264-b661-1c2e12570aea None admin] RBAC: Adding query filter params (role.id=ce31429587b44a7aafb4f600c011be4a, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=96d09fca7f864129ab0dcb90fb5d24e3) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:24.990274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289294f3-c4d0-4264-b661-1c2e12570aea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:24.991798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289294f3-c4d0-4264-b661-1c2e12570aea None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:25.000382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 334/675] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:24 2022] GET /identity/v3/role_assignments?user.id=96d09fca7f864129ab0dcb90fb5d24e3&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=ce31429587b44a7aafb4f600c011be4a => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:25.002540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289294f3-c4d0-4264-b661-1c2e12570aea None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:25.139747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539e85d-8aee-4403-a649-a2c4bc3d8fbe None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:25.183256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:25.216586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289294f3-c4d0-4264-b661-1c2e12570aea None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:25.220520 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81103723-5d74-4c9c-bc80-b36ed4a35231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:25.221129 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81103723-5d74-4c9c-bc80-b36ed4a35231 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:25.224197 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81103723-5d74-4c9c-bc80-b36ed4a35231 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:25.224758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81103723-5d74-4c9c-bc80-b36ed4a35231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:25.248368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81103723-5d74-4c9c-bc80-b36ed4a35231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:25.251222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81103723-5d74-4c9c-bc80-b36ed4a35231 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:25.262866 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:25.275900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-81103723-5d74-4c9c-bc80-b36ed4a35231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:25.275900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:25.275900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:25.275900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:25.275900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:25.275900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:25.275900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:25.275900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:25.275900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:25.275900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:25.275900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:25.275900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:25.275900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:25.275900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:25.275900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:25.277022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:25.277987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:25.277987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:25.277987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:25.277987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:25.279211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 342/676] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:25.280006 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa59b3-ea81-4200-b8fb-35e33a253b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:25.281581 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81103723-5d74-4c9c-bc80-b36ed4a35231 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:25.283212 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa59b3-ea81-4200-b8fb-35e33a253b43 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:25.283819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa59b3-ea81-4200-b8fb-35e33a253b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:25.284231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa59b3-ea81-4200-b8fb-35e33a253b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:25.302736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa59b3-ea81-4200-b8fb-35e33a253b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:25.304255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa59b3-ea81-4200-b8fb-35e33a253b43 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:25.335504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-1ffa59b3-ea81-4200-b8fb-35e33a253b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:25.335504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:25.335504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:25.335504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:25.335504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:25.335504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:25.335504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:25.335504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:25.335504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:25.335504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:25.335504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:25.335504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:25.335504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:25.335504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:25.335504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:25.336656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:25.337623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:25.337623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:25.337623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:25.337623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:25.340245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 335/677] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:25.343212 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493dddb-87fb-4b50-810e-ad79127688b4 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:25.344119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493dddb-87fb-4b50-810e-ad79127688b4 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:25.344885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493dddb-87fb-4b50-810e-ad79127688b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:25.382469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d493dddb-87fb-4b50-810e-ad79127688b4 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:25.383711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d493dddb-87fb-4b50-810e-ad79127688b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:25.486069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81103723-5d74-4c9c-bc80-b36ed4a35231 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:25.514458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 336/678] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:25.514458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493dddb-87fb-4b50-810e-ad79127688b4 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:25.585100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198f88d-654b-4d86-b2b7-a8f07bdf5578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:25.586107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198f88d-654b-4d86-b2b7-a8f07bdf5578 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:25.586556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198f88d-654b-4d86-b2b7-a8f07bdf5578 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:25.586905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198f88d-654b-4d86-b2b7-a8f07bdf5578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:25.588241 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198f88d-654b-4d86-b2b7-a8f07bdf5578 None admin] RBAC: Adding query filter params (role.id=ce31429587b44a7aafb4f600c011be4a, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=a4a6c0e7ca434010980d7cac1800dbe9) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:25.589274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198f88d-654b-4d86-b2b7-a8f07bdf5578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:25.592329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198f88d-654b-4d86-b2b7-a8f07bdf5578 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:25.603630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 343/679] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:25 2022] GET /identity/v3/role_assignments?user.id=a4a6c0e7ca434010980d7cac1800dbe9&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=ce31429587b44a7aafb4f600c011be4a => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:25.605377 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198f88d-654b-4d86-b2b7-a8f07bdf5578 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:25.668713 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:25.731641 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:25.751000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493dddb-87fb-4b50-810e-ad79127688b4 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:25.801435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a3fb2-a34b-4d6f-b516-dca4db7db2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:25.802350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a3fb2-a34b-4d6f-b516-dca4db7db2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:25.802540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a3fb2-a34b-4d6f-b516-dca4db7db2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:25.802685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a3fb2-a34b-4d6f-b516-dca4db7db2c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:25.803453 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a3fb2-a34b-4d6f-b516-dca4db7db2c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:25.803881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a3fb2-a34b-4d6f-b516-dca4db7db2c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:25.805504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a3fb2-a34b-4d6f-b516-dca4db7db2c0 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:25.817591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198f88d-654b-4d86-b2b7-a8f07bdf5578 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:25.830963 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 337/680] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:25.832014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a3fb2-a34b-4d6f-b516-dca4db7db2c0 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:25.889990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac9509-cb5a-4d31-beb0-10808a8348f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:25.890975 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac9509-cb5a-4d31-beb0-10808a8348f4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:25.892260 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac9509-cb5a-4d31-beb0-10808a8348f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:25.892260 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac9509-cb5a-4d31-beb0-10808a8348f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:25.893019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac9509-cb5a-4d31-beb0-10808a8348f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:25.893472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac9509-cb5a-4d31-beb0-10808a8348f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:25.897370 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac9509-cb5a-4d31-beb0-10808a8348f4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:25.918046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 344/681] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:25.919557 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac9509-cb5a-4d31-beb0-10808a8348f4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:25.994431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a3fb2-a34b-4d6f-b516-dca4db7db2c0 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:26.050484 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:26.065031 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5beec2e-1d67-48af-88fd-ef150d3179b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:26.066150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beec2e-1d67-48af-88fd-ef150d3179b2 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:26.066682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beec2e-1d67-48af-88fd-ef150d3179b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:26.067158 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beec2e-1d67-48af-88fd-ef150d3179b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:26.089000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5beec2e-1d67-48af-88fd-ef150d3179b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:26.092177 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5beec2e-1d67-48af-88fd-ef150d3179b2 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:26.129395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-d5beec2e-1d67-48af-88fd-ef150d3179b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:26.129395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:26.129395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:26.129395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:26.129395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:26.129395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:26.129395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:26.129395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:26.129395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:26.129395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:26.129395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:26.129395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:26.129395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:26.129395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:26.129395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:26.131238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:26.133180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:26.133180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:26.133180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:26.133180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:26.136983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 338/682] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:26.142398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac9509-cb5a-4d31-beb0-10808a8348f4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:26.144924 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5beec2e-1d67-48af-88fd-ef150d3179b2 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:26.217400 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:26.241879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5567d-1e2c-4fa9-a629-542c2a020aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:26.242983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5567d-1e2c-4fa9-a629-542c2a020aac None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:26.243483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5567d-1e2c-4fa9-a629-542c2a020aac None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:26.243980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5567d-1e2c-4fa9-a629-542c2a020aac None admin] PATH_INFO: `/v3/users/swift` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:26.259343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5567d-1e2c-4fa9-a629-542c2a020aac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:26.262213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5567d-1e2c-4fa9-a629-542c2a020aac None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-63d5567d-1e2c-4fa9-a629-542c2a020aac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:26.292464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:26.311802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:26.313587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:26.313587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:26.313587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:26.313587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:26.313587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:26.313587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:26.313587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:26.313587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:26.313587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:56:26.313587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:26.313587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 345/683] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:56:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:26.313587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5567d-1e2c-4fa9-a629-542c2a020aac None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:26.370800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5beec2e-1d67-48af-88fd-ef150d3179b2 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:26.453992 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b89d3-ad41-411f-b24a-26a62afc643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:26.455978 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b89d3-ad41-411f-b24a-26a62afc643f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:26.456702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b89d3-ad41-411f-b24a-26a62afc643f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:26.457384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b89d3-ad41-411f-b24a-26a62afc643f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:26.475166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b89d3-ad41-411f-b24a-26a62afc643f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:26.480161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b89d3-ad41-411f-b24a-26a62afc643f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:26.520171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-b71b89d3-ad41-411f-b24a-26a62afc643f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:26.520171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:26.520171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:26.520171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:26.520171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:26.520171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:26.520171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:26.520171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:26.520171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:26.520171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:26.520171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:26.520171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:26.520171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:26.520171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:26.520171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:26.523415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:26.525520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:26.525520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:26.525520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:26.525520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:26.525520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:26.525520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:26.525520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:26.525520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:26.537540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 339/684] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:26.537540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b89d3-ad41-411f-b24a-26a62afc643f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:26.559949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5567d-1e2c-4fa9-a629-542c2a020aac None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:26.610785 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:26.636498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7f548-0965-4e30-a9ea-320553da7ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:26.637882 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7f548-0965-4e30-a9ea-320553da7ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:26.638414 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7f548-0965-4e30-a9ea-320553da7ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:26.638909 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7f548-0965-4e30-a9ea-320553da7ed7 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:26.639844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7f548-0965-4e30-a9ea-320553da7ed7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:26.640563 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7f548-0965-4e30-a9ea-320553da7ed7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:26.643511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7f548-0965-4e30-a9ea-320553da7ed7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:26.670971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 346/685] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:26.673474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7f548-0965-4e30-a9ea-320553da7ed7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:26.724354 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b89d3-ad41-411f-b24a-26a62afc643f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:26.771967 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:26.791193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd84b8-e422-4380-b900-389a419d95a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:26.792837 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd84b8-e422-4380-b900-389a419d95a7 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:26.793733 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd84b8-e422-4380-b900-389a419d95a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:26.794639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd84b8-e422-4380-b900-389a419d95a7 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:26.797213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd84b8-e422-4380-b900-389a419d95a7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:26.798132 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd84b8-e422-4380-b900-389a419d95a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:26.801028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd84b8-e422-4380-b900-389a419d95a7 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:26.834405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 340/686] 10.222.0.98 () {56 vars in 1135 bytes} [Tue Jul 26 14:56:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:26.834405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd84b8-e422-4380-b900-389a419d95a7 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:26.894443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7f548-0965-4e30-a9ea-320553da7ed7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:26.959100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf43d0-ec89-491d-9d30-7516d75d888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:26.960701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf43d0-ec89-491d-9d30-7516d75d888b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:26.961498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf43d0-ec89-491d-9d30-7516d75d888b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:26.962228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf43d0-ec89-491d-9d30-7516d75d888b None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:26.964743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf43d0-ec89-491d-9d30-7516d75d888b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:26.965461 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf43d0-ec89-491d-9d30-7516d75d888b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:26.968559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf43d0-ec89-491d-9d30-7516d75d888b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:26.998448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 347/687] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:27.001048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf43d0-ec89-491d-9d30-7516d75d888b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:27.043982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:27.056325 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd84b8-e422-4380-b900-389a419d95a7 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:27.138905 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6851d-8ac9-4296-908d-062cf4dd3484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:27.141860 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6851d-8ac9-4296-908d-062cf4dd3484 None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:27.142454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6851d-8ac9-4296-908d-062cf4dd3484 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:27.142956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6851d-8ac9-4296-908d-062cf4dd3484 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:27.144241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6851d-8ac9-4296-908d-062cf4dd3484 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:27.147348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6851d-8ac9-4296-908d-062cf4dd3484 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:27.191062 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf43d0-ec89-491d-9d30-7516d75d888b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:27.195626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:27.251239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 341/688] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:56:26 2022] POST /identity/v3/users => generated 254 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:56:27.252419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6851d-8ac9-4296-908d-062cf4dd3484 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:27.281211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6145-c3b6-4517-a9fb-d8cc55ef1a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:27.283037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6145-c3b6-4517-a9fb-d8cc55ef1a72 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:27.283986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6145-c3b6-4517-a9fb-d8cc55ef1a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:27.284879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6145-c3b6-4517-a9fb-d8cc55ef1a72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:27.444060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b6145-c3b6-4517-a9fb-d8cc55ef1a72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:27.446457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b6145-c3b6-4517-a9fb-d8cc55ef1a72 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:27.558405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6851d-8ac9-4296-908d-062cf4dd3484 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:27.633039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d90546-7751-4de7-8593-67dc3ee38935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:27.635582 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d90546-7751-4de7-8593-67dc3ee38935 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:27.635582 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d90546-7751-4de7-8593-67dc3ee38935 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:27.635582 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d90546-7751-4de7-8593-67dc3ee38935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:27.637264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d90546-7751-4de7-8593-67dc3ee38935 None admin] RBAC: Adding query filter params (role.id=ce31429587b44a7aafb4f600c011be4a, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=e44d2d2b50484fb89b0688ff28615d05) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:27.637264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d90546-7751-4de7-8593-67dc3ee38935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:27.639648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d90546-7751-4de7-8593-67dc3ee38935 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:27.659664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 342/689] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:27 2022] GET /identity/v3/role_assignments?user.id=e44d2d2b50484fb89b0688ff28615d05&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=ce31429587b44a7aafb4f600c011be4a => generated 608 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:27.746089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 348/690] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:56:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:27.761291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d90546-7751-4de7-8593-67dc3ee38935 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:27.829207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:28.025528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d90546-7751-4de7-8593-67dc3ee38935 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:28.103608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed35fc1-7583-4edf-b46f-e0622de067cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:28.104768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed35fc1-7583-4edf-b46f-e0622de067cf None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:28.105258 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed35fc1-7583-4edf-b46f-e0622de067cf None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:28.105735 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed35fc1-7583-4edf-b46f-e0622de067cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:28.127719 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed35fc1-7583-4edf-b46f-e0622de067cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:28.130564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed35fc1-7583-4edf-b46f-e0622de067cf None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:28.169431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-2ed35fc1-7583-4edf-b46f-e0622de067cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:28.169431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:28.169431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:28.169431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:28.169431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:28.169431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:28.169431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:28.169431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:28.169431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:28.169431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:28.169431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:28.169431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:28.169431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:28.169431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:28.169431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:28.171220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:28.172932 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:28.172932 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:28.172932 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:28.172932 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:28.173934 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 343/691] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:28.183024 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6145-c3b6-4517-a9fb-d8cc55ef1a72 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:28.186811 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:28.422391 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6145-c3b6-4517-a9fb-d8cc55ef1a72 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:28.513251 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a120a48-8b53-4363-885b-f6b27150811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:28.514383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a120a48-8b53-4363-885b-f6b27150811e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:28.514904 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a120a48-8b53-4363-885b-f6b27150811e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:28.515406 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a120a48-8b53-4363-885b-f6b27150811e None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:28.516798 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a120a48-8b53-4363-885b-f6b27150811e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:28.517349 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a120a48-8b53-4363-885b-f6b27150811e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:28.526784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a120a48-8b53-4363-885b-f6b27150811e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:28.568982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 349/692] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:28.578859 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed35fc1-7583-4edf-b46f-e0622de067cf None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:28.753085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:28.852017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed35fc1-7583-4edf-b46f-e0622de067cf None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:28.943029 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c55fe-b23a-46d9-aaec-d4705d0fc838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:28.944131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c55fe-b23a-46d9-aaec-d4705d0fc838 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:28.944625 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c55fe-b23a-46d9-aaec-d4705d0fc838 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:28.945103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c55fe-b23a-46d9-aaec-d4705d0fc838 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:28.970627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c55fe-b23a-46d9-aaec-d4705d0fc838 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:28.975445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7e9fe-326e-4b64-8b1f-a0250f28fac2 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:28.975913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7e9fe-326e-4b64-8b1f-a0250f28fac2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:28.976438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7e9fe-326e-4b64-8b1f-a0250f28fac2 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:28.979156 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 350/693] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:28.980068 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c55fe-b23a-46d9-aaec-d4705d0fc838 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:29.002690 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56024b77-1984-44e8-8de1-ed6bd0242eae None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:29.003268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56024b77-1984-44e8-8de1-ed6bd0242eae None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:29.003704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56024b77-1984-44e8-8de1-ed6bd0242eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:29.014842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-a28c55fe-b23a-46d9-aaec-d4705d0fc838 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:29.014842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:29.014842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:29.014842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:29.014842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:29.014842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:29.014842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:29.014842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:29.014842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:29.014842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:29.014842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:29.014842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:29.014842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:29.014842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:29.014842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:29.016547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:29.020510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:29.020510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:29.020510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:29.020510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:29.020510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:29.020510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:29.020510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:29.020510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:29.020510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 344/694] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:29.026647 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c55fe-b23a-46d9-aaec-d4705d0fc838 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:29.068826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-56024b77-1984-44e8-8de1-ed6bd0242eae None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:29.070952 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-56024b77-1984-44e8-8de1-ed6bd0242eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:29.199429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:29.222584 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 351/695] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:29.262942 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56024b77-1984-44e8-8de1-ed6bd0242eae None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:29.358728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c55fe-b23a-46d9-aaec-d4705d0fc838 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:29.424345 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:29.445201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a684-0471-4ae4-8b13-b982fafe69df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:29.446622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a684-0471-4ae4-8b13-b982fafe69df None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:29.451371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a684-0471-4ae4-8b13-b982fafe69df None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:29.451371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a684-0471-4ae4-8b13-b982fafe69df None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:29.451371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4a684-0471-4ae4-8b13-b982fafe69df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:29.451371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4a684-0471-4ae4-8b13-b982fafe69df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:29.455491 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4a684-0471-4ae4-8b13-b982fafe69df None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:29.502987 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 345/696] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:56:29.520583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a684-0471-4ae4-8b13-b982fafe69df None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:29.643200 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56024b77-1984-44e8-8de1-ed6bd0242eae None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:29.765602 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4088db-f065-4ca4-80a1-dc53d6021477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:29.767462 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4088db-f065-4ca4-80a1-dc53d6021477 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:29.768310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4088db-f065-4ca4-80a1-dc53d6021477 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:29.769086 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4088db-f065-4ca4-80a1-dc53d6021477 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:29.770758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4088db-f065-4ca4-80a1-dc53d6021477 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:29.774121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4088db-f065-4ca4-80a1-dc53d6021477 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-cd4088db-f065-4ca4-80a1-dc53d6021477 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:29.810745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:29.812588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:29.814211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:29.814211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:29.814211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:29.814211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:29.814211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:29.814211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:29.814211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:29.814211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:29.814211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:29.814211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:29.814211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:29.814211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:56:29.814211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:29.814211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:56:29.814211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:29.819996 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 352/697] 10.222.0.98 () {56 vars in 1129 bytes} [Tue Jul 26 14:56:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 558 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:29.820252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a684-0471-4ae4-8b13-b982fafe69df None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:29.823550 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3150ac-f1b4-49b9-8c40-37e45955f965 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:29.824402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3150ac-f1b4-49b9-8c40-37e45955f965 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:29.825321 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3150ac-f1b4-49b9-8c40-37e45955f965 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:29.836203 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 353/698] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:29.836203 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3150ac-f1b4-49b9-8c40-37e45955f965 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:29.894349 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc89eea-a11c-4ea1-88bd-4280cc0b7e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:29.895448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc89eea-a11c-4ea1-88bd-4280cc0b7e2c None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:29.895935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc89eea-a11c-4ea1-88bd-4280cc0b7e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:29.896432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc89eea-a11c-4ea1-88bd-4280cc0b7e2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:29.898065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc89eea-a11c-4ea1-88bd-4280cc0b7e2c None admin] RBAC: Adding query filter params (role.id=ce31429587b44a7aafb4f600c011be4a, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=013ae8b88160433db6876f84947f0d8c) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:29.898653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc89eea-a11c-4ea1-88bd-4280cc0b7e2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:29.902579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc89eea-a11c-4ea1-88bd-4280cc0b7e2c None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:29.921494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 346/699] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:29 2022] GET /identity/v3/role_assignments?user.id=013ae8b88160433db6876f84947f0d8c&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=ce31429587b44a7aafb4f600c011be4a => generated 608 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:29.924623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:29.925419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2356b91-625b-49e1-97a6-850f09955b9e None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:29.925797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2356b91-625b-49e1-97a6-850f09955b9e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:29.926287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2356b91-625b-49e1-97a6-850f09955b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:29.990134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d2356b91-625b-49e1-97a6-850f09955b9e None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:29.995068 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d2356b91-625b-49e1-97a6-850f09955b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:30.033123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3150ac-f1b4-49b9-8c40-37e45955f965 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:30.071060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:30.102642 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 347/700] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:30.139108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2356b91-625b-49e1-97a6-850f09955b9e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:30.168488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e89d94-7632-4bc5-9aee-d60346c8ad52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:30.170682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e89d94-7632-4bc5-9aee-d60346c8ad52 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:30.171473 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e89d94-7632-4bc5-9aee-d60346c8ad52 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:30.172122 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e89d94-7632-4bc5-9aee-d60346c8ad52 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:30.173948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e89d94-7632-4bc5-9aee-d60346c8ad52 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:30.174901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e89d94-7632-4bc5-9aee-d60346c8ad52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:30.177269 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e89d94-7632-4bc5-9aee-d60346c8ad52 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:30.185078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 354/701] 10.222.0.98 () {56 vars in 1124 bytes} [Tue Jul 26 14:56:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:30.194698 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e89d94-7632-4bc5-9aee-d60346c8ad52 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:30.434405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2356b91-625b-49e1-97a6-850f09955b9e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:30.469525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e89d94-7632-4bc5-9aee-d60346c8ad52 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:30.518599 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ded4a8-892d-40e2-85e9-ec0f98813cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:30.519697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ded4a8-892d-40e2-85e9-ec0f98813cde None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:30.520196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ded4a8-892d-40e2-85e9-ec0f98813cde None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:30.520705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ded4a8-892d-40e2-85e9-ec0f98813cde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:30.522115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:30.537670 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ded4a8-892d-40e2-85e9-ec0f98813cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-f2ded4a8-892d-40e2-85e9-ec0f98813cde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:30.548202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:30.549393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:30.550482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:30.550482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:30.550482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:30.550482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:30.550482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:30.550482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:30.550482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:30.550482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:30.550482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:30.550482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:30.550482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:56:30.550482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:30.554785 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 348/702] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:56:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:56:30.560642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f7d7d-7c0e-41c9-82a0-20f5ce450b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:30.561671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f7d7d-7c0e-41c9-82a0-20f5ce450b18 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:30.562088 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ded4a8-892d-40e2-85e9-ec0f98813cde None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:30.562201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f7d7d-7c0e-41c9-82a0-20f5ce450b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:30.562603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f7d7d-7c0e-41c9-82a0-20f5ce450b18 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:30.563856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f7d7d-7c0e-41c9-82a0-20f5ce450b18 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:30.564390 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f7d7d-7c0e-41c9-82a0-20f5ce450b18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:30.567278 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f7d7d-7c0e-41c9-82a0-20f5ce450b18 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:30.582065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 355/703] 10.222.0.98 () {56 vars in 1124 bytes} [Tue Jul 26 14:56:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:30.679407 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:30.756906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ded4a8-892d-40e2-85e9-ec0f98813cde None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:30.835715 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b48b04-f51a-45ac-b6bd-15745f74f24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:30.838055 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b48b04-f51a-45ac-b6bd-15745f74f24f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:30.838974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b48b04-f51a-45ac-b6bd-15745f74f24f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:30.839959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b48b04-f51a-45ac-b6bd-15745f74f24f None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:30.841750 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b48b04-f51a-45ac-b6bd-15745f74f24f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:30.842655 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b48b04-f51a-45ac-b6bd-15745f74f24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:30.845254 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b48b04-f51a-45ac-b6bd-15745f74f24f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:30.864592 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 349/704] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:56:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:56:30.874261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f7d7d-7c0e-41c9-82a0-20f5ce450b18 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:31.152683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f7d7d-7c0e-41c9-82a0-20f5ce450b18 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:31.249793 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3863c9c-5a2b-4e0a-a627-5261c2450783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:31.250966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3863c9c-5a2b-4e0a-a627-5261c2450783 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:31.251423 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3863c9c-5a2b-4e0a-a627-5261c2450783 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:31.251872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3863c9c-5a2b-4e0a-a627-5261c2450783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:31.286072 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3863c9c-5a2b-4e0a-a627-5261c2450783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:31.289176 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3863c9c-5a2b-4e0a-a627-5261c2450783 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:31.333103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-e3863c9c-5a2b-4e0a-a627-5261c2450783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:31.333103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:31.333103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:31.333103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:31.333103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:31.333103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:31.333103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:31.333103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:31.333103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:31.333103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:31.333103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:31.333103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:31.333103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:31.333103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:31.333103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:31.334891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:31.336656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:31.336656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:31.336656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:31.336656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:31.340848 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 356/705] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:31.350762 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b48b04-f51a-45ac-b6bd-15745f74f24f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:31.636361 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b48b04-f51a-45ac-b6bd-15745f74f24f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:31.641768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:31.726965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362055a-c6f2-4942-aea6-f5e0945c1760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:31.751180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362055a-c6f2-4942-aea6-f5e0945c1760 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:31.751180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362055a-c6f2-4942-aea6-f5e0945c1760 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:31.751180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362055a-c6f2-4942-aea6-f5e0945c1760 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:31.751180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362055a-c6f2-4942-aea6-f5e0945c1760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:31.751180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362055a-c6f2-4942-aea6-f5e0945c1760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:31.751180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362055a-c6f2-4942-aea6-f5e0945c1760 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:31.761030 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 350/706] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:31.770710 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3863c9c-5a2b-4e0a-a627-5261c2450783 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:31.832852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4791-dd4b-4123-a772-b18ba27d621d None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:31.833869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4791-dd4b-4123-a772-b18ba27d621d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:31.834675 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4791-dd4b-4123-a772-b18ba27d621d None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:31.842540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 351/707] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:31.846152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730714c5-7b92-4985-a1fa-666d4a1e4aa1 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:31.847135 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730714c5-7b92-4985-a1fa-666d4a1e4aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:31.847865 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730714c5-7b92-4985-a1fa-666d4a1e4aa1 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:31.855070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 352/708] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:31.857730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef390f-c75e-4003-bd3b-9d43d0173436 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:31.858749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef390f-c75e-4003-bd3b-9d43d0173436 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:31.859514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef390f-c75e-4003-bd3b-9d43d0173436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:31.870382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:31.891432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-7fef390f-c75e-4003-bd3b-9d43d0173436 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:31.894192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7fef390f-c75e-4003-bd3b-9d43d0173436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:31.999813 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3863c9c-5a2b-4e0a-a627-5261c2450783 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:32.030530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 353/709] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:32.030530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8fc22-7cda-4330-b28e-db5a07b18c33 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:32.030530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8fc22-7cda-4330-b28e-db5a07b18c33 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:32.030530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8fc22-7cda-4330-b28e-db5a07b18c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:32.087353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-09a8fc22-7cda-4330-b28e-db5a07b18c33 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:32.089947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-09a8fc22-7cda-4330-b28e-db5a07b18c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:32.092091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a6396-4520-4fa9-b60e-98b8308423a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:32.092851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a6396-4520-4fa9-b60e-98b8308423a1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:32.093156 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a6396-4520-4fa9-b60e-98b8308423a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:32.093608 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a6396-4520-4fa9-b60e-98b8308423a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:32.105261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a6396-4520-4fa9-b60e-98b8308423a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:32.107575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a6396-4520-4fa9-b60e-98b8308423a1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-5a7a6396-4520-4fa9-b60e-98b8308423a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:32.125834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:32.127457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:32.128420 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:32.128420 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:32.128420 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:32.128420 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:32.128420 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:32.128420 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:32.128420 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:32.128420 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:32.128420 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:56:32.128420 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:32.131453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 357/710] 10.222.0.98 () {56 vars in 1093 bytes} [Tue Jul 26 14:56:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:32.133437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a6396-4520-4fa9-b60e-98b8308423a1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:32.227856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 354/711] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:32.229110 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8fc22-7cda-4330-b28e-db5a07b18c33 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:32.262005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:32.280262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:32.290807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a6396-4520-4fa9-b60e-98b8308423a1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:32.369619 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf25c12-aae9-4e5a-9d47-14797b0ae59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:32.370509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf25c12-aae9-4e5a-9d47-14797b0ae59e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:32.370869 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf25c12-aae9-4e5a-9d47-14797b0ae59e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:32.371184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf25c12-aae9-4e5a-9d47-14797b0ae59e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:32.389009 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf25c12-aae9-4e5a-9d47-14797b0ae59e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-9bf25c12-aae9-4e5a-9d47-14797b0ae59e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:32.397456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:32.399474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:32.401056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:32.401056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:32.401056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:32.401056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:32.401056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:32.401056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:32.401056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:32.401056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:32.401056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:32.401056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:32.401056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:32.401056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:32.405172 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 358/712] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:32.405172 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf25c12-aae9-4e5a-9d47-14797b0ae59e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:32.446616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8fc22-7cda-4330-b28e-db5a07b18c33 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:32.526191 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b1ac2-d3e0-436d-9fdf-1cd283883d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:32.527656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b1ac2-d3e0-436d-9fdf-1cd283883d09 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:32.528471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b1ac2-d3e0-436d-9fdf-1cd283883d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:32.529304 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b1ac2-d3e0-436d-9fdf-1cd283883d09 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:32.530931 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b1ac2-d3e0-436d-9fdf-1cd283883d09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:32.531689 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b1ac2-d3e0-436d-9fdf-1cd283883d09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:32.535058 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b1ac2-d3e0-436d-9fdf-1cd283883d09 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:32.577747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 355/713] 10.222.0.98 () {56 vars in 1133 bytes} [Tue Jul 26 14:56:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:32.579296 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b1ac2-d3e0-436d-9fdf-1cd283883d09 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:32.611496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf25c12-aae9-4e5a-9d47-14797b0ae59e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:32.709320 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42370f82-2b91-4f3c-94f0-d538c7681afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:32.712310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42370f82-2b91-4f3c-94f0-d538c7681afd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:32.714583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42370f82-2b91-4f3c-94f0-d538c7681afd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:32.715855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42370f82-2b91-4f3c-94f0-d538c7681afd None admin] PATH_INFO: `/v3/services/network` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:32.718389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42370f82-2b91-4f3c-94f0-d538c7681afd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:32.721701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42370f82-2b91-4f3c-94f0-d538c7681afd None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-42370f82-2b91-4f3c-94f0-d538c7681afd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:32.740988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:32.742924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:32.745194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:32.745194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:32.745194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:32.745194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:32.745194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:32.745194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:32.745194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:32.745194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:32.745194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:32.745194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:32.745194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:56:32.745194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:32.745194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:56:32.745194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:32.745194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 359/714] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:32 2022] GET /identity/v3/services/network => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:32.746730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42370f82-2b91-4f3c-94f0-d538c7681afd None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:32.776117 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:32.784220 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:32.809597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b1ac2-d3e0-436d-9fdf-1cd283883d09 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:32.865113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa8a3f-2d5b-479b-b524-37457f46f77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:32.867338 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa8a3f-2d5b-479b-b524-37457f46f77e None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:32.867916 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa8a3f-2d5b-479b-b524-37457f46f77e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:32.868453 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa8a3f-2d5b-479b-b524-37457f46f77e None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:32.869970 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa8a3f-2d5b-479b-b524-37457f46f77e None admin] RBAC: Adding query filter params (name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:32.870575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa8a3f-2d5b-479b-b524-37457f46f77e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:32.872621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa8a3f-2d5b-479b-b524-37457f46f77e None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:32.886771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 356/715] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:56:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:32.888537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa8a3f-2d5b-479b-b524-37457f46f77e None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:32.926405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42370f82-2b91-4f3c-94f0-d538c7681afd None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:32.979917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ffab2-3bf1-4b5a-8ffe-9fdafc0bc96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:32.980584 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ffab2-3bf1-4b5a-8ffe-9fdafc0bc96f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:32.980873 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ffab2-3bf1-4b5a-8ffe-9fdafc0bc96f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:32.981152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ffab2-3bf1-4b5a-8ffe-9fdafc0bc96f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:33.043147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa8a3f-2d5b-479b-b524-37457f46f77e None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:33.091226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ffab2-3bf1-4b5a-8ffe-9fdafc0bc96f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:33.092770 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ffab2-3bf1-4b5a-8ffe-9fdafc0bc96f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:33.096076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939f8c7-b694-4436-86a9-2f7ffbbd0713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:33.097082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939f8c7-b694-4436-86a9-2f7ffbbd0713 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:33.097616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939f8c7-b694-4436-86a9-2f7ffbbd0713 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:33.098099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939f8c7-b694-4436-86a9-2f7ffbbd0713 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:33.099185 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939f8c7-b694-4436-86a9-2f7ffbbd0713 None admin] RBAC: Adding query filter params (name=network) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:33.099844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939f8c7-b694-4436-86a9-2f7ffbbd0713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:33.102841 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939f8c7-b694-4436-86a9-2f7ffbbd0713 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:33.109665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 357/716] 10.222.0.98 () {56 vars in 1112 bytes} [Tue Jul 26 14:56:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:33.111646 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939f8c7-b694-4436-86a9-2f7ffbbd0713 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:33.129746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:33.130243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:33.257564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 360/717] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:56:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:33.258763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ffab2-3bf1-4b5a-8ffe-9fdafc0bc96f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:33.276584 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939f8c7-b694-4436-86a9-2f7ffbbd0713 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:33.327198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d158ca-001c-4d1b-9ba3-e231e5dd6514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:33.328531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d158ca-001c-4d1b-9ba3-e231e5dd6514 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:33.329233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d158ca-001c-4d1b-9ba3-e231e5dd6514 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:33.329835 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d158ca-001c-4d1b-9ba3-e231e5dd6514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:33.346829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d158ca-001c-4d1b-9ba3-e231e5dd6514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:33.348744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d158ca-001c-4d1b-9ba3-e231e5dd6514 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:33.374199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-35d158ca-001c-4d1b-9ba3-e231e5dd6514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:33.374199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:33.374199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:33.374199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:33.374199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:33.374199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:33.374199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:33.374199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:33.374199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:33.374199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:33.374199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:33.374199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:33.374199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:33.374199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:33.374199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:33.375966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:33.377715 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:33.377715 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:33.377715 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:33.377715 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:33.380901 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 358/718] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:33.382574 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d158ca-001c-4d1b-9ba3-e231e5dd6514 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:33.430406 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ffab2-3bf1-4b5a-8ffe-9fdafc0bc96f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:33.468367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:33.472037 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:33.495670 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a6ca8-bf16-4570-a6a3-a0bb94f60f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:33.496364 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a6ca8-bf16-4570-a6a3-a0bb94f60f82 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:33.496755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a6ca8-bf16-4570-a6a3-a0bb94f60f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:33.497138 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a6ca8-bf16-4570-a6a3-a0bb94f60f82 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:33.497970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a6ca8-bf16-4570-a6a3-a0bb94f60f82 None admin] RBAC: Adding query filter params (type=network) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:33.498410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a6ca8-bf16-4570-a6a3-a0bb94f60f82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:33.500287 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a6ca8-bf16-4570-a6a3-a0bb94f60f82 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:33.507960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 361/719] 10.222.0.98 () {56 vars in 1112 bytes} [Tue Jul 26 14:56:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:33.510041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a6ca8-bf16-4570-a6a3-a0bb94f60f82 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:33.545062 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d158ca-001c-4d1b-9ba3-e231e5dd6514 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:33.625027 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e68fd3-9012-4af3-b904-c184af9874f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:33.626318 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e68fd3-9012-4af3-b904-c184af9874f7 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:33.626894 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e68fd3-9012-4af3-b904-c184af9874f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:33.627441 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e68fd3-9012-4af3-b904-c184af9874f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:33.666514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e68fd3-9012-4af3-b904-c184af9874f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:33.670154 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e68fd3-9012-4af3-b904-c184af9874f7 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:33.674401 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a6ca8-bf16-4570-a6a3-a0bb94f60f82 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:33.725280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-80e68fd3-9012-4af3-b904-c184af9874f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:33.725280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:33.725280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:33.725280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:33.725280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:33.725280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:33.725280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:33.725280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:33.725280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:33.725280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:33.725280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:33.725280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:33.725280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:33.725280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:33.725280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:33.727124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:33.728973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:33.728973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:33.728973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:33.728973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:33.735433 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e019a-673a-4219-b942-f436c6a5e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:33.736184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e019a-673a-4219-b942-f436c6a5e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:33.736469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e019a-673a-4219-b942-f436c6a5e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:33.736720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e019a-673a-4219-b942-f436c6a5e1b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:33.737518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e019a-673a-4219-b942-f436c6a5e1b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:33.737896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e019a-673a-4219-b942-f436c6a5e1b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:33.739712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e019a-673a-4219-b942-f436c6a5e1b4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:33.740420 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 359/720] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:33.750941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e68fd3-9012-4af3-b904-c184af9874f7 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:33.759234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 362/721] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:33.771666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e019a-673a-4219-b942-f436c6a5e1b4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:33.865720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:33.939360 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e019a-673a-4219-b942-f436c6a5e1b4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:33.991238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c0262-7b89-476f-898d-aa43774ef04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:33.991959 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c0262-7b89-476f-898d-aa43774ef04a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:33.992336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c0262-7b89-476f-898d-aa43774ef04a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:33.992618 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c0262-7b89-476f-898d-aa43774ef04a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:34.012718 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c0262-7b89-476f-898d-aa43774ef04a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:34.014304 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c0262-7b89-476f-898d-aa43774ef04a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-143c0262-7b89-476f-898d-aa43774ef04a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:34.048496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:34.050444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:34.052381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:34.052381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:34.052381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:34.052381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:34.052381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:34.052381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:34.052381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:34.052381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:34.052381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:56:34.052381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:34.065235 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e68fd3-9012-4af3-b904-c184af9874f7 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:34.068174 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 363/722] 10.222.0.98 () {56 vars in 1117 bytes} [Tue Jul 26 14:56:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:56:34.071654 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c0262-7b89-476f-898d-aa43774ef04a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:34.123416 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:34.199237 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b9ea8-6935-4d3a-ac21-4f40a797e223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:34.200158 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b9ea8-6935-4d3a-ac21-4f40a797e223 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:34.200489 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b9ea8-6935-4d3a-ac21-4f40a797e223 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:34.200772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b9ea8-6935-4d3a-ac21-4f40a797e223 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:34.201686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b9ea8-6935-4d3a-ac21-4f40a797e223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:34.201997 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b9ea8-6935-4d3a-ac21-4f40a797e223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:34.203677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b9ea8-6935-4d3a-ac21-4f40a797e223 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:34.239993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 360/723] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:56:34.242347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1143d-21ac-41d5-9424-490224a92f77 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:34.242874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1143d-21ac-41d5-9424-490224a92f77 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:34.243334 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1143d-21ac-41d5-9424-490224a92f77 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:34.246410 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 361/724] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:34.247864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1143d-21ac-41d5-9424-490224a92f77 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:34.261822 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c0262-7b89-476f-898d-aa43774ef04a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:34.266020 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:34.330406 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617efe3a-14f0-4d8d-93c7-3412adfdef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:34.331301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617efe3a-14f0-4d8d-93c7-3412adfdef96 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:34.331695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617efe3a-14f0-4d8d-93c7-3412adfdef96 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:34.331976 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617efe3a-14f0-4d8d-93c7-3412adfdef96 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:34.332798 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617efe3a-14f0-4d8d-93c7-3412adfdef96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:34.333135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617efe3a-14f0-4d8d-93c7-3412adfdef96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:34.334894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617efe3a-14f0-4d8d-93c7-3412adfdef96 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:34.370048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 364/725] 10.222.0.98 () {56 vars in 1149 bytes} [Tue Jul 26 14:56:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:34.372159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73366c47-dbbc-4916-bde9-5163b15aecdd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:34.372588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73366c47-dbbc-4916-bde9-5163b15aecdd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:34.373043 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73366c47-dbbc-4916-bde9-5163b15aecdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:34.408051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-73366c47-dbbc-4916-bde9-5163b15aecdd None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:34.409372 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-73366c47-dbbc-4916-bde9-5163b15aecdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:34.477374 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1143d-21ac-41d5-9424-490224a92f77 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:34.551735 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfacf42-9935-424a-a661-c8817afb3b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:34.552888 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfacf42-9935-424a-a661-c8817afb3b82 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:34.553349 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfacf42-9935-424a-a661-c8817afb3b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:34.553801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfacf42-9935-424a-a661-c8817afb3b82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:34.571003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 365/726] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:34.573557 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73366c47-dbbc-4916-bde9-5163b15aecdd None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:34.591341 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfacf42-9935-424a-a661-c8817afb3b82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:34.594429 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfacf42-9935-424a-a661-c8817afb3b82 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:34.641284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-4cfacf42-9935-424a-a661-c8817afb3b82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:34.641284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:34.641284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:34.641284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:34.641284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:34.641284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:34.641284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:34.641284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:34.641284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:34.641284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:34.641284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:34.641284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:34.641284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:34.641284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:34.641284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:34.643462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:34.645492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:34.645492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:34.645492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:34.645492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:34.645492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:34.645492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:34.645492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:34.645492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:34.645492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 362/727] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:34.648882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfacf42-9935-424a-a661-c8817afb3b82 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:34.719586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:34.765031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:34.782641 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73366c47-dbbc-4916-bde9-5163b15aecdd None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:34.843948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92a469-aadc-4010-a184-fc0b7b5447b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:34.844605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92a469-aadc-4010-a184-fc0b7b5447b6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:34.844902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92a469-aadc-4010-a184-fc0b7b5447b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:34.845166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92a469-aadc-4010-a184-fc0b7b5447b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:34.850017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfacf42-9935-424a-a661-c8817afb3b82 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:34.905661 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c2e84-cdd7-4a45-99ba-cc357c65d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:34.906769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c2e84-cdd7-4a45-99ba-cc357c65d78f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:34.907239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c2e84-cdd7-4a45-99ba-cc357c65d78f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:34.907720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c2e84-cdd7-4a45-99ba-cc357c65d78f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:34.925276 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c2e84-cdd7-4a45-99ba-cc357c65d78f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-323c2e84-cdd7-4a45-99ba-cc357c65d78f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:34.931806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:34.933846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:34.935681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:34.935681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:34.935681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:34.935681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:34.935681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:34.935681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:34.935681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:34.935681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:34.935681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:34.935681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:34.935681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:56:34.935681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:34.935681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 363/728] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:56:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:34.935681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c2e84-cdd7-4a45-99ba-cc357c65d78f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:34.972946 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92a469-aadc-4010-a184-fc0b7b5447b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:34.975311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92a469-aadc-4010-a184-fc0b7b5447b6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:35.115462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:35.141862 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c2e84-cdd7-4a45-99ba-cc357c65d78f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:35.144828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:35.158655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 366/729] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:56:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:35.159720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ea2ea-c07c-4e4f-b538-0e9491624389 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:35.160016 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ea2ea-c07c-4e4f-b538-0e9491624389 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:35.160363 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ea2ea-c07c-4e4f-b538-0e9491624389 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:35.167297 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 367/730] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:35.168474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ea2ea-c07c-4e4f-b538-0e9491624389 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:35.216876 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699a6b7-31e7-49b2-8ba6-d09dcb706241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:35.218006 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699a6b7-31e7-49b2-8ba6-d09dcb706241 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:35.218875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699a6b7-31e7-49b2-8ba6-d09dcb706241 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:35.218875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699a6b7-31e7-49b2-8ba6-d09dcb706241 None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:35.219667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699a6b7-31e7-49b2-8ba6-d09dcb706241 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:35.220382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699a6b7-31e7-49b2-8ba6-d09dcb706241 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:35.222782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699a6b7-31e7-49b2-8ba6-d09dcb706241 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:35.250409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 364/731] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:35.250409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1c037-e102-4e35-86ad-d6775c59fb25 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:35.250409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1c037-e102-4e35-86ad-d6775c59fb25 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:35.250409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1c037-e102-4e35-86ad-d6775c59fb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:35.277341 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b9f1c037-e102-4e35-86ad-d6775c59fb25 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:35.279270 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b9f1c037-e102-4e35-86ad-d6775c59fb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:35.377896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ea2ea-c07c-4e4f-b538-0e9491624389 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:35.398868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 365/732] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:35.400808 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1c037-e102-4e35-86ad-d6775c59fb25 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:35.442555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967cffc-4a02-4fcd-9ccb-f014262aa3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:35.443552 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967cffc-4a02-4fcd-9ccb-f014262aa3ef None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:35.444035 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967cffc-4a02-4fcd-9ccb-f014262aa3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:35.444515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967cffc-4a02-4fcd-9ccb-f014262aa3ef None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:35.445406 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967cffc-4a02-4fcd-9ccb-f014262aa3ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:35.445888 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967cffc-4a02-4fcd-9ccb-f014262aa3ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:35.449080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967cffc-4a02-4fcd-9ccb-f014262aa3ef None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:35.463621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 368/733] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:56:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:35.465238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967cffc-4a02-4fcd-9ccb-f014262aa3ef None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:35.565255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:35.574966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:35.604052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1c037-e102-4e35-86ad-d6775c59fb25 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:35.658065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617866e-c1ab-4270-9619-6641dee618df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:35.658985 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617866e-c1ab-4270-9619-6641dee618df None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:35.659424 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617866e-c1ab-4270-9619-6641dee618df None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:35.659855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617866e-c1ab-4270-9619-6641dee618df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:35.660942 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967cffc-4a02-4fcd-9ccb-f014262aa3ef None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:35.680406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617866e-c1ab-4270-9619-6641dee618df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:35.683458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617866e-c1ab-4270-9619-6641dee618df None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:35.706131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-8617866e-c1ab-4270-9619-6641dee618df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:35.706131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:35.706131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:35.706131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:35.706131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:35.706131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:35.706131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:35.706131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:35.706131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:35.706131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:35.706131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:35.706131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:35.706131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:35.706131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:35.706131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:35.708146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:35.709864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:35.709864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:35.709864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:35.709864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:35.709864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 366/734] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:35.709864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617866e-c1ab-4270-9619-6641dee618df None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:35.738554 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760bd9b-3a09-4e8b-b84f-ce3b0ea9542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:35.739593 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760bd9b-3a09-4e8b-b84f-ce3b0ea9542d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:35.740122 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760bd9b-3a09-4e8b-b84f-ce3b0ea9542d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:35.740573 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760bd9b-3a09-4e8b-b84f-ce3b0ea9542d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:35.741994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760bd9b-3a09-4e8b-b84f-ce3b0ea9542d None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=a4a6c0e7ca434010980d7cac1800dbe9) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:35.742522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760bd9b-3a09-4e8b-b84f-ce3b0ea9542d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:35.745273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760bd9b-3a09-4e8b-b84f-ce3b0ea9542d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:35.755356 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 369/735] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:35 2022] GET /identity/v3/role_assignments?user.id=a4a6c0e7ca434010980d7cac1800dbe9&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=17054492864541709fda49dbf677a7a2 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:35.756729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760bd9b-3a09-4e8b-b84f-ce3b0ea9542d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:35.887262 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617866e-c1ab-4270-9619-6641dee618df None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:35.956807 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860adb67-d309-47d4-862f-13f71c1c8094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:35.957849 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860adb67-d309-47d4-862f-13f71c1c8094 None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:35.958242 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860adb67-d309-47d4-862f-13f71c1c8094 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:35.958749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860adb67-d309-47d4-862f-13f71c1c8094 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:35.960100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860adb67-d309-47d4-862f-13f71c1c8094 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:35.963438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860adb67-d309-47d4-862f-13f71c1c8094 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:35.969989 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:35.972297 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760bd9b-3a09-4e8b-b84f-ce3b0ea9542d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:36.012751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:36.037556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e4b9e-3c8c-4f63-b3ee-f8080202f862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:36.038532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e4b9e-3c8c-4f63-b3ee-f8080202f862 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:36.039768 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e4b9e-3c8c-4f63-b3ee-f8080202f862 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:36.039768 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e4b9e-3c8c-4f63-b3ee-f8080202f862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:36.055877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e4b9e-3c8c-4f63-b3ee-f8080202f862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:36.057814 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e4b9e-3c8c-4f63-b3ee-f8080202f862 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:36.079318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-221e4b9e-3c8c-4f63-b3ee-f8080202f862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:36.079318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:36.079318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:36.079318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:36.079318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:36.079318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:36.079318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:36.079318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:36.079318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:36.079318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:36.079318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:36.079318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:36.079318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:36.079318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:36.079318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:36.081045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:36.083622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:36.083622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:36.083622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:36.083622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:36.083622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 370/736] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:36.083622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e4b9e-3c8c-4f63-b3ee-f8080202f862 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:36.131145 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 367/737] 10.222.0.98 () {60 vars in 1141 bytes} [Tue Jul 26 14:56:35 2022] POST /identity/v3/services => generated 251 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:56:36.133834 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860adb67-d309-47d4-862f-13f71c1c8094 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:36.346293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860adb67-d309-47d4-862f-13f71c1c8094 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:36.395127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e4b9e-3c8c-4f63-b3ee-f8080202f862 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:36.407976 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee1e5-548b-47c1-a235-63fb559ffd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:36.408947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee1e5-548b-47c1-a235-63fb559ffd8b None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:36.409245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee1e5-548b-47c1-a235-63fb559ffd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:36.409524 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee1e5-548b-47c1-a235-63fb559ffd8b None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:36.410409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fee1e5-548b-47c1-a235-63fb559ffd8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:36.410730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fee1e5-548b-47c1-a235-63fb559ffd8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:36.412913 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fee1e5-548b-47c1-a235-63fb559ffd8b None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:36.429852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 368/738] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:36.441911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee1e5-548b-47c1-a235-63fb559ffd8b None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:36.481149 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e86291-6d95-4373-b42f-9759e2af38fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:36.482436 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e86291-6d95-4373-b42f-9759e2af38fa None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:36.483025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e86291-6d95-4373-b42f-9759e2af38fa None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:36.483540 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e86291-6d95-4373-b42f-9759e2af38fa None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:36.485059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e86291-6d95-4373-b42f-9759e2af38fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:36.485631 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e86291-6d95-4373-b42f-9759e2af38fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:36.487803 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e86291-6d95-4373-b42f-9759e2af38fa None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:36.505250 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 371/739] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:36.515124 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e86291-6d95-4373-b42f-9759e2af38fa None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:36.574929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:36.603505 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:36.684855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee1e5-548b-47c1-a235-63fb559ffd8b None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:36.727166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e86291-6d95-4373-b42f-9759e2af38fa None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:36.773294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce9e59-9e4d-45a9-a3be-a9adcaa26343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:36.774580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce9e59-9e4d-45a9-a3be-a9adcaa26343 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:36.775648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce9e59-9e4d-45a9-a3be-a9adcaa26343 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:36.776121 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce9e59-9e4d-45a9-a3be-a9adcaa26343 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:36.792431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce9e59-9e4d-45a9-a3be-a9adcaa26343 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:36.795170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce9e59-9e4d-45a9-a3be-a9adcaa26343 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-81ce9e59-9e4d-45a9-a3be-a9adcaa26343 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:36.819677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:36.821255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:36.823771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:36.823771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:36.823771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:36.823771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:36.823771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:36.823771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:36.823771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:36.823771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:36.823771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:56:36.823771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:36.823771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 369/740] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:56:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:56:36.830405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c41a0-d174-40d9-b0e5-42cd06ad0516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:36.830405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c41a0-d174-40d9-b0e5-42cd06ad0516 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:36.830405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c41a0-d174-40d9-b0e5-42cd06ad0516 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:36.830405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c41a0-d174-40d9-b0e5-42cd06ad0516 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:36.834556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce9e59-9e4d-45a9-a3be-a9adcaa26343 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:36.843355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c41a0-d174-40d9-b0e5-42cd06ad0516 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:36.846128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c41a0-d174-40d9-b0e5-42cd06ad0516 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:36.870422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-317c41a0-d174-40d9-b0e5-42cd06ad0516 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:36.870422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:36.870422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:36.870422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:36.870422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:36.870422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:36.870422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:36.870422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:36.870422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:36.870422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:36.870422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:36.870422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:36.870422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:36.870422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:36.870422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:36.873821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:36.876127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:36.876127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:36.876127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:36.876127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:36.876127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:36.876127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:36.876127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:36.876127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:36.876127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 372/741] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:36.882060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c41a0-d174-40d9-b0e5-42cd06ad0516 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:37.131732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce9e59-9e4d-45a9-a3be-a9adcaa26343 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:37.151622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:37.194155 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:37.218612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c41a0-d174-40d9-b0e5-42cd06ad0516 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:37.228254 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91046d52-297d-4815-b53b-6390b35d040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:37.229371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91046d52-297d-4815-b53b-6390b35d040c None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:37.229916 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91046d52-297d-4815-b53b-6390b35d040c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:37.230494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91046d52-297d-4815-b53b-6390b35d040c None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:37.231949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91046d52-297d-4815-b53b-6390b35d040c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:37.232573 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91046d52-297d-4815-b53b-6390b35d040c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:37.235124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91046d52-297d-4815-b53b-6390b35d040c None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:37.286081 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 370/742] 10.222.0.98 () {56 vars in 1135 bytes} [Tue Jul 26 14:56:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:37.296064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91046d52-297d-4815-b53b-6390b35d040c None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:37.297576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963478b-541f-470a-8d48-74b93831e248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:37.298549 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963478b-541f-470a-8d48-74b93831e248 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:37.299076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963478b-541f-470a-8d48-74b93831e248 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:37.299570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963478b-541f-470a-8d48-74b93831e248 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:37.300856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963478b-541f-470a-8d48-74b93831e248 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:37.301489 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963478b-541f-470a-8d48-74b93831e248 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:37.303265 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963478b-541f-470a-8d48-74b93831e248 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:37.325401 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 373/743] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:37.335476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963478b-541f-470a-8d48-74b93831e248 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:37.550917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963478b-541f-470a-8d48-74b93831e248 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:37.553724 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91046d52-297d-4815-b53b-6390b35d040c None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:37.599068 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05167383-8f73-4ba5-94e0-5b557a5c0168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:37.600076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05167383-8f73-4ba5-94e0-5b557a5c0168 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:37.600576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05167383-8f73-4ba5-94e0-5b557a5c0168 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:37.601259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05167383-8f73-4ba5-94e0-5b557a5c0168 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:37.602628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05167383-8f73-4ba5-94e0-5b557a5c0168 None admin] RBAC: Adding query filter params (role.id=ce31429587b44a7aafb4f600c011be4a, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=3497ed5c5d204d088a178a9560ee83cf) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:37.603834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05167383-8f73-4ba5-94e0-5b557a5c0168 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:37.605985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05167383-8f73-4ba5-94e0-5b557a5c0168 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:37.613667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 374/744] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:37 2022] GET /identity/v3/role_assignments?user.id=3497ed5c5d204d088a178a9560ee83cf&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=ce31429587b44a7aafb4f600c011be4a => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:56:37.615553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c0ae5-e227-4c71-954e-199553ce1ec7 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:37.616193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c0ae5-e227-4c71-954e-199553ce1ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:37.616747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c0ae5-e227-4c71-954e-199553ce1ec7 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:37.619182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 375/745] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:37.626756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7135-a298-45a2-850b-7e6e5a8c2ec3 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:37.627991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7135-a298-45a2-850b-7e6e5a8c2ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:37.631236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7135-a298-45a2-850b-7e6e5a8c2ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:37.655915 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e0f16-ac0e-41ce-8fef-cd2a8fe94b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:37.657640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e0f16-ac0e-41ce-8fef-cd2a8fe94b8a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:37.658495 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e0f16-ac0e-41ce-8fef-cd2a8fe94b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:37.659046 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e0f16-ac0e-41ce-8fef-cd2a8fe94b8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:37.685617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a20b7135-a298-45a2-850b-7e6e5a8c2ec3 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:37.687331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a20b7135-a298-45a2-850b-7e6e5a8c2ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:37.703051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:37.780751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:37.850077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 376/746] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:37.879653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e0f16-ac0e-41ce-8fef-cd2a8fe94b8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:37.881651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e0f16-ac0e-41ce-8fef-cd2a8fe94b8a None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:37.883108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7135-a298-45a2-850b-7e6e5a8c2ec3 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:38.087547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7135-a298-45a2-850b-7e6e5a8c2ec3 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:38.132613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 371/747] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:56:37 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 835 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:38.135612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5434e1b-f490-4366-8ed3-22d523b926b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:38.136566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5434e1b-f490-4366-8ed3-22d523b926b0 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:38.137086 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5434e1b-f490-4366-8ed3-22d523b926b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:38.137558 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5434e1b-f490-4366-8ed3-22d523b926b0 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:38.138861 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e0f16-ac0e-41ce-8fef-cd2a8fe94b8a None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:38.149329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5434e1b-f490-4366-8ed3-22d523b926b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:38.152494 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5434e1b-f490-4366-8ed3-22d523b926b0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:38.245404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 377/748] 10.222.0.98 () {60 vars in 1141 bytes} [Tue Jul 26 14:56:37 2022] POST /identity/v3/services => generated 240 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:56:38.263030 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:38.314636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e0f16-ac0e-41ce-8fef-cd2a8fe94b8a None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:38.373529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a60e5-2510-4c40-ab4b-d8b554a18140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:38.374213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a60e5-2510-4c40-ab4b-d8b554a18140 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:38.374617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a60e5-2510-4c40-ab4b-d8b554a18140 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:38.374884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a60e5-2510-4c40-ab4b-d8b554a18140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:38.393529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a60e5-2510-4c40-ab4b-d8b554a18140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:38.396213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a60e5-2510-4c40-ab4b-d8b554a18140 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:38.424864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-ca5a60e5-2510-4c40-ab4b-d8b554a18140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:38.424864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:38.424864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:38.424864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:38.424864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:38.424864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:38.424864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:38.424864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:38.424864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:38.424864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:38.424864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:38.424864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:38.424864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:38.424864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:38.424864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:38.426487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:38.428114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:38.428114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:38.428114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:38.428114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:38.428114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 372/749] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:38.436232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5434e1b-f490-4366-8ed3-22d523b926b0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:38.452710 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:38.735776 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5434e1b-f490-4366-8ed3-22d523b926b0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:38.811334 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bda97-f702-4710-9a8d-676f97dc8a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:38.812440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bda97-f702-4710-9a8d-676f97dc8a62 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:38.812930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bda97-f702-4710-9a8d-676f97dc8a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:38.813435 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bda97-f702-4710-9a8d-676f97dc8a62 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:38.814798 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bda97-f702-4710-9a8d-676f97dc8a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:38.815344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bda97-f702-4710-9a8d-676f97dc8a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:38.817986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bda97-f702-4710-9a8d-676f97dc8a62 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:38.846047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 378/750] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:38.855603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a60e5-2510-4c40-ab4b-d8b554a18140 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:39.017375 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a60e5-2510-4c40-ab4b-d8b554a18140 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:39.039976 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:39.075662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9491d9a-538e-454b-9606-322cb7cf6ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:39.077025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9491d9a-538e-454b-9606-322cb7cf6ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:39.077508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9491d9a-538e-454b-9606-322cb7cf6ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:39.077997 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9491d9a-538e-454b-9606-322cb7cf6ab2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:39.092331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9491d9a-538e-454b-9606-322cb7cf6ab2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:39.095664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9491d9a-538e-454b-9606-322cb7cf6ab2 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:39.130238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-f9491d9a-538e-454b-9606-322cb7cf6ab2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:39.130238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:39.130238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:39.130238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:39.130238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:39.130238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:39.130238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:39.130238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:39.130238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:39.130238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:39.130238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:39.130238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:39.130238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:39.130238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:39.130238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:39.132326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:39.141233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:39.141233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:39.141233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:39.141233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:39.141233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:39.141233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:39.141233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:39.141233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:39.145384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 373/751] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:56:39.155593 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bda97-f702-4710-9a8d-676f97dc8a62 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:39.190795 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412ad13-3354-4980-af6f-4b787ce2968d None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:39.191775 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412ad13-3354-4980-af6f-4b787ce2968d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:39.192539 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412ad13-3354-4980-af6f-4b787ce2968d None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:39.196043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 374/752] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:56:39.202635 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0c76a-325b-4c1e-a8ce-b1c75c4be976 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:39.202920 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0c76a-325b-4c1e-a8ce-b1c75c4be976 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:39.203251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0c76a-325b-4c1e-a8ce-b1c75c4be976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:39.229527 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-4bf0c76a-325b-4c1e-a8ce-b1c75c4be976 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:39.230865 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4bf0c76a-325b-4c1e-a8ce-b1c75c4be976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:39.319203 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:39.373913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bda97-f702-4710-9a8d-676f97dc8a62 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:39.417142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 375/753] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:56:39.443267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479801fb-d01a-4b02-93df-704febb7155e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:39.443942 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479801fb-d01a-4b02-93df-704febb7155e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:39.444222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479801fb-d01a-4b02-93df-704febb7155e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:39.444494 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479801fb-d01a-4b02-93df-704febb7155e None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:39.445289 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479801fb-d01a-4b02-93df-704febb7155e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:39.445601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479801fb-d01a-4b02-93df-704febb7155e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:39.448124 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479801fb-d01a-4b02-93df-704febb7155e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:39.466987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 379/754] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:39.476254 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0c76a-325b-4c1e-a8ce-b1c75c4be976 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:39.479887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479801fb-d01a-4b02-93df-704febb7155e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:39.662090 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479801fb-d01a-4b02-93df-704febb7155e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:39.741078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:39.773845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122b236-6a85-4e98-a7f6-1e5773f4fa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:39.775348 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122b236-6a85-4e98-a7f6-1e5773f4fa2f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:39.775598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122b236-6a85-4e98-a7f6-1e5773f4fa2f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:39.775874 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122b236-6a85-4e98-a7f6-1e5773f4fa2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:39.812545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0c76a-325b-4c1e-a8ce-b1c75c4be976 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:39.823803 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122b236-6a85-4e98-a7f6-1e5773f4fa2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:39.828645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-4122b236-6a85-4e98-a7f6-1e5773f4fa2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:39.832875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:39.834753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:39.836454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:39.836454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:39.836454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:39.836454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:39.836454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:39.836454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:39.836454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:39.836454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:39.836454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:39.836454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:39.836454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:56:39.836454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:39.846023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 380/755] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:56:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:39.846023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaf564-882d-4873-9f1a-74fc94954cdc None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:39.846023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaf564-882d-4873-9f1a-74fc94954cdc None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:39.846023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaf564-882d-4873-9f1a-74fc94954cdc None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:39.857022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 381/756] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:39.860144 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af6280-476b-4a0e-903d-37d8160342a3 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:39.861164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af6280-476b-4a0e-903d-37d8160342a3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:39.861943 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af6280-476b-4a0e-903d-37d8160342a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:39.900413 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-42af6280-476b-4a0e-903d-37d8160342a3 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:39.902822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b3d31-7431-4cd7-8e59-264ebeb62cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:39.903523 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-42af6280-476b-4a0e-903d-37d8160342a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:39.903908 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b3d31-7431-4cd7-8e59-264ebeb62cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:39.904414 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b3d31-7431-4cd7-8e59-264ebeb62cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:39.904990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b3d31-7431-4cd7-8e59-264ebeb62cc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:39.906754 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b3d31-7431-4cd7-8e59-264ebeb62cc3 None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=013ae8b88160433db6876f84947f0d8c) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:39.907309 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b3d31-7431-4cd7-8e59-264ebeb62cc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:39.910640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b3d31-7431-4cd7-8e59-264ebeb62cc3 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:39.925996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 376/757] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:39 2022] GET /identity/v3/role_assignments?user.id=013ae8b88160433db6876f84947f0d8c&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=17054492864541709fda49dbf677a7a2 => generated 259 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:56:39.927755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b3d31-7431-4cd7-8e59-264ebeb62cc3 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:40.113543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 382/758] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:56:40.139790 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b3d31-7431-4cd7-8e59-264ebeb62cc3 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:40.186156 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af6280-476b-4a0e-903d-37d8160342a3 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:40.193817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f4952-28c0-4a9a-b663-9c3f97ebc667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:40.194963 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f4952-28c0-4a9a-b663-9c3f97ebc667 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:40.195471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f4952-28c0-4a9a-b663-9c3f97ebc667 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:40.195951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f4952-28c0-4a9a-b663-9c3f97ebc667 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:40.197504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f4952-28c0-4a9a-b663-9c3f97ebc667 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:40.198160 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f4952-28c0-4a9a-b663-9c3f97ebc667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:40.200425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f4952-28c0-4a9a-b663-9c3f97ebc667 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:40.212911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 377/759] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:56:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:40.219714 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f4952-28c0-4a9a-b663-9c3f97ebc667 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:40.262817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:40.360978 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f4952-28c0-4a9a-b663-9c3f97ebc667 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:40.410251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d355a-2cda-4e20-b0c4-c7349f663053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:40.411450 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d355a-2cda-4e20-b0c4-c7349f663053 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:40.411955 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d355a-2cda-4e20-b0c4-c7349f663053 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:40.412467 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d355a-2cda-4e20-b0c4-c7349f663053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:40.426201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af6280-476b-4a0e-903d-37d8160342a3 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:40.427671 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d355a-2cda-4e20-b0c4-c7349f663053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:40.429884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d355a-2cda-4e20-b0c4-c7349f663053 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:40.469793 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:40.472788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-430d355a-2cda-4e20-b0c4-c7349f663053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:40.472788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:40.472788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:40.472788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:40.472788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:40.472788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:40.472788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:40.472788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:40.472788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:40.472788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:40.472788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:40.472788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:40.472788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:40.472788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:40.472788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:40.474007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:40.474946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:40.474946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:40.474946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:40.474946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:40.480698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 378/760] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:40.497973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d355a-2cda-4e20-b0c4-c7349f663053 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:40.536623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab07f6-3961-4f1c-94ad-536ec169a034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:40.537618 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab07f6-3961-4f1c-94ad-536ec169a034 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:40.538047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab07f6-3961-4f1c-94ad-536ec169a034 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:40.538790 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab07f6-3961-4f1c-94ad-536ec169a034 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:40.540191 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab07f6-3961-4f1c-94ad-536ec169a034 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:40.551354 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab07f6-3961-4f1c-94ad-536ec169a034 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-20ab07f6-3961-4f1c-94ad-536ec169a034 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:40.575891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:40.577753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:40.579175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:40.579175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:40.579175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:40.579175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:40.579175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:40.579175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:40.579175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:40.579175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:40.579175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:40.579175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:40.579175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:40.579175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:56:40.579175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:40.579175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:56:40.579175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:40.588723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 383/761] 10.222.0.98 () {56 vars in 1129 bytes} [Tue Jul 26 14:56:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:40.594389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab07f6-3961-4f1c-94ad-536ec169a034 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:40.796113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:40.834973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d355a-2cda-4e20-b0c4-c7349f663053 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:40.895069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab07f6-3961-4f1c-94ad-536ec169a034 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:40.921435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0393b3-5ef8-463b-9644-24b93781eef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:40.922486 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0393b3-5ef8-463b-9644-24b93781eef4 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:40.922952 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0393b3-5ef8-463b-9644-24b93781eef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:40.923366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0393b3-5ef8-463b-9644-24b93781eef4 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:40.924575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0393b3-5ef8-463b-9644-24b93781eef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:40.925079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0393b3-5ef8-463b-9644-24b93781eef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:40.927578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0393b3-5ef8-463b-9644-24b93781eef4 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:40.972118 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97e8a2-53e2-46b7-bfa6-5d9235eec5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:40.973107 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 379/762] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:40.974205 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97e8a2-53e2-46b7-bfa6-5d9235eec5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:40.975201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97e8a2-53e2-46b7-bfa6-5d9235eec5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:40.975988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97e8a2-53e2-46b7-bfa6-5d9235eec5a8 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:40.977710 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97e8a2-53e2-46b7-bfa6-5d9235eec5a8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:40.978752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97e8a2-53e2-46b7-bfa6-5d9235eec5a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:40.980259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0393b3-5ef8-463b-9644-24b93781eef4 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:40.982106 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97e8a2-53e2-46b7-bfa6-5d9235eec5a8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:40.998710 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 384/763] 10.222.0.98 () {56 vars in 1124 bytes} [Tue Jul 26 14:56:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:41.003163 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97e8a2-53e2-46b7-bfa6-5d9235eec5a8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:41.142721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:41.266968 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0393b3-5ef8-463b-9644-24b93781eef4 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:41.292683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97e8a2-53e2-46b7-bfa6-5d9235eec5a8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:41.364389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d3914-dfe3-475e-9978-65d3957a66fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:41.368232 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d3914-dfe3-475e-9978-65d3957a66fa None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:41.369636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d3914-dfe3-475e-9978-65d3957a66fa None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:41.370599 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d3914-dfe3-475e-9978-65d3957a66fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:41.384952 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d3914-dfe3-475e-9978-65d3957a66fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:41.388443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d3914-dfe3-475e-9978-65d3957a66fa None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-082d3914-dfe3-475e-9978-65d3957a66fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:41.413048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:41.415163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:41.416800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:41.416800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:41.416800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:41.416800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:41.416800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:41.416800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:41.416800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:41.416800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:41.416800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:56:41.416800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:41.420574 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 380/764] 10.222.0.98 () {56 vars in 1093 bytes} [Tue Jul 26 14:56:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:56:41.420809 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7518127-e29a-4d20-8b81-913c18382d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:41.426461 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7518127-e29a-4d20-8b81-913c18382d30 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:41.426461 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7518127-e29a-4d20-8b81-913c18382d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:41.426461 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7518127-e29a-4d20-8b81-913c18382d30 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:41.429406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d3914-dfe3-475e-9978-65d3957a66fa None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:41.432121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7518127-e29a-4d20-8b81-913c18382d30 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:41.432713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7518127-e29a-4d20-8b81-913c18382d30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:41.434816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7518127-e29a-4d20-8b81-913c18382d30 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:41.437764 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:41.453944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 385/765] 10.222.0.98 () {56 vars in 1124 bytes} [Tue Jul 26 14:56:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:41.464507 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7518127-e29a-4d20-8b81-913c18382d30 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:41.795480 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d3914-dfe3-475e-9978-65d3957a66fa None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:41.828535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7518127-e29a-4d20-8b81-913c18382d30 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:41.844760 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:41.891887 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01d23e-897a-4925-b2a2-45a5a7448551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:41.892829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01d23e-897a-4925-b2a2-45a5a7448551 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:41.893198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01d23e-897a-4925-b2a2-45a5a7448551 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:41.894011 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01d23e-897a-4925-b2a2-45a5a7448551 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:41.895887 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01d23e-897a-4925-b2a2-45a5a7448551 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:41.896590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01d23e-897a-4925-b2a2-45a5a7448551 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:41.898287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01d23e-897a-4925-b2a2-45a5a7448551 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:41.904271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49943c4-a24e-4b71-b8e8-1480df806c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:41.905085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49943c4-a24e-4b71-b8e8-1480df806c91 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:41.905249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49943c4-a24e-4b71-b8e8-1480df806c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:41.905463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49943c4-a24e-4b71-b8e8-1480df806c91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:41.906490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49943c4-a24e-4b71-b8e8-1480df806c91 None admin] RBAC: Adding query filter params (interface=public, service_id=da97938154c5495097550f533ad67b07, region_id=RegionOne) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:41.906983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49943c4-a24e-4b71-b8e8-1480df806c91 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:41.908419 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49943c4-a24e-4b71-b8e8-1480df806c91 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:41.928529 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 386/766] 10.222.0.98 () {56 vars in 1251 bytes} [Tue Jul 26 14:56:41 2022] GET /identity/v3/endpoints?service_id=da97938154c5495097550f533ad67b07&interface=public®ion_id=RegionOne => generated 194 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:41.931627 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc4718-8bfd-491d-9474-18e16bd6e710 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:41.932955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc4718-8bfd-491d-9474-18e16bd6e710 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:41.933386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc4718-8bfd-491d-9474-18e16bd6e710 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:41.935130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 387/767] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:41.937074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ca3bb-6bc7-428b-a822-375fc3b486ec None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:41.938795 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ca3bb-6bc7-428b-a822-375fc3b486ec None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:41.939416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ca3bb-6bc7-428b-a822-375fc3b486ec None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:41.941586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 388/768] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:41.943560 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ca3bb-6bc7-428b-a822-375fc3b486ec None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:41.945440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 381/769] 10.222.0.98 () {56 vars in 1133 bytes} [Tue Jul 26 14:56:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:41.953711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcf64e-acc4-40bc-99af-64fddb3ead1d None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:41.954868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcf64e-acc4-40bc-99af-64fddb3ead1d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:41.955674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcf64e-acc4-40bc-99af-64fddb3ead1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:41.991334 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-32dcf64e-acc4-40bc-99af-64fddb3ead1d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:41.993880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-32dcf64e-acc4-40bc-99af-64fddb3ead1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:42.128708 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:42.155919 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 382/770] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:56:42.158457 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2032db0-a5e4-4d33-a9b8-fc3b7986b445 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:42.159810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2032db0-a5e4-4d33-a9b8-fc3b7986b445 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:42.160527 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2032db0-a5e4-4d33-a9b8-fc3b7986b445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:42.188180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ca3bb-6bc7-428b-a822-375fc3b486ec None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:42.194426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d2032db0-a5e4-4d33-a9b8-fc3b7986b445 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:42.195867 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d2032db0-a5e4-4d33-a9b8-fc3b7986b445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:42.276285 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00343c6b-b3ed-432b-914e-4362f533967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:42.277816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00343c6b-b3ed-432b-914e-4362f533967d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:42.277816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00343c6b-b3ed-432b-914e-4362f533967d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:42.278156 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00343c6b-b3ed-432b-914e-4362f533967d None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:42.279304 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00343c6b-b3ed-432b-914e-4362f533967d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:42.281707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00343c6b-b3ed-432b-914e-4362f533967d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:42.302930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 389/771] 10.222.0.98 () {56 vars in 1087 bytes} [Tue Jul 26 14:56:41 2022] GET /identity/v3/services => generated 772 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:42.302930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00343c6b-b3ed-432b-914e-4362f533967d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:42.356772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 383/772] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:56:42.359451 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2032db0-a5e4-4d33-a9b8-fc3b7986b445 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:42.387265 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:42.534392 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00343c6b-b3ed-432b-914e-4362f533967d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:42.596508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2032db0-a5e4-4d33-a9b8-fc3b7986b445 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:42.606120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c6af1-0883-4ea7-b53a-52faa9c14417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:42.607607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c6af1-0883-4ea7-b53a-52faa9c14417 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:42.608355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c6af1-0883-4ea7-b53a-52faa9c14417 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:42.609013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c6af1-0883-4ea7-b53a-52faa9c14417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:42.631167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c6af1-0883-4ea7-b53a-52faa9c14417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:42.633245 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c6af1-0883-4ea7-b53a-52faa9c14417 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:42.647115 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:42.664449 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db19fb7-0d8a-448c-abaa-14a2ed9bc1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:42.665507 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db19fb7-0d8a-448c-abaa-14a2ed9bc1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:42.666081 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db19fb7-0d8a-448c-abaa-14a2ed9bc1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:42.666736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db19fb7-0d8a-448c-abaa-14a2ed9bc1c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:42.678785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-ec9c6af1-0883-4ea7-b53a-52faa9c14417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:42.678785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:42.678785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:42.678785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:42.678785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:42.678785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:42.678785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:42.678785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:42.678785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:42.678785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:42.678785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:42.678785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:42.678785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:42.678785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:42.678785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:42.681895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:42.684677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:42.684677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:42.684677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:42.684677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:42.687619 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db19fb7-0d8a-448c-abaa-14a2ed9bc1c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:42.689465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 390/773] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:42.691212 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c6af1-0883-4ea7-b53a-52faa9c14417 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-7db19fb7-0d8a-448c-abaa-14a2ed9bc1c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:42.699112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:42.701540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:42.705048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:42.705048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:42.705048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:42.705048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:42.705048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:42.705048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:42.705048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:42.705048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:42.705048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:42.705048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:42.705048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:42.705048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:42.706864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 384/774] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:42.708021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db19fb7-0d8a-448c-abaa-14a2ed9bc1c0 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:42.904796 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db19fb7-0d8a-448c-abaa-14a2ed9bc1c0 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:42.919525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:42.956201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c6af1-0883-4ea7-b53a-52faa9c14417 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:43.010549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebeaf5-40d3-4018-9c93-15a27503d091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:43.013163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebeaf5-40d3-4018-9c93-15a27503d091 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:43.013996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebeaf5-40d3-4018-9c93-15a27503d091 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:43.014973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebeaf5-40d3-4018-9c93-15a27503d091 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:43.016779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebeaf5-40d3-4018-9c93-15a27503d091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:43.018052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebeaf5-40d3-4018-9c93-15a27503d091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:43.022295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebeaf5-40d3-4018-9c93-15a27503d091 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:43.041659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445fa6c-8888-4607-b393-4e66ec860919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:43.045544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445fa6c-8888-4607-b393-4e66ec860919 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:43.046781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445fa6c-8888-4607-b393-4e66ec860919 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:43.046781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445fa6c-8888-4607-b393-4e66ec860919 None admin] PATH_INFO: `/v3/services/network` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:43.050213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445fa6c-8888-4607-b393-4e66ec860919 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:43.051634 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445fa6c-8888-4607-b393-4e66ec860919 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:43.057346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 385/775] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:43.059424 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebeaf5-40d3-4018-9c93-15a27503d091 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-2445fa6c-8888-4607-b393-4e66ec860919 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:43.083480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:43.085769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:43.089416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:43.089416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:43.089416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:43.089416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:43.089416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:43.089416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:43.089416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:43.089416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:43.089416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:43.089416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:43.089416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:56:43.089416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:43.089416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:56:43.089416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:43.092883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 391/776] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:42 2022] GET /identity/v3/services/network => generated 88 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:43.094311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445fa6c-8888-4607-b393-4e66ec860919 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:43.182695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:43.280294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebeaf5-40d3-4018-9c93-15a27503d091 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:43.299864 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445fa6c-8888-4607-b393-4e66ec860919 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:43.352446 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba57d5-4ea7-414d-ad3f-035c34e4fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:43.353469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba57d5-4ea7-414d-ad3f-035c34e4fc8f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:43.353892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba57d5-4ea7-414d-ad3f-035c34e4fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:43.354320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba57d5-4ea7-414d-ad3f-035c34e4fc8f None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:43.355479 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba57d5-4ea7-414d-ad3f-035c34e4fc8f None admin] RBAC: Adding query filter params (name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:43.356008 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba57d5-4ea7-414d-ad3f-035c34e4fc8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:43.358513 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba57d5-4ea7-414d-ad3f-035c34e4fc8f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:43.371195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d488503-de00-4a66-a7ef-c76caf3c7b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:43.371905 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 386/777] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:56:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:43.372428 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488503-de00-4a66-a7ef-c76caf3c7b82 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:43.372906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba57d5-4ea7-414d-ad3f-035c34e4fc8f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:43.373138 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488503-de00-4a66-a7ef-c76caf3c7b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:43.373612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488503-de00-4a66-a7ef-c76caf3c7b82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:43.397654 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d488503-de00-4a66-a7ef-c76caf3c7b82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:43.399894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d488503-de00-4a66-a7ef-c76caf3c7b82 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:43.415598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-0d488503-de00-4a66-a7ef-c76caf3c7b82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:43.415598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:43.415598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:43.415598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:43.415598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:43.415598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:43.415598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:43.415598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:43.415598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:43.415598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:43.415598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:43.415598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:43.415598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:43.415598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:43.415598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:43.417385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:43.419743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:43.419743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:43.419743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:43.419743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:43.419743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:43.419743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:43.419743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:43.419743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:43.419743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 392/778] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:43.419743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a077a-3a69-46f5-9c2f-36a84b18c141 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:43.419743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a077a-3a69-46f5-9c2f-36a84b18c141 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:43.420649 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a077a-3a69-46f5-9c2f-36a84b18c141 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:43.427805 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 393/779] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:43 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:43.428971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a077a-3a69-46f5-9c2f-36a84b18c141 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:43.451899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:43.597612 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba57d5-4ea7-414d-ad3f-035c34e4fc8f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:43.600910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:43.633096 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a077a-3a69-46f5-9c2f-36a84b18c141 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:43.653752 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b35e97-6034-4ba7-87ed-4068c64359ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:43.655053 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b35e97-6034-4ba7-87ed-4068c64359ad None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:43.655230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b35e97-6034-4ba7-87ed-4068c64359ad None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:43.655812 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b35e97-6034-4ba7-87ed-4068c64359ad None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:43.656758 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b35e97-6034-4ba7-87ed-4068c64359ad None admin] RBAC: Adding query filter params (name=network) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:43.656758 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b35e97-6034-4ba7-87ed-4068c64359ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:43.658454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b35e97-6034-4ba7-87ed-4068c64359ad None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:43.665946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 387/780] 10.222.0.98 () {56 vars in 1112 bytes} [Tue Jul 26 14:56:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:43.666958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b35e97-6034-4ba7-87ed-4068c64359ad None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:43.708764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabc2ea-0b55-4960-8c95-5581729490d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:43.709921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabc2ea-0b55-4960-8c95-5581729490d0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:43.710492 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabc2ea-0b55-4960-8c95-5581729490d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:43.711268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabc2ea-0b55-4960-8c95-5581729490d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:43.741491 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabc2ea-0b55-4960-8c95-5581729490d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:43.745743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabc2ea-0b55-4960-8c95-5581729490d0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:43.778157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-6aabc2ea-0b55-4960-8c95-5581729490d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:43.778157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:43.778157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:43.778157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:43.778157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:43.778157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:43.778157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:43.778157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:43.778157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:43.778157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:43.778157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:43.778157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:43.778157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:43.778157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:43.778157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:43.779457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:43.780611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:43.780611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:43.780611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:43.780611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:43.780859 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 394/781] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:43.783215 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2a182-4db2-4c82-ab2c-f6207050cc2d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:43.783669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2a182-4db2-4c82-ab2c-f6207050cc2d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:43.784174 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2a182-4db2-4c82-ab2c-f6207050cc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:43.810767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d7e2a182-4db2-4c82-ab2c-f6207050cc2d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:43.812611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d7e2a182-4db2-4c82-ab2c-f6207050cc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:43.852751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b35e97-6034-4ba7-87ed-4068c64359ad None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:43.922608 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:43.926707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a22fc-b962-46a1-81f5-267037300ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:43.927538 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a22fc-b962-46a1-81f5-267037300ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:43.928040 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a22fc-b962-46a1-81f5-267037300ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:43.928550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a22fc-b962-46a1-81f5-267037300ea7 None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:43.929890 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a22fc-b962-46a1-81f5-267037300ea7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:43.930388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a22fc-b962-46a1-81f5-267037300ea7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:43.933124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a22fc-b962-46a1-81f5-267037300ea7 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:43.939264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 395/782] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:56:43.942200 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2a182-4db2-4c82-ab2c-f6207050cc2d None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:43.963671 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 388/783] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:43.965652 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a22fc-b962-46a1-81f5-267037300ea7 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:44.031433 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:44.149169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2a182-4db2-4c82-ab2c-f6207050cc2d None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:44.176156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a22fc-b962-46a1-81f5-267037300ea7 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:44.200868 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4965418-4da2-4334-bbae-b2d731a13625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:44.202021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4965418-4da2-4334-bbae-b2d731a13625 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:44.202626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4965418-4da2-4334-bbae-b2d731a13625 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:44.203349 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4965418-4da2-4334-bbae-b2d731a13625 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:44.204423 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4965418-4da2-4334-bbae-b2d731a13625 None admin] RBAC: Adding query filter params (type=network) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:44.204966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4965418-4da2-4334-bbae-b2d731a13625 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:44.207621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4965418-4da2-4334-bbae-b2d731a13625 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:44.215306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 396/784] 10.222.0.98 () {56 vars in 1112 bytes} [Tue Jul 26 14:56:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:44.216257 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4965418-4da2-4334-bbae-b2d731a13625 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:44.252217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8a0ab-1e38-4e55-873b-ddb3cd8e6791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:44.252869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8a0ab-1e38-4e55-873b-ddb3cd8e6791 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:44.253155 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8a0ab-1e38-4e55-873b-ddb3cd8e6791 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:44.253432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8a0ab-1e38-4e55-873b-ddb3cd8e6791 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:44.254166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8a0ab-1e38-4e55-873b-ddb3cd8e6791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:44.254501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8a0ab-1e38-4e55-873b-ddb3cd8e6791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:44.256314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8a0ab-1e38-4e55-873b-ddb3cd8e6791 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:44.283202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 389/785] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:44.284517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8a0ab-1e38-4e55-873b-ddb3cd8e6791 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:44.352395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:44.434202 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4965418-4da2-4334-bbae-b2d731a13625 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:44.456665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:44.475494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8a0ab-1e38-4e55-873b-ddb3cd8e6791 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:44.506449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7068b1-6801-4828-b8cd-fb3164a5c26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:44.507629 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7068b1-6801-4828-b8cd-fb3164a5c26e None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:44.508984 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7068b1-6801-4828-b8cd-fb3164a5c26e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:44.509160 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7068b1-6801-4828-b8cd-fb3164a5c26e None admin] PATH_INFO: `/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/a4a6c0e7ca434010980d7cac1800dbe9/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:44.512887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7068b1-6801-4828-b8cd-fb3164a5c26e None admin] RBAC: Authorizing `identity:create_grant(project_id=7f750777b75f49a19a5019c4fc2c00f5, user_id=a4a6c0e7ca434010980d7cac1800dbe9, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:44.515533 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7068b1-6801-4828-b8cd-fb3164a5c26e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:44.539274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431715f7-7533-48ba-8644-2281f85bcb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:44.540901 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431715f7-7533-48ba-8644-2281f85bcb37 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:44.541416 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431715f7-7533-48ba-8644-2281f85bcb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:44.541749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431715f7-7533-48ba-8644-2281f85bcb37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:44.558303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431715f7-7533-48ba-8644-2281f85bcb37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-431715f7-7533-48ba-8644-2281f85bcb37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:44.567213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:44.569052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:44.571892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:44.571892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:44.571892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:44.571892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:44.571892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:44.571892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:44.571892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:44.571892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:44.571892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:44.571892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:44.571892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:56:44.571892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:44.571892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 390/786] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:56:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:44.571892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431715f7-7533-48ba-8644-2281f85bcb37 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:44.614279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 397/787] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:56:44 2022] PUT /identity/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/a4a6c0e7ca434010980d7cac1800dbe9/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:56:44.616104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7068b1-6801-4828-b8cd-fb3164a5c26e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:44.795147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431715f7-7533-48ba-8644-2281f85bcb37 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:44.796482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7068b1-6801-4828-b8cd-fb3164a5c26e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:44.822059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:44.850825 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fe26b-ab4c-4dc5-a714-6a86bf19bab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:44.851513 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe26b-ab4c-4dc5-a714-6a86bf19bab9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:44.851787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe26b-ab4c-4dc5-a714-6a86bf19bab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:44.852934 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe26b-ab4c-4dc5-a714-6a86bf19bab9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:44.865577 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fe26b-ab4c-4dc5-a714-6a86bf19bab9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:44.867160 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fe26b-ab4c-4dc5-a714-6a86bf19bab9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:44.882447 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3fb0b-4e52-49d0-8db7-f666559f212a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-4b1fe26b-ab4c-4dc5-a714-6a86bf19bab9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:44.883762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:44.885732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:44.887932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:44.887932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:44.887932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:44.887932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:44.887932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:44.887932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:44.887932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:44.887932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:44.887932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:56:44.887932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:44.890268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3fb0b-4e52-49d0-8db7-f666559f212a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:44.890268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3fb0b-4e52-49d0-8db7-f666559f212a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:44.890268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3fb0b-4e52-49d0-8db7-f666559f212a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:44.891048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 398/788] 10.222.0.98 () {56 vars in 1117 bytes} [Tue Jul 26 14:56:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:44.891048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fe26b-ab4c-4dc5-a714-6a86bf19bab9 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:44.891575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3fb0b-4e52-49d0-8db7-f666559f212a None admin] RBAC: Adding query filter params (interface=public, service_id=30e10db3f322477d80de3a95473122c3, region_id=RegionOne) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:44.891575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3fb0b-4e52-49d0-8db7-f666559f212a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:44.891575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3fb0b-4e52-49d0-8db7-f666559f212a None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:44.909797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 391/789] 10.222.0.98 () {56 vars in 1251 bytes} [Tue Jul 26 14:56:44 2022] GET /identity/v3/endpoints?service_id=30e10db3f322477d80de3a95473122c3&interface=public®ion_id=RegionOne => generated 194 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:44.910764 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3fb0b-4e52-49d0-8db7-f666559f212a None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:44.929636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:45.067149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3fb0b-4e52-49d0-8db7-f666559f212a None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:45.116271 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b430791-2f54-4fca-a95f-c4303da708b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:45.117129 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b430791-2f54-4fca-a95f-c4303da708b4 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:45.117425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b430791-2f54-4fca-a95f-c4303da708b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:45.118226 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b430791-2f54-4fca-a95f-c4303da708b4 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:45.119122 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b430791-2f54-4fca-a95f-c4303da708b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:45.119444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b430791-2f54-4fca-a95f-c4303da708b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:45.121249 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b430791-2f54-4fca-a95f-c4303da708b4 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:45.127306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fe26b-ab4c-4dc5-a714-6a86bf19bab9 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:45.158512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 392/790] 10.222.0.98 () {56 vars in 1149 bytes} [Tue Jul 26 14:56:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:45.160748 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b430791-2f54-4fca-a95f-c4303da708b4 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:45.207488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2dafd-4c28-4651-b05d-098ae81d8cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:45.208194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2dafd-4c28-4651-b05d-098ae81d8cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:45.208679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2dafd-4c28-4651-b05d-098ae81d8cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:45.209217 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2dafd-4c28-4651-b05d-098ae81d8cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:45.210653 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2dafd-4c28-4651-b05d-098ae81d8cb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:45.211211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2dafd-4c28-4651-b05d-098ae81d8cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:45.214389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2dafd-4c28-4651-b05d-098ae81d8cb1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:45.238491 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 399/791] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:56:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:45.238491 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2dafd-4c28-4651-b05d-098ae81d8cb1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:45.324008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:45.341224 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:45.422114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b430791-2f54-4fca-a95f-c4303da708b4 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:45.477837 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2dafd-4c28-4651-b05d-098ae81d8cb1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:45.520613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbd74a-d275-4809-81f1-d4417ab9bcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:45.523170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbd74a-d275-4809-81f1-d4417ab9bcdc None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:45.524638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbd74a-d275-4809-81f1-d4417ab9bcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:45.526081 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbd74a-d275-4809-81f1-d4417ab9bcdc None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:45.527750 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbd74a-d275-4809-81f1-d4417ab9bcdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:45.530326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbd74a-d275-4809-81f1-d4417ab9bcdc None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:45.553982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 393/792] 10.222.0.98 () {56 vars in 1087 bytes} [Tue Jul 26 14:56:45 2022] GET /identity/v3/services => generated 772 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:45.556715 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbd74a-d275-4809-81f1-d4417ab9bcdc None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:45.591423 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b940c-54ad-4ad6-8212-dd7d9be58f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:45.591423 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b940c-54ad-4ad6-8212-dd7d9be58f12 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:45.591423 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b940c-54ad-4ad6-8212-dd7d9be58f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:45.591423 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b940c-54ad-4ad6-8212-dd7d9be58f12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:45.636059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b940c-54ad-4ad6-8212-dd7d9be58f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:45.638415 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b940c-54ad-4ad6-8212-dd7d9be58f12 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:45.701894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-c32b940c-54ad-4ad6-8212-dd7d9be58f12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:45.701894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:45.701894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:45.701894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:45.701894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:45.701894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:45.701894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:45.701894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:45.701894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:45.701894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:45.701894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:45.701894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:45.701894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:45.701894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:45.701894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:45.703667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:45.705383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:45.705383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:45.705383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:45.705383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:45.709653 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 400/793] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 476 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:45.724627 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b940c-54ad-4ad6-8212-dd7d9be58f12 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:45.865119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbd74a-d275-4809-81f1-d4417ab9bcdc None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:45.931472 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80a5fb-451f-4988-832f-ecf9812e88ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:45.932367 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80a5fb-451f-4988-832f-ecf9812e88ab None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:45.932704 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80a5fb-451f-4988-832f-ecf9812e88ab None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:45.932980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80a5fb-451f-4988-832f-ecf9812e88ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:45.937231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:45.950891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:45.957181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80a5fb-451f-4988-832f-ecf9812e88ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:45.960146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80a5fb-451f-4988-832f-ecf9812e88ab None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:45.965840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b940c-54ad-4ad6-8212-dd7d9be58f12 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:46.013122 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab8b2e-85c0-4d96-8c4d-8522930148b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:46.014102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab8b2e-85c0-4d96-8c4d-8522930148b1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:46.014637 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab8b2e-85c0-4d96-8c4d-8522930148b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:46.015082 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab8b2e-85c0-4d96-8c4d-8522930148b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:46.015894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab8b2e-85c0-4d96-8c4d-8522930148b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:46.016204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab8b2e-85c0-4d96-8c4d-8522930148b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:46.018492 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab8b2e-85c0-4d96-8c4d-8522930148b1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:46.036170 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 401/794] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:46.037796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5da4de-2e4c-4344-80b2-1f2751256ff5 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:46.038157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5da4de-2e4c-4344-80b2-1f2751256ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:46.038576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5da4de-2e4c-4344-80b2-1f2751256ff5 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:46.041140 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 402/795] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:46.047308 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8809a2-8a93-4a88-86c8-06d5afc5fee9 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:46.047678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8809a2-8a93-4a88-86c8-06d5afc5fee9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:46.048068 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8809a2-8a93-4a88-86c8-06d5afc5fee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:46.072121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-0e8809a2-8a93-4a88-86c8-06d5afc5fee9 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:46.073684 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0e8809a2-8a93-4a88-86c8-06d5afc5fee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:46.158846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-5b80a5fb-451f-4988-832f-ecf9812e88ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:46.158846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:46.158846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:46.158846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:46.158846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:46.158846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:46.158846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:46.158846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:46.158846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:46.158846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:46.158846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:46.158846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:46.158846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:46.158846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:46.158846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:46.160512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:46.162969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:46.162969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:46.162969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:46.162969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:46.162969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 394/796] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 606 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:46.166440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80a5fb-451f-4988-832f-ecf9812e88ab None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:46.198472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 403/797] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:56:46.199896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8809a2-8a93-4a88-86c8-06d5afc5fee9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:46.316999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:46.331032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80a5fb-451f-4988-832f-ecf9812e88ab None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:46.342862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8809a2-8a93-4a88-86c8-06d5afc5fee9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:46.382114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4f31d-37e7-41e4-a6c4-3f503a336747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:46.383131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4f31d-37e7-41e4-a6c4-3f503a336747 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:46.384173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4f31d-37e7-41e4-a6c4-3f503a336747 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:46.384465 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4f31d-37e7-41e4-a6c4-3f503a336747 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:46.386570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8379d-b650-4518-81fd-b8373c2f5f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:46.387413 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8379d-b650-4518-81fd-b8373c2f5f05 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:46.387757 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8379d-b650-4518-81fd-b8373c2f5f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:46.388092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8379d-b650-4518-81fd-b8373c2f5f05 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:46.388905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8379d-b650-4518-81fd-b8373c2f5f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:46.389316 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8379d-b650-4518-81fd-b8373c2f5f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:46.390909 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8379d-b650-4518-81fd-b8373c2f5f05 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:46.393370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4f31d-37e7-41e4-a6c4-3f503a336747 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:46.395150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4f31d-37e7-41e4-a6c4-3f503a336747 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:46.406029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 404/798] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:46.407095 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8379d-b650-4518-81fd-b8373c2f5f05 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:46.415928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-33b4f31d-37e7-41e4-a6c4-3f503a336747 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:46.415928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:46.415928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:46.415928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:46.415928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:46.415928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:46.415928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:46.415928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:46.415928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:46.415928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:46.415928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:46.415928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:46.415928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:46.415928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:46.415928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:46.419032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:46.421558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:46.421558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:46.421558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:46.421558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:46.421558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:46.421558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:46.421558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:46.421558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:46.421558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 395/799] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:46.421558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4f31d-37e7-41e4-a6c4-3f503a336747 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:46.512029 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:46.615086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4f31d-37e7-41e4-a6c4-3f503a336747 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:46.617155 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8379d-b650-4518-81fd-b8373c2f5f05 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:46.671689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1aa0dd-ca4c-4568-971d-9240e2ed278b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:46.673104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1aa0dd-ca4c-4568-971d-9240e2ed278b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:46.673675 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1aa0dd-ca4c-4568-971d-9240e2ed278b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:46.674618 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1aa0dd-ca4c-4568-971d-9240e2ed278b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:46.675659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1aa0dd-ca4c-4568-971d-9240e2ed278b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:46.678089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1aa0dd-ca4c-4568-971d-9240e2ed278b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:46.686184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f8efc-76bc-478b-95fb-88d021fc918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:46.687324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f8efc-76bc-478b-95fb-88d021fc918c None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:46.687822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f8efc-76bc-478b-95fb-88d021fc918c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:46.688316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f8efc-76bc-478b-95fb-88d021fc918c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-cb1aa0dd-ca4c-4568-971d-9240e2ed278b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:46.693968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:46.695099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:46.696828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:46.696828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:46.696828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:46.696828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:46.696828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:46.696828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:46.696828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:46.696828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:46.696828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:46.696828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:46.696828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:46.696828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:56:46.696828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:46.696828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:56:46.696828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:46.701728 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 405/800] 10.222.0.98 () {56 vars in 1129 bytes} [Tue Jul 26 14:56:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:46.702764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1aa0dd-ca4c-4568-971d-9240e2ed278b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:46.703887 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f8efc-76bc-478b-95fb-88d021fc918c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:46.705603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f8efc-76bc-478b-95fb-88d021fc918c None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:46.709398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-bf1f8efc-76bc-478b-95fb-88d021fc918c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:46.723832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:46.724868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:46.725816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:46.725816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:46.725816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:46.725816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:46.725816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:46.725816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:46.725816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:46.725816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:46.725816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:56:46.725816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:46.736344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 396/801] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:56:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:46.736344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f8efc-76bc-478b-95fb-88d021fc918c None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:46.880407 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1aa0dd-ca4c-4568-971d-9240e2ed278b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:46.895254 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f8efc-76bc-478b-95fb-88d021fc918c None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:46.908821 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:46.927119 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d15bfc-bd05-4f93-a3fa-eb8c857f8cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:46.928488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d15bfc-bd05-4f93-a3fa-eb8c857f8cdb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:46.929274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d15bfc-bd05-4f93-a3fa-eb8c857f8cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:46.930595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d15bfc-bd05-4f93-a3fa-eb8c857f8cdb None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:46.932274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d15bfc-bd05-4f93-a3fa-eb8c857f8cdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:46.933119 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d15bfc-bd05-4f93-a3fa-eb8c857f8cdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:46.935216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d15bfc-bd05-4f93-a3fa-eb8c857f8cdb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:46.956659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 406/802] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:46.956659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d15bfc-bd05-4f93-a3fa-eb8c857f8cdb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:46.963417 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368942c-39d9-4d5c-bcd9-c6e0a366ddd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:46.963631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368942c-39d9-4d5c-bcd9-c6e0a366ddd1 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:46.963997 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368942c-39d9-4d5c-bcd9-c6e0a366ddd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:46.964462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368942c-39d9-4d5c-bcd9-c6e0a366ddd1 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:46.965904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368942c-39d9-4d5c-bcd9-c6e0a366ddd1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:46.966434 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368942c-39d9-4d5c-bcd9-c6e0a366ddd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:46.968793 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368942c-39d9-4d5c-bcd9-c6e0a366ddd1 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:46.985751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 397/803] 10.222.0.98 () {56 vars in 1124 bytes} [Tue Jul 26 14:56:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:46.987346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368942c-39d9-4d5c-bcd9-c6e0a366ddd1 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:47.058315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:47.139202 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d15bfc-bd05-4f93-a3fa-eb8c857f8cdb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:47.139467 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368942c-39d9-4d5c-bcd9-c6e0a366ddd1 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:47.194414 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca01269-29e2-4921-89a7-78a43eb1e9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:47.195015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca01269-29e2-4921-89a7-78a43eb1e9e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:47.195300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca01269-29e2-4921-89a7-78a43eb1e9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:47.195801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca01269-29e2-4921-89a7-78a43eb1e9e8 None admin] PATH_INFO: `/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/3497ed5c5d204d088a178a9560ee83cf/roles/ce31429587b44a7aafb4f600c011be4a` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:47.209112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3aaec8-163d-476d-8677-f59614f4b462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:47.211822 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3aaec8-163d-476d-8677-f59614f4b462 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:47.212900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3aaec8-163d-476d-8677-f59614f4b462 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:47.213706 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3aaec8-163d-476d-8677-f59614f4b462 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:47.215612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3aaec8-163d-476d-8677-f59614f4b462 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:47.216495 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3aaec8-163d-476d-8677-f59614f4b462 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:47.218686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca01269-29e2-4921-89a7-78a43eb1e9e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f750777b75f49a19a5019c4fc2c00f5, user_id=3497ed5c5d204d088a178a9560ee83cf, role_id=ce31429587b44a7aafb4f600c011be4a)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:47.220049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3aaec8-163d-476d-8677-f59614f4b462 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:47.220405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca01269-29e2-4921-89a7-78a43eb1e9e8 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:47.254405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 407/804] 10.222.0.98 () {56 vars in 1135 bytes} [Tue Jul 26 14:56:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:47.254405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3aaec8-163d-476d-8677-f59614f4b462 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:47.322402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 398/805] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:56:46 2022] PUT /identity/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/3497ed5c5d204d088a178a9560ee83cf/roles/ce31429587b44a7aafb4f600c011be4a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:56:47.322402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca01269-29e2-4921-89a7-78a43eb1e9e8 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:47.383577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:47.506982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3aaec8-163d-476d-8677-f59614f4b462 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:47.585080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca01269-29e2-4921-89a7-78a43eb1e9e8 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:47.626978 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:47.664725 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa848fb3-4324-4e30-8631-927ef76d33b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:47.667003 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa848fb3-4324-4e30-8631-927ef76d33b8 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:47.667829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa848fb3-4324-4e30-8631-927ef76d33b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:47.668611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa848fb3-4324-4e30-8631-927ef76d33b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:47.671849 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f51f87-cfef-418c-8534-6ac99127cc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:47.672519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f51f87-cfef-418c-8534-6ac99127cc96 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:47.672989 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f51f87-cfef-418c-8534-6ac99127cc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:47.673276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f51f87-cfef-418c-8534-6ac99127cc96 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:47.674043 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f51f87-cfef-418c-8534-6ac99127cc96 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:47.674584 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f51f87-cfef-418c-8534-6ac99127cc96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:47.675895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f51f87-cfef-418c-8534-6ac99127cc96 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:47.686946 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 408/806] 10.222.0.98 () {56 vars in 1124 bytes} [Tue Jul 26 14:56:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:47.690731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f51f87-cfef-418c-8534-6ac99127cc96 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:47.698233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa848fb3-4324-4e30-8631-927ef76d33b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:47.702270 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa848fb3-4324-4e30-8631-927ef76d33b8 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:47.736946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-fa848fb3-4324-4e30-8631-927ef76d33b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:47.736946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:47.736946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:47.736946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:47.736946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:47.736946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:47.736946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:47.736946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:47.736946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:47.736946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:47.736946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:47.736946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:47.736946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:47.736946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:47.736946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:47.738840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:47.740661 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:47.740661 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:47.740661 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:47.740661 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:47.745171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 399/807] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:47.752344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6027d1-1d52-421c-975b-66bf8f9d4618 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:47.753125 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6027d1-1d52-421c-975b-66bf8f9d4618 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:47.753792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6027d1-1d52-421c-975b-66bf8f9d4618 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:47.757190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 400/808] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:47 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:47.764219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6027d1-1d52-421c-975b-66bf8f9d4618 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:47.866891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f51f87-cfef-418c-8534-6ac99127cc96 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:47.915761 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cdf4d-9ecc-4b5f-96b9-3c86c8409ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:47.916481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cdf4d-9ecc-4b5f-96b9-3c86c8409ec7 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:47.916812 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cdf4d-9ecc-4b5f-96b9-3c86c8409ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:47.917312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cdf4d-9ecc-4b5f-96b9-3c86c8409ec7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:47.917954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cdf4d-9ecc-4b5f-96b9-3c86c8409ec7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:47.919585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cdf4d-9ecc-4b5f-96b9-3c86c8409ec7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:47.928922 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:47.987846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6027d1-1d52-421c-975b-66bf8f9d4618 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:48.046536 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf4599-8bfc-4ae2-87e3-4b987085c4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:48.047089 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf4599-8bfc-4ae2-87e3-4b987085c4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:48.047377 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf4599-8bfc-4ae2-87e3-4b987085c4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:48.047744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf4599-8bfc-4ae2-87e3-4b987085c4f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:48.048701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf4599-8bfc-4ae2-87e3-4b987085c4f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:48.049032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf4599-8bfc-4ae2-87e3-4b987085c4f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:48.050695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf4599-8bfc-4ae2-87e3-4b987085c4f3 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:48.074671 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 401/809] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:48.076371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30bd4c-7181-4910-9c6d-34553641e2e1 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:48.076659 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30bd4c-7181-4910-9c6d-34553641e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:48.076942 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30bd4c-7181-4910-9c6d-34553641e2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:48.116060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-de30bd4c-7181-4910-9c6d-34553641e2e1 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:48.118627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-de30bd4c-7181-4910-9c6d-34553641e2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:48.120780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 409/810] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 14:56:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:56:48.122923 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cdf4d-9ecc-4b5f-96b9-3c86c8409ec7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:48.244666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:48.338216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cdf4d-9ecc-4b5f-96b9-3c86c8409ec7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:48.340245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 402/811] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:56:48.391482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7d124-b2fb-47b8-9493-c2be2ea9ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:48.393320 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7d124-b2fb-47b8-9493-c2be2ea9ef63 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:48.394205 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7d124-b2fb-47b8-9493-c2be2ea9ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:48.396281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7d124-b2fb-47b8-9493-c2be2ea9ef63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:48.412727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7d124-b2fb-47b8-9493-c2be2ea9ef63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:48.416049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7d124-b2fb-47b8-9493-c2be2ea9ef63 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:48.420193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30bd4c-7181-4910-9c6d-34553641e2e1 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:48.439939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-19d7d124-b2fb-47b8-9493-c2be2ea9ef63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:48.439939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:48.439939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:48.439939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:48.439939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:48.439939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:48.439939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:48.439939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:48.439939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:48.439939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:48.439939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:48.439939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:48.439939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:48.439939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:48.439939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:48.440944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:48.442154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:48.442154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:48.442154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:48.442154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:48.442154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:48.442154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:48.442154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:48.442154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:48.450554 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 410/812] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:48.454332 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7d124-b2fb-47b8-9493-c2be2ea9ef63 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:48.578126 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:48.651350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30bd4c-7181-4910-9c6d-34553641e2e1 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:48.688037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:48.697449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7d124-b2fb-47b8-9493-c2be2ea9ef63 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:48.705135 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1fee3-e885-4ab2-ac1c-7d36e350319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:48.706004 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1fee3-e885-4ab2-ac1c-7d36e350319f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:48.706926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1fee3-e885-4ab2-ac1c-7d36e350319f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:48.707452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1fee3-e885-4ab2-ac1c-7d36e350319f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:48.723919 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1fee3-e885-4ab2-ac1c-7d36e350319f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-79f1fee3-e885-4ab2-ac1c-7d36e350319f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:48.734412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:48.736508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:48.738448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:48.738448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:48.738448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:48.738448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:48.738448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:48.738448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:48.738448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:48.738448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:48.738448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:48.738448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:48.738448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:56:48.738448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:48.740574 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 403/813] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:56:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:56:48.750646 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1fee3-e885-4ab2-ac1c-7d36e350319f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:48.792964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5721e6b-20ac-4896-92b4-b3541c4982b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:48.794942 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5721e6b-20ac-4896-92b4-b3541c4982b0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:48.797534 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5721e6b-20ac-4896-92b4-b3541c4982b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:48.798582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5721e6b-20ac-4896-92b4-b3541c4982b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:48.802713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5721e6b-20ac-4896-92b4-b3541c4982b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:48.807281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5721e6b-20ac-4896-92b4-b3541c4982b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:48.811013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5721e6b-20ac-4896-92b4-b3541c4982b0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:48.853756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 411/814] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:56:48.863443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5721e6b-20ac-4896-92b4-b3541c4982b0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:49.004473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1fee3-e885-4ab2-ac1c-7d36e350319f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:49.036585 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:49.079127 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae8d4a-1a3f-4f6e-b04a-c4cf4d4e0caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:49.081384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8d4a-1a3f-4f6e-b04a-c4cf4d4e0caf None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:49.082506 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8d4a-1a3f-4f6e-b04a-c4cf4d4e0caf None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:49.083269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8d4a-1a3f-4f6e-b04a-c4cf4d4e0caf None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:49.085650 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae8d4a-1a3f-4f6e-b04a-c4cf4d4e0caf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:49.087537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae8d4a-1a3f-4f6e-b04a-c4cf4d4e0caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:49.091438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae8d4a-1a3f-4f6e-b04a-c4cf4d4e0caf None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:49.103543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5721e6b-20ac-4896-92b4-b3541c4982b0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:49.119274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 404/815] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:56:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:49.119274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ae70f-00d5-453b-9229-9bd1c14e78e0 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:49.119274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ae70f-00d5-453b-9229-9bd1c14e78e0 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:49.119274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ae70f-00d5-453b-9229-9bd1c14e78e0 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:49.123530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 405/816] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:49.126281 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ae70f-00d5-453b-9229-9bd1c14e78e0 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:49.178003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59df46-5c15-4a01-a5c5-296456c5e2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:49.180700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59df46-5c15-4a01-a5c5-296456c5e2df None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:49.181853 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59df46-5c15-4a01-a5c5-296456c5e2df None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:49.182984 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59df46-5c15-4a01-a5c5-296456c5e2df None admin] PATH_INFO: `/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/013ae8b88160433db6876f84947f0d8c/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:49.188618 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59df46-5c15-4a01-a5c5-296456c5e2df None admin] RBAC: Authorizing `identity:create_grant(project_id=7f750777b75f49a19a5019c4fc2c00f5, user_id=013ae8b88160433db6876f84947f0d8c, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:49.193162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59df46-5c15-4a01-a5c5-296456c5e2df None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:49.310286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ae70f-00d5-453b-9229-9bd1c14e78e0 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:49.318799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 412/817] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:56:48 2022] PUT /identity/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/013ae8b88160433db6876f84947f0d8c/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:56:49.322723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc58dbe-7165-4bc3-a7b5-b2d93a0c565b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:49.323545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc58dbe-7165-4bc3-a7b5-b2d93a0c565b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:49.324380 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc58dbe-7165-4bc3-a7b5-b2d93a0c565b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:49.365330 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-afc58dbe-7165-4bc3-a7b5-b2d93a0c565b None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:49.367619 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-afc58dbe-7165-4bc3-a7b5-b2d93a0c565b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:49.418861 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:49.439653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae2870-2d98-45c2-85d8-07bb342e9506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:49.447580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae2870-2d98-45c2-85d8-07bb342e9506 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:49.448099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae2870-2d98-45c2-85d8-07bb342e9506 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:49.448623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae2870-2d98-45c2-85d8-07bb342e9506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:49.499223 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae2870-2d98-45c2-85d8-07bb342e9506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:49.501712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae2870-2d98-45c2-85d8-07bb342e9506 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:49.545257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-c7ae2870-2d98-45c2-85d8-07bb342e9506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:49.545257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:49.545257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:49.545257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:49.545257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:49.545257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:49.545257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:49.545257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:49.545257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:49.545257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:49.545257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:49.545257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:49.545257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:49.545257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:49.545257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:49.546917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:49.548589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:49.548589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:49.548589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:49.548589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:49.550733 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 406/818] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:49.560208 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae2870-2d98-45c2-85d8-07bb342e9506 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:49.618774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 413/819] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:56:49.643586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc58dbe-7165-4bc3-a7b5-b2d93a0c565b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:49.645586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:49.808622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae2870-2d98-45c2-85d8-07bb342e9506 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:49.826084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc58dbe-7165-4bc3-a7b5-b2d93a0c565b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:49.867084 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d43e1-64cb-4d4f-ade6-abd106360839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:49.868023 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d43e1-64cb-4d4f-ade6-abd106360839 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:49.868488 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d43e1-64cb-4d4f-ade6-abd106360839 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:49.871760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d43e1-64cb-4d4f-ade6-abd106360839 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:49.871760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d43e1-64cb-4d4f-ade6-abd106360839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:49.871760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d43e1-64cb-4d4f-ade6-abd106360839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:49.878454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d43e1-64cb-4d4f-ade6-abd106360839 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:49.902270 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 407/820] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:49.910692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d43e1-64cb-4d4f-ade6-abd106360839 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:49.920322 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc2d84-5ac7-44ab-8c2b-9ee410d326fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:49.923542 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc2d84-5ac7-44ab-8c2b-9ee410d326fc None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:49.923933 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc2d84-5ac7-44ab-8c2b-9ee410d326fc None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:49.924168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc2d84-5ac7-44ab-8c2b-9ee410d326fc None admin] PATH_INFO: `/v3/services/network` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:49.924865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc2d84-5ac7-44ab-8c2b-9ee410d326fc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:49.926490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc2d84-5ac7-44ab-8c2b-9ee410d326fc None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-36bc2d84-5ac7-44ab-8c2b-9ee410d326fc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:49.954175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:49.956099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:49.959455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:49.959455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:49.959455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:49.959455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:49.959455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:49.959455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:49.959455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:49.959455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:49.959455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:49.959455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:49.959455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:56:49.959455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:49.959455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:56:49.959455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:49.967265 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 414/821] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:49 2022] GET /identity/v3/services/network => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:49.967265 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc2d84-5ac7-44ab-8c2b-9ee410d326fc None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:50.008902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:50.092779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:50.107212 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d43e1-64cb-4d4f-ade6-abd106360839 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:50.140593 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc2d84-5ac7-44ab-8c2b-9ee410d326fc None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:50.158779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd777870-ad4e-4bec-a305-9844e8c48fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:50.159918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd777870-ad4e-4bec-a305-9844e8c48fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:50.160309 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd777870-ad4e-4bec-a305-9844e8c48fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:50.160688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd777870-ad4e-4bec-a305-9844e8c48fe3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:50.174580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd777870-ad4e-4bec-a305-9844e8c48fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:50.177393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd777870-ad4e-4bec-a305-9844e8c48fe3 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-cd777870-ad4e-4bec-a305-9844e8c48fe3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:50.196123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:50.197283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:50.198240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:50.198240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:50.198240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:50.198240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:50.198240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:50.198240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:50.198240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:50.198240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:50.198240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:56:50.198240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:50.198240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 408/822] 10.222.0.98 () {56 vars in 1093 bytes} [Tue Jul 26 14:56:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:56:50.199658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22470be8-db9f-4657-aa20-647654377308 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:50.201914 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22470be8-db9f-4657-aa20-647654377308 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:50.202122 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d0ade-579d-4a94-a6a5-b2b1d4b3d77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:50.202282 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22470be8-db9f-4657-aa20-647654377308 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:50.202412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d0ade-579d-4a94-a6a5-b2b1d4b3d77d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:50.202412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d0ade-579d-4a94-a6a5-b2b1d4b3d77d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:50.202412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d0ade-579d-4a94-a6a5-b2b1d4b3d77d None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:50.202658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 409/823] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:50.202927 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d0ade-579d-4a94-a6a5-b2b1d4b3d77d None admin] RBAC: Adding query filter params (name=network) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:50.203343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d0ade-579d-4a94-a6a5-b2b1d4b3d77d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:50.205135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d0ade-579d-4a94-a6a5-b2b1d4b3d77d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:50.206345 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22470be8-db9f-4657-aa20-647654377308 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:50.218677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 415/824] 10.222.0.98 () {56 vars in 1112 bytes} [Tue Jul 26 14:56:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:50.218677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d7cff-b16d-40dd-b79a-babefe0dd1d2 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:50.218677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d7cff-b16d-40dd-b79a-babefe0dd1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:50.218677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d7cff-b16d-40dd-b79a-babefe0dd1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:50.244647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c45d7cff-b16d-40dd-b79a-babefe0dd1d2 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:50.246436 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c45d7cff-b16d-40dd-b79a-babefe0dd1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:50.371255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22470be8-db9f-4657-aa20-647654377308 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:50.382333 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 416/825] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:56:50.385595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d7cff-b16d-40dd-b79a-babefe0dd1d2 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:50.400256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:50.438948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f065905-c095-4c45-bc00-7f7e23737fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:50.439650 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f065905-c095-4c45-bc00-7f7e23737fed None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:50.439933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f065905-c095-4c45-bc00-7f7e23737fed None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:50.440211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f065905-c095-4c45-bc00-7f7e23737fed None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:50.441062 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f065905-c095-4c45-bc00-7f7e23737fed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:50.441407 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f065905-c095-4c45-bc00-7f7e23737fed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:50.443218 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f065905-c095-4c45-bc00-7f7e23737fed None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:50.476137 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 410/826] 10.222.0.98 () {56 vars in 1133 bytes} [Tue Jul 26 14:56:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:50.477862 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f065905-c095-4c45-bc00-7f7e23737fed None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:50.499023 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:50.577225 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d7cff-b16d-40dd-b79a-babefe0dd1d2 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:50.629844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f065905-c095-4c45-bc00-7f7e23737fed None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:50.640352 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb51f7-8b27-4a8d-b8d5-26b995610bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:50.641021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb51f7-8b27-4a8d-b8d5-26b995610bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:50.641284 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb51f7-8b27-4a8d-b8d5-26b995610bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:50.641562 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb51f7-8b27-4a8d-b8d5-26b995610bc4 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:50.642521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb51f7-8b27-4a8d-b8d5-26b995610bc4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:50.642878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb51f7-8b27-4a8d-b8d5-26b995610bc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:50.644325 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb51f7-8b27-4a8d-b8d5-26b995610bc4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:50.652300 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 417/827] 10.222.0.98 () {56 vars in 1112 bytes} [Tue Jul 26 14:56:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:50.653164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb51f7-8b27-4a8d-b8d5-26b995610bc4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:50.690169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc0864-8b7b-4821-89c4-68b7b247b65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:50.692045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc0864-8b7b-4821-89c4-68b7b247b65e None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:50.692674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc0864-8b7b-4821-89c4-68b7b247b65e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:50.693175 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc0864-8b7b-4821-89c4-68b7b247b65e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:50.712081 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc0864-8b7b-4821-89c4-68b7b247b65e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-73cc0864-8b7b-4821-89c4-68b7b247b65e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:50.719761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:50.720806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:50.721653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:50.721653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:50.721653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:50.721653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:50.721653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:50.721653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:50.721653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:50.721653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:50.721653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:50.721653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:50.721653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:56:50.721653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:50.731170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 411/828] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 14:56:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:50.732001 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc0864-8b7b-4821-89c4-68b7b247b65e None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:50.753295 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:50.792903 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb51f7-8b27-4a8d-b8d5-26b995610bc4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:50.833711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:50.839261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea11df3-318d-450c-a4a4-317630e8c8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:50.840174 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea11df3-318d-450c-a4a4-317630e8c8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:50.840643 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea11df3-318d-450c-a4a4-317630e8c8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:50.841086 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea11df3-318d-450c-a4a4-317630e8c8b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:50.884528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc0864-8b7b-4821-89c4-68b7b247b65e None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:50.936440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea11df3-318d-450c-a4a4-317630e8c8b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:50.938087 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea11df3-318d-450c-a4a4-317630e8c8b0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:50.942009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb65c7d-0917-415e-a6b3-47e7a799b8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:50.943064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb65c7d-0917-415e-a6b3-47e7a799b8cc None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:50.943540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb65c7d-0917-415e-a6b3-47e7a799b8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:50.943999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb65c7d-0917-415e-a6b3-47e7a799b8cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:50.945252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb65c7d-0917-415e-a6b3-47e7a799b8cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:50.948007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb65c7d-0917-415e-a6b3-47e7a799b8cc None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:51.031274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:51.050132 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 412/829] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 14:56:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:56:51.051266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb65c7d-0917-415e-a6b3-47e7a799b8cc None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:51.119272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 418/830] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:56:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:56:51.129063 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea11df3-318d-450c-a4a4-317630e8c8b0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:51.255444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb65c7d-0917-415e-a6b3-47e7a799b8cc None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:51.298722 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:51.325767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492f45a-1f66-45a5-b50f-948fc5595bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:51.326663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492f45a-1f66-45a5-b50f-948fc5595bcd None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:51.327079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492f45a-1f66-45a5-b50f-948fc5595bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:51.327359 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492f45a-1f66-45a5-b50f-948fc5595bcd None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:51.328343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492f45a-1f66-45a5-b50f-948fc5595bcd None admin] RBAC: Adding query filter params (name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:51.329042 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492f45a-1f66-45a5-b50f-948fc5595bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:51.331688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492f45a-1f66-45a5-b50f-948fc5595bcd None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:51.347512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 413/831] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 14:56:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:51.349007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e7443-4323-4948-88b0-b47a058d12a0 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:51.349300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e7443-4323-4948-88b0-b47a058d12a0 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:51.349575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e7443-4323-4948-88b0-b47a058d12a0 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:51.351949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 414/832] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:51.358534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e7443-4323-4948-88b0-b47a058d12a0 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:51.399649 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea11df3-318d-450c-a4a4-317630e8c8b0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:51.464172 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dcae9-0cb8-456d-8e4f-f7f57da46033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:51.465499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dcae9-0cb8-456d-8e4f-f7f57da46033 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:51.465792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dcae9-0cb8-456d-8e4f-f7f57da46033 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:51.466354 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dcae9-0cb8-456d-8e4f-f7f57da46033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:51.480941 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2dcae9-0cb8-456d-8e4f-f7f57da46033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:51.482488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2dcae9-0cb8-456d-8e4f-f7f57da46033 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:51.504669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-3e2dcae9-0cb8-456d-8e4f-f7f57da46033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:51.504669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:51.504669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:51.504669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:51.504669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:51.504669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:51.504669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:51.504669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:51.504669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:51.504669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:51.504669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:51.504669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:51.504669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:51.504669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:51.504669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:51.505767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:51.506763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:51.506763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:51.506763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:51.506763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:51.506763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 419/833] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:51.507830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c443792-0540-4d0a-9bfc-07f9ca978860 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:51.508202 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c443792-0540-4d0a-9bfc-07f9ca978860 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:51.508479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c443792-0540-4d0a-9bfc-07f9ca978860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:51.528489 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e7443-4323-4948-88b0-b47a058d12a0 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:51.529127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8c443792-0540-4d0a-9bfc-07f9ca978860 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:51.530446 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8c443792-0540-4d0a-9bfc-07f9ca978860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:51.558461 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:51.581230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb311d-39c6-4ba0-ae77-91ba4fb5f413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:51.581892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb311d-39c6-4ba0-ae77-91ba4fb5f413 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:51.582185 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb311d-39c6-4ba0-ae77-91ba4fb5f413 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:51.582499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb311d-39c6-4ba0-ae77-91ba4fb5f413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:51.596202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb311d-39c6-4ba0-ae77-91ba4fb5f413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:51.598096 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb311d-39c6-4ba0-ae77-91ba4fb5f413 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:51.619694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-83cb311d-39c6-4ba0-ae77-91ba4fb5f413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:51.619694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:51.619694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:51.619694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:51.619694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:51.619694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:51.619694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:51.619694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:51.619694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:51.619694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:51.619694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:51.619694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:51.619694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:51.619694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:51.619694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:51.620998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:51.623645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:51.623645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:51.623645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:51.623645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:51.623645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 415/834] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:51.623645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb311d-39c6-4ba0-ae77-91ba4fb5f413 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:51.650402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 420/835] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:56:51.650402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c443792-0540-4d0a-9bfc-07f9ca978860 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:51.692557 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:51.800923 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb311d-39c6-4ba0-ae77-91ba4fb5f413 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:51.813542 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c443792-0540-4d0a-9bfc-07f9ca978860 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:51.857627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c8de5-16f5-4fa9-af99-719ebf27fc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:51.859198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c8de5-16f5-4fa9-af99-719ebf27fc54 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:51.859690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c8de5-16f5-4fa9-af99-719ebf27fc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:51.860196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c8de5-16f5-4fa9-af99-719ebf27fc54 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:51.861925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c8de5-16f5-4fa9-af99-719ebf27fc54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:51.862529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c8de5-16f5-4fa9-af99-719ebf27fc54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:51.865817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c8de5-16f5-4fa9-af99-719ebf27fc54 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:51.866306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3630b57-061c-44fe-871a-b5190456e808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:51.867527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3630b57-061c-44fe-871a-b5190456e808 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:51.867806 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3630b57-061c-44fe-871a-b5190456e808 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:51.868082 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3630b57-061c-44fe-871a-b5190456e808 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:51.868815 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3630b57-061c-44fe-871a-b5190456e808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:51.869120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3630b57-061c-44fe-871a-b5190456e808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:51.870832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3630b57-061c-44fe-871a-b5190456e808 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:51.891273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 421/836] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:51.891273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3630b57-061c-44fe-871a-b5190456e808 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:51.896035 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 416/837] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:51.898080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c8de5-16f5-4fa9-af99-719ebf27fc54 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:51.916307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:52.085579 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3630b57-061c-44fe-871a-b5190456e808 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:52.091324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:52.099525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c8de5-16f5-4fa9-af99-719ebf27fc54 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:52.153932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88826cf-bf44-4a1a-aad2-f33673187a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:52.155847 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88826cf-bf44-4a1a-aad2-f33673187a43 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:52.156671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88826cf-bf44-4a1a-aad2-f33673187a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:52.157247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88826cf-bf44-4a1a-aad2-f33673187a43 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:52.158188 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88826cf-bf44-4a1a-aad2-f33673187a43 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:52.160136 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88826cf-bf44-4a1a-aad2-f33673187a43 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:52.162556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b65f7-fb3e-4bb5-a399-fb39c09c6576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:52.164000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b65f7-fb3e-4bb5-a399-fb39c09c6576 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:52.164841 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b65f7-fb3e-4bb5-a399-fb39c09c6576 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:52.165167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b65f7-fb3e-4bb5-a399-fb39c09c6576 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-e88826cf-bf44-4a1a-aad2-f33673187a43 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:52.174528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:52.175603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:52.177164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:52.177164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:52.177164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:52.177164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:52.177164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:52.177164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:52.177164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:52.177164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:52.177164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:52.177164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:52.177164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:56:52.177164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:52.177164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:56:52.177164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:52.180672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b65f7-fb3e-4bb5-a399-fb39c09c6576 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:52.183534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b65f7-fb3e-4bb5-a399-fb39c09c6576 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:52.185166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 422/838] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:56:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:52.186729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88826cf-bf44-4a1a-aad2-f33673187a43 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-ce9b65f7-fb3e-4bb5-a399-fb39c09c6576 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:52.207975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:52.209799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:52.214322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:52.214322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:52.214322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:52.214322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:52.214322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:52.214322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:52.214322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:52.214322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:52.214322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:56:52.214322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:52.214322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 417/839] 10.222.0.98 () {56 vars in 1117 bytes} [Tue Jul 26 14:56:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:52.214322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b65f7-fb3e-4bb5-a399-fb39c09c6576 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:52.368653 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:52.408107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88826cf-bf44-4a1a-aad2-f33673187a43 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:52.439592 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b65f7-fb3e-4bb5-a399-fb39c09c6576 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:52.480373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c12185-125d-452b-a422-e25ad03c2922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:52.481504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c12185-125d-452b-a422-e25ad03c2922 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:52.482002 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c12185-125d-452b-a422-e25ad03c2922 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:52.482532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c12185-125d-452b-a422-e25ad03c2922 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:52.502777 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73235958-763a-4feb-818f-8650ac5fff66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:52.503442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73235958-763a-4feb-818f-8650ac5fff66 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:52.503749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73235958-763a-4feb-818f-8650ac5fff66 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:52.503854 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c12185-125d-452b-a422-e25ad03c2922 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:52.504051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73235958-763a-4feb-818f-8650ac5fff66 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:52.504714 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73235958-763a-4feb-818f-8650ac5fff66 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:52.505025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73235958-763a-4feb-818f-8650ac5fff66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:52.506469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73235958-763a-4feb-818f-8650ac5fff66 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:52.506729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c12185-125d-452b-a422-e25ad03c2922 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:52.518543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 418/840] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:56:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:52.518543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73235958-763a-4feb-818f-8650ac5fff66 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:52.531211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-d1c12185-125d-452b-a422-e25ad03c2922 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:52.531211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:52.531211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:52.531211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:52.531211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:52.531211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:52.531211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:52.531211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:52.531211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:52.531211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:52.531211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:52.531211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:52.531211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:52.531211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:52.531211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:52.532238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:52.533179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:52.533179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:52.533179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:52.533179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:52.533179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:52.533179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:52.533179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:52.533179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:52.540734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 423/841] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:52.540734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c12185-125d-452b-a422-e25ad03c2922 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:52.551610 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:52.675788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73235958-763a-4feb-818f-8650ac5fff66 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:52.685659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c12185-125d-452b-a422-e25ad03c2922 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:52.729503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64890237-d68d-45b0-b1c1-bf0115cc0354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:52.730656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64890237-d68d-45b0-b1c1-bf0115cc0354 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:52.731110 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64890237-d68d-45b0-b1c1-bf0115cc0354 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:52.731557 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64890237-d68d-45b0-b1c1-bf0115cc0354 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:52.732917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64890237-d68d-45b0-b1c1-bf0115cc0354 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:52.733423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64890237-d68d-45b0-b1c1-bf0115cc0354 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:52.735817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64890237-d68d-45b0-b1c1-bf0115cc0354 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:52.741099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7218e28-9ced-4efc-9eb3-fcb372bf2b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:52.742311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7218e28-9ced-4efc-9eb3-fcb372bf2b90 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:52.743075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7218e28-9ced-4efc-9eb3-fcb372bf2b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:52.743558 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7218e28-9ced-4efc-9eb3-fcb372bf2b90 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:52.744852 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7218e28-9ced-4efc-9eb3-fcb372bf2b90 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:52.745350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7218e28-9ced-4efc-9eb3-fcb372bf2b90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:52.747818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7218e28-9ced-4efc-9eb3-fcb372bf2b90 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:52.751538 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:52.756415 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 424/842] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:56:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:52.757994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7218e28-9ced-4efc-9eb3-fcb372bf2b90 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:52.778425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 419/843] 10.222.0.98 () {56 vars in 1149 bytes} [Tue Jul 26 14:56:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:52.778425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fe732-307c-4afe-a55c-cabe9d483f85 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:52.778425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fe732-307c-4afe-a55c-cabe9d483f85 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:52.778425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fe732-307c-4afe-a55c-cabe9d483f85 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:52.778425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 420/844] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:52.782326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b553e-4106-40e5-8153-f76dfed6ec49 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:52.782326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b553e-4106-40e5-8153-f76dfed6ec49 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:52.782743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b553e-4106-40e5-8153-f76dfed6ec49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:52.807892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-389b553e-4106-40e5-8153-f76dfed6ec49 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:52.809282 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-389b553e-4106-40e5-8153-f76dfed6ec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:52.925937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7218e28-9ced-4efc-9eb3-fcb372bf2b90 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:52.927853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 421/845] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:56:52.929845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b553e-4106-40e5-8153-f76dfed6ec49 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:52.958043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:52.997765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412712f-ea5b-4b51-8e39-958c0884027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:52.998912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412712f-ea5b-4b51-8e39-958c0884027c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:52.999347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412712f-ea5b-4b51-8e39-958c0884027c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:52.999778 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412712f-ea5b-4b51-8e39-958c0884027c None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:53.000739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412712f-ea5b-4b51-8e39-958c0884027c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:53.001268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412712f-ea5b-4b51-8e39-958c0884027c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:53.003945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412712f-ea5b-4b51-8e39-958c0884027c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:53.025148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 425/846] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:53.026719 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412712f-ea5b-4b51-8e39-958c0884027c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:53.117289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b553e-4106-40e5-8153-f76dfed6ec49 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:53.131842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:53.172652 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892c5c-777f-4d1f-8e26-d1b0e214ba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:53.173831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892c5c-777f-4d1f-8e26-d1b0e214ba9a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:53.174175 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892c5c-777f-4d1f-8e26-d1b0e214ba9a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:53.174562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892c5c-777f-4d1f-8e26-d1b0e214ba9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:53.218431 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412712f-ea5b-4b51-8e39-958c0884027c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:53.287417 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caec0a-1ebb-4668-a2e3-533274260869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:53.288559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caec0a-1ebb-4668-a2e3-533274260869 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:53.289033 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caec0a-1ebb-4668-a2e3-533274260869 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:53.289504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caec0a-1ebb-4668-a2e3-533274260869 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:53.310255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c892c5c-777f-4d1f-8e26-d1b0e214ba9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:53.311182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caec0a-1ebb-4668-a2e3-533274260869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:56:53.313745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c892c5c-777f-4d1f-8e26-d1b0e214ba9a None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-b6caec0a-1ebb-4668-a2e3-533274260869 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:56:53.321982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:53.324367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:53.325994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:53.325994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:53.325994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:53.325994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:53.325994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:56:53.325994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:56:53.325994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:56:53.325994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:56:53.325994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:56:53.325994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:56:53.325994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:56:53.325994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:53.325994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 426/847] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:56:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:53.325994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caec0a-1ebb-4668-a2e3-533274260869 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:53.338016 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:53.514411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 422/848] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:56:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:56:53.514411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892c5c-777f-4d1f-8e26-d1b0e214ba9a None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:53.514834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caec0a-1ebb-4668-a2e3-533274260869 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:53.548363 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:53.571705 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863aed2-a291-4344-b2c7-3221389dd325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:53.572838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863aed2-a291-4344-b2c7-3221389dd325 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:53.573364 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863aed2-a291-4344-b2c7-3221389dd325 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:53.574199 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863aed2-a291-4344-b2c7-3221389dd325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:53.575898 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863aed2-a291-4344-b2c7-3221389dd325 None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=a4a6c0e7ca434010980d7cac1800dbe9) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:53.576447 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863aed2-a291-4344-b2c7-3221389dd325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:53.579512 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863aed2-a291-4344-b2c7-3221389dd325 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:53.598425 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 427/849] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:53 2022] GET /identity/v3/role_assignments?user.id=a4a6c0e7ca434010980d7cac1800dbe9&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=17054492864541709fda49dbf677a7a2 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:53.598425 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863aed2-a291-4344-b2c7-3221389dd325 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:53.737143 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892c5c-777f-4d1f-8e26-d1b0e214ba9a None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:53.771150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:53.804728 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863aed2-a291-4344-b2c7-3221389dd325 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:53.819433 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dff10-1261-4957-9c16-3be2d09c3807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:53.821846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dff10-1261-4957-9c16-3be2d09c3807 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:53.822094 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dff10-1261-4957-9c16-3be2d09c3807 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:53.824140 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dff10-1261-4957-9c16-3be2d09c3807 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:53.826053 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dff10-1261-4957-9c16-3be2d09c3807 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:53.826608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dff10-1261-4957-9c16-3be2d09c3807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:53.829729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dff10-1261-4957-9c16-3be2d09c3807 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:53.848847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 423/850] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:56:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:53.857591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dff10-1261-4957-9c16-3be2d09c3807 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:53.895082 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf9b65-4edd-47c9-90ed-9a511a03b4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:53.896994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf9b65-4edd-47c9-90ed-9a511a03b4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:53.898338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf9b65-4edd-47c9-90ed-9a511a03b4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:53.899387 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf9b65-4edd-47c9-90ed-9a511a03b4b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:53.927889 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf9b65-4edd-47c9-90ed-9a511a03b4b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:53.930081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf9b65-4edd-47c9-90ed-9a511a03b4b3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:53.969307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-bfaf9b65-4edd-47c9-90ed-9a511a03b4b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:53.969307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:53.969307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:53.969307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:53.969307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:53.969307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:53.969307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:53.969307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:53.969307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:53.969307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:53.969307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:53.969307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:53.969307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:53.969307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:53.969307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:53.970616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:53.971644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:53.971644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:53.971644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:53.971644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:53.972482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 428/851] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:53.989759 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf9b65-4edd-47c9-90ed-9a511a03b4b3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:54.060322 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:54.112667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dff10-1261-4957-9c16-3be2d09c3807 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:54.182451 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d54936-3f84-46f7-8405-3ff3b326e5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:54.183998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d54936-3f84-46f7-8405-3ff3b326e5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:54.184757 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d54936-3f84-46f7-8405-3ff3b326e5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:54.185244 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d54936-3f84-46f7-8405-3ff3b326e5b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:54.204480 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d54936-3f84-46f7-8405-3ff3b326e5b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:54.208210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d54936-3f84-46f7-8405-3ff3b326e5b3 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:54.213886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf9b65-4edd-47c9-90ed-9a511a03b4b3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:54.233611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-73d54936-3f84-46f7-8405-3ff3b326e5b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:54.233611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:54.233611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:54.233611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:54.233611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:54.233611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:54.233611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:54.233611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:54.233611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:54.233611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:54.233611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:54.233611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:54.233611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:54.233611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:54.233611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:54.234791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:54.235691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:54.235691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:54.235691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:54.235691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:54.242552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 424/852] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:56:54.245917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d54936-3f84-46f7-8405-3ff3b326e5b3 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:54.289710 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6a912-0425-4899-bacc-4e7f322b73f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:54.291376 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6a912-0425-4899-bacc-4e7f322b73f2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:54.291928 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6a912-0425-4899-bacc-4e7f322b73f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:54.292462 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6a912-0425-4899-bacc-4e7f322b73f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:54.293956 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6a912-0425-4899-bacc-4e7f322b73f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:54.294577 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6a912-0425-4899-bacc-4e7f322b73f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:54.297872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6a912-0425-4899-bacc-4e7f322b73f2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:54.299450 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:54.325772 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 429/853] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:56:54.327348 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6a912-0425-4899-bacc-4e7f322b73f2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:54.439913 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d54936-3f84-46f7-8405-3ff3b326e5b3 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:54.499368 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293ce92-c8a1-4319-97c8-1ad4f7e4c476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:54.500721 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293ce92-c8a1-4319-97c8-1ad4f7e4c476 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:54.501243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293ce92-c8a1-4319-97c8-1ad4f7e4c476 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:54.501725 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293ce92-c8a1-4319-97c8-1ad4f7e4c476 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:54.502723 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293ce92-c8a1-4319-97c8-1ad4f7e4c476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:54.503246 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293ce92-c8a1-4319-97c8-1ad4f7e4c476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:54.505145 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293ce92-c8a1-4319-97c8-1ad4f7e4c476 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:54.523853 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:54.533084 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 425/854] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:56:54.534653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293ce92-c8a1-4319-97c8-1ad4f7e4c476 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:54.534934 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6a912-0425-4899-bacc-4e7f322b73f2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:54.617090 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673992ef-cad9-419a-aa54-1429405a112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:54.619018 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673992ef-cad9-419a-aa54-1429405a112e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:54.620029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673992ef-cad9-419a-aa54-1429405a112e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:54.620925 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673992ef-cad9-419a-aa54-1429405a112e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:54.637229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673992ef-cad9-419a-aa54-1429405a112e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:54.640991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673992ef-cad9-419a-aa54-1429405a112e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:54.666528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-673992ef-cad9-419a-aa54-1429405a112e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:54.666528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:54.666528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:54.666528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:54.666528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:54.666528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:54.666528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:54.666528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:54.666528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:54.666528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:54.666528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:54.666528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:54.666528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:54.666528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:54.666528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:54.668277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:54.670181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:54.670181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:54.670181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:54.670181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:54.670181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:54.670181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:54.670181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:54.670181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:54.673202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:54.681965 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 430/855] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:54.686396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673992ef-cad9-419a-aa54-1429405a112e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:54.703442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293ce92-c8a1-4319-97c8-1ad4f7e4c476 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:54.781430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59c07f-87a2-47d0-91df-156a827d712b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:54.782610 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59c07f-87a2-47d0-91df-156a827d712b None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:54.783792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59c07f-87a2-47d0-91df-156a827d712b None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:54.784313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59c07f-87a2-47d0-91df-156a827d712b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:54.805509 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59c07f-87a2-47d0-91df-156a827d712b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:54.809512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59c07f-87a2-47d0-91df-156a827d712b None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-7c59c07f-87a2-47d0-91df-156a827d712b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:56:54.845082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:54.846427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:54.847991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:54.847991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:54.847991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:56:54.847991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:56:54.847991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:56:54.847991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:56:54.847991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:56:54.847991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:56:54.847991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:56:54.847991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:54.854603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 426/856] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:56:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:54.857869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59c07f-87a2-47d0-91df-156a827d712b None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:54.909443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673992ef-cad9-419a-aa54-1429405a112e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:54.980159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6ea7b-d5f8-4e41-a7ab-6ec15b81ce01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:54.981222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6ea7b-d5f8-4e41-a7ab-6ec15b81ce01 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:54.981710 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6ea7b-d5f8-4e41-a7ab-6ec15b81ce01 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:54.982232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6ea7b-d5f8-4e41-a7ab-6ec15b81ce01 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:54.983865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6ea7b-d5f8-4e41-a7ab-6ec15b81ce01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:54.984360 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6ea7b-d5f8-4e41-a7ab-6ec15b81ce01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:54.987446 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6ea7b-d5f8-4e41-a7ab-6ec15b81ce01 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:55.018842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 431/857] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:55.023410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6ea7b-d5f8-4e41-a7ab-6ec15b81ce01 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:55.034620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59c07f-87a2-47d0-91df-156a827d712b None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:55.062131 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:55.088790 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf8241-b2c1-476f-819e-3b53aae2315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:55.089955 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf8241-b2c1-476f-819e-3b53aae2315e None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:55.090899 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf8241-b2c1-476f-819e-3b53aae2315e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:55.091441 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf8241-b2c1-476f-819e-3b53aae2315e None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:55.093416 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf8241-b2c1-476f-819e-3b53aae2315e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:55.094449 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf8241-b2c1-476f-819e-3b53aae2315e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:55.096460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf8241-b2c1-476f-819e-3b53aae2315e None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:55.126555 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:55.140845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 427/858] 10.222.0.98 () {56 vars in 1135 bytes} [Tue Jul 26 14:56:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:55.142454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf8241-b2c1-476f-819e-3b53aae2315e None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:55.246563 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6ea7b-d5f8-4e41-a7ab-6ec15b81ce01 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:55.299474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cf800-2d11-4ae4-9185-bbf236c8ddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:55.300278 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cf800-2d11-4ae4-9185-bbf236c8ddbd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:55.300543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cf800-2d11-4ae4-9185-bbf236c8ddbd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:55.300826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cf800-2d11-4ae4-9185-bbf236c8ddbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:55.302024 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cf800-2d11-4ae4-9185-bbf236c8ddbd None admin] RBAC: Adding query filter params (role.id=ce31429587b44a7aafb4f600c011be4a, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=3497ed5c5d204d088a178a9560ee83cf) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:55.302024 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cf800-2d11-4ae4-9185-bbf236c8ddbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:55.303500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cf800-2d11-4ae4-9185-bbf236c8ddbd None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:55.316038 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf8241-b2c1-476f-819e-3b53aae2315e None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:55.318750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 432/859] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:55 2022] GET /identity/v3/role_assignments?user.id=3497ed5c5d204d088a178a9560ee83cf&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=ce31429587b44a7aafb4f600c011be4a => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:55.379661 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55cc44-a7a7-4068-be13-7c8671567448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:55.381384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55cc44-a7a7-4068-be13-7c8671567448 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:55.382597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55cc44-a7a7-4068-be13-7c8671567448 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:55.383434 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55cc44-a7a7-4068-be13-7c8671567448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:55.509663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d94e7d-0c30-4a67-98a0-bee82e87dd39 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:55.510424 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d94e7d-0c30-4a67-98a0-bee82e87dd39 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:55.511048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d94e7d-0c30-4a67-98a0-bee82e87dd39 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:55.513059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 433/860] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:55.520697 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82ad66-b776-4853-ab8b-cd04198560c9 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:55.521196 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82ad66-b776-4853-ab8b-cd04198560c9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:55.521283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82ad66-b776-4853-ab8b-cd04198560c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:55.547204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-df82ad66-b776-4853-ab8b-cd04198560c9 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:55.548438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-df82ad66-b776-4853-ab8b-cd04198560c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:55.562795 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:55.566769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55cc44-a7a7-4068-be13-7c8671567448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:55.568430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55cc44-a7a7-4068-be13-7c8671567448 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:55.677254 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 434/861] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:56:55.702159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82ad66-b776-4853-ab8b-cd04198560c9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:55.719473 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:55.771415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 428/862] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:56:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:56:55.780620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55cc44-a7a7-4068-be13-7c8671567448 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:55.917181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82ad66-b776-4853-ab8b-cd04198560c9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:55.970517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55cc44-a7a7-4068-be13-7c8671567448 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:55.975782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:55.998401 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1077b4-db51-4b4a-b0c7-e4c609fb575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:55.999513 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1077b4-db51-4b4a-b0c7-e4c609fb575a None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:56.000007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1077b4-db51-4b4a-b0c7-e4c609fb575a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:56.000486 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1077b4-db51-4b4a-b0c7-e4c609fb575a None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:56.001851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1077b4-db51-4b4a-b0c7-e4c609fb575a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:56.005019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1077b4-db51-4b4a-b0c7-e4c609fb575a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:56.046824 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c2254-1c6a-4497-83fe-637ec61f9904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:56.047768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c2254-1c6a-4497-83fe-637ec61f9904 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:56.048246 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c2254-1c6a-4497-83fe-637ec61f9904 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:56.048716 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c2254-1c6a-4497-83fe-637ec61f9904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:56.071755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c2254-1c6a-4497-83fe-637ec61f9904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:56.074711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c2254-1c6a-4497-83fe-637ec61f9904 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:56.104290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-ff1c2254-1c6a-4497-83fe-637ec61f9904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:56.104290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:56.104290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:56.104290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:56.104290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:56.104290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:56.104290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:56.104290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:56.104290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:56.104290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:56.104290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:56.104290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:56.104290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:56:56.104290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:56:56.104290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:56.106230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:56.108085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:56:56.108085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:56:56.108085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:56:56.108085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:56.109641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 429/863] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:56:56.117241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c2254-1c6a-4497-83fe-637ec61f9904 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:56.170877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 435/864] 10.222.0.98 () {60 vars in 1141 bytes} [Tue Jul 26 14:56:55 2022] POST /identity/v3/services => generated 251 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:56:56.213917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c5b84-3908-4f58-87a9-a916cd918fed None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:56.214305 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c5b84-3908-4f58-87a9-a916cd918fed None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:56.214789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c5b84-3908-4f58-87a9-a916cd918fed None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:56.217445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 436/865] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:56:56.223827 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d153a-399d-4f65-93d5-8258e01a4437 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:56.224123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d153a-399d-4f65-93d5-8258e01a4437 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:56.224570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d153a-399d-4f65-93d5-8258e01a4437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:56.251609 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ce4d153a-399d-4f65-93d5-8258e01a4437 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:56.253281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ce4d153a-399d-4f65-93d5-8258e01a4437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:56.318422 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c2254-1c6a-4497-83fe-637ec61f9904 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:56.386671 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca220885-745e-4ff8-b3f8-592f8352deaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:56.388814 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca220885-745e-4ff8-b3f8-592f8352deaf None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:56.389303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca220885-745e-4ff8-b3f8-592f8352deaf None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:56.391688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca220885-745e-4ff8-b3f8-592f8352deaf None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:56.391943 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:56.392081 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca220885-745e-4ff8-b3f8-592f8352deaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:56.392524 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca220885-745e-4ff8-b3f8-592f8352deaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:56.395584 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca220885-745e-4ff8-b3f8-592f8352deaf None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:56.399702 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 437/866] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:56 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:56:56.426221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 430/867] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:56:56.427099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d153a-399d-4f65-93d5-8258e01a4437 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:56.438133 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca220885-745e-4ff8-b3f8-592f8352deaf None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:56.465983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:56.613871 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca220885-745e-4ff8-b3f8-592f8352deaf None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:56.654421 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d153a-399d-4f65-93d5-8258e01a4437 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:56.683818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe069b80-48c7-4686-a7d9-2010dffabc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:56.685800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe069b80-48c7-4686-a7d9-2010dffabc45 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:56.687291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe069b80-48c7-4686-a7d9-2010dffabc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:56.688092 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe069b80-48c7-4686-a7d9-2010dffabc45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:56.705993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe069b80-48c7-4686-a7d9-2010dffabc45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:56.709732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe069b80-48c7-4686-a7d9-2010dffabc45 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:56.721667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffe18a-eeba-4c52-b446-c19947d071ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:56.722802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffe18a-eeba-4c52-b446-c19947d071ac None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:56.723299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffe18a-eeba-4c52-b446-c19947d071ac None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:56.723854 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffe18a-eeba-4c52-b446-c19947d071ac None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:56.725127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffe18a-eeba-4c52-b446-c19947d071ac None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:56.728576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffe18a-eeba-4c52-b446-c19947d071ac None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:56.732597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-fe069b80-48c7-4686-a7d9-2010dffabc45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:56.732597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:56.732597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:56.732597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:56.732597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:56.732597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:56.732597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:56.732597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:56.732597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:56.732597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:56.732597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:56.732597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:56.732597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:56:56.732597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:56:56.732597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:56.734149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:56.735409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:56:56.735409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:56:56.735409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:56:56.735409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:56:56.735409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:56:56.735409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:56:56.735409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:56:56.735409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:56:56.737150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 431/868] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:56:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:56:56.743977 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe069b80-48c7-4686-a7d9-2010dffabc45 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-21ffe18a-eeba-4c52-b446-c19947d071ac None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:56:56.755450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:56:56.756604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:56:56.758085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:56:56.758085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:56:56.758085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:56:56.758085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:56:56.758085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:56:56.758085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:56:56.758085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:56:56.758085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:56:56.758085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:56:56.758085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:56:56.758085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:56:56.758085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:56:56.758085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:56:56.758085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:56:56.758085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:56:56.766728 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 438/869] 10.222.0.98 () {56 vars in 1132 bytes} [Tue Jul 26 14:56:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:56:56.768438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffe18a-eeba-4c52-b446-c19947d071ac None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:56.857265 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:56.916878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:56.938606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe069b80-48c7-4686-a7d9-2010dffabc45 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:56.985295 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffe18a-eeba-4c52-b446-c19947d071ac None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:57.014464 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1ebfb-5176-48bb-905a-1ae5d670d7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:57.015268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1ebfb-5176-48bb-905a-1ae5d670d7cb None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:57.015762 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1ebfb-5176-48bb-905a-1ae5d670d7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:57.016247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1ebfb-5176-48bb-905a-1ae5d670d7cb None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:57.017635 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1ebfb-5176-48bb-905a-1ae5d670d7cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:57.018189 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1ebfb-5176-48bb-905a-1ae5d670d7cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:57.020944 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1ebfb-5176-48bb-905a-1ae5d670d7cb None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:57.042053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d06e8b-2a4e-49a3-ab5c-31894e7a5b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:57.042948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d06e8b-2a4e-49a3-ab5c-31894e7a5b3b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:57.043369 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d06e8b-2a4e-49a3-ab5c-31894e7a5b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:57.043772 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d06e8b-2a4e-49a3-ab5c-31894e7a5b3b None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:57.044668 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d06e8b-2a4e-49a3-ab5c-31894e7a5b3b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:57.045123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d06e8b-2a4e-49a3-ab5c-31894e7a5b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:57.046986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d06e8b-2a4e-49a3-ab5c-31894e7a5b3b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:57.053001 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 432/870] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:56:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:57.060698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1ebfb-5176-48bb-905a-1ae5d670d7cb None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:57.062785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 439/871] 10.222.0.98 () {56 vars in 1126 bytes} [Tue Jul 26 14:56:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:56:57.072670 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d06e8b-2a4e-49a3-ab5c-31894e7a5b3b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:57.269484 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1ebfb-5176-48bb-905a-1ae5d670d7cb None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:57.303738 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d06e8b-2a4e-49a3-ab5c-31894e7a5b3b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:57.307679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:57.318083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804e451-34ec-402b-b013-252d94f74000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:57.319100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804e451-34ec-402b-b013-252d94f74000 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:57.320302 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804e451-34ec-402b-b013-252d94f74000 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:57.320801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804e451-34ec-402b-b013-252d94f74000 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:57.322026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804e451-34ec-402b-b013-252d94f74000 None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=013ae8b88160433db6876f84947f0d8c) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:57.322736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804e451-34ec-402b-b013-252d94f74000 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:57.324683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804e451-34ec-402b-b013-252d94f74000 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:57.333056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 433/872] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:56:57 2022] GET /identity/v3/role_assignments?user.id=013ae8b88160433db6876f84947f0d8c&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=17054492864541709fda49dbf677a7a2 => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:56:57.362997 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:57.378926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0acb2-8b53-40c5-9cb1-ff84965ba958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:57.380003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0acb2-8b53-40c5-9cb1-ff84965ba958 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:57.380451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0acb2-8b53-40c5-9cb1-ff84965ba958 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:57.380878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0acb2-8b53-40c5-9cb1-ff84965ba958 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:57.382117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0acb2-8b53-40c5-9cb1-ff84965ba958 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:56:57.382726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0acb2-8b53-40c5-9cb1-ff84965ba958 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:56:57.385479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0acb2-8b53-40c5-9cb1-ff84965ba958 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:56:57.394906 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 440/873] 10.222.0.98 () {56 vars in 1126 bytes} [Tue Jul 26 14:56:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:56:59.393510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153bedf-17ba-4544-8c43-75a3a0a7c608 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:59.394310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153bedf-17ba-4544-8c43-75a3a0a7c608 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:59.394531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153bedf-17ba-4544-8c43-75a3a0a7c608 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:59.398451 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 434/874] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:59.408290 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfa505-bd26-4417-9703-8b75c3d533b5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:59.409058 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfa505-bd26-4417-9703-8b75c3d533b5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:59.409193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfa505-bd26-4417-9703-8b75c3d533b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:59.447879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9acfa505-bd26-4417-9703-8b75c3d533b5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:59.450540 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9acfa505-bd26-4417-9703-8b75c3d533b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:59.614992 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 441/875] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:59 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:56:59.655406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153bedf-17ba-4544-8c43-75a3a0a7c608 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:56:59.812219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d182c-2f12-4349-a788-c53b27430dba None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:59.813238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d182c-2f12-4349-a788-c53b27430dba None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:59.814008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d182c-2f12-4349-a788-c53b27430dba None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:59.822782 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 442/876] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:56:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:56:59.827592 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a5dab-f15c-40bf-b9b4-16b25a8cd117 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:59.828382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a5dab-f15c-40bf-b9b4-16b25a8cd117 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:59.829263 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a5dab-f15c-40bf-b9b4-16b25a8cd117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:59.863825 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2d9a5dab-f15c-40bf-b9b4-16b25a8cd117 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:56:59.867521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2d9a5dab-f15c-40bf-b9b4-16b25a8cd117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:56:59.882976 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153bedf-17ba-4544-8c43-75a3a0a7c608 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:56:59.961104 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fada09-f2de-4b9b-a0bd-3c6ec3a8490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:56:59.962170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fada09-f2de-4b9b-a0bd-3c6ec3a8490a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:56:59.962733 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fada09-f2de-4b9b-a0bd-3c6ec3a8490a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:56:59.963182 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fada09-f2de-4b9b-a0bd-3c6ec3a8490a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:56:59.988008 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fada09-f2de-4b9b-a0bd-3c6ec3a8490a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-23fada09-f2de-4b9b-a0bd-3c6ec3a8490a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:57:00.004560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:00.006959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:00.008692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:00.008692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:00.008692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:00.008692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:00.008692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:57:00.008692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:57:00.008692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:57:00.008692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:57:00.008692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:57:00.008692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:57:00.008692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:57:00.008692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:00.008692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 435/877] 10.222.0.98 () {56 vars in 1120 bytes} [Tue Jul 26 14:56:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:00.020475 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fada09-f2de-4b9b-a0bd-3c6ec3a8490a None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:00.031133 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 443/878] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:56:59 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:57:00.072767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a5dab-f15c-40bf-b9b4-16b25a8cd117 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:00.141370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:00.152610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:00.214255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fada09-f2de-4b9b-a0bd-3c6ec3a8490a None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:00.242723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a5dab-f15c-40bf-b9b4-16b25a8cd117 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:00.265337 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee71d3-1f8d-49f6-8d0d-450107f4822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:00.266052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee71d3-1f8d-49f6-8d0d-450107f4822a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:00.266351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee71d3-1f8d-49f6-8d0d-450107f4822a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:00.266697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee71d3-1f8d-49f6-8d0d-450107f4822a None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:00.267460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee71d3-1f8d-49f6-8d0d-450107f4822a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:00.267768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee71d3-1f8d-49f6-8d0d-450107f4822a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:00.269207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee71d3-1f8d-49f6-8d0d-450107f4822a None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:00.289747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 436/879] 10.222.0.98 () {56 vars in 1115 bytes} [Tue Jul 26 14:57:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:00.289747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd15964-b835-470d-974e-25ccea478c84 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:00.289747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd15964-b835-470d-974e-25ccea478c84 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:00.289747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd15964-b835-470d-974e-25ccea478c84 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:00.289747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 437/880] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:00.290702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73be10b-4f82-4104-94c6-7f801a5c2d70 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:00.290999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73be10b-4f82-4104-94c6-7f801a5c2d70 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:00.292823 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73be10b-4f82-4104-94c6-7f801a5c2d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:00.300804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6982b-f877-48dc-84c9-7849cd646784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:00.301734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6982b-f877-48dc-84c9-7849cd646784 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:00.303928 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6982b-f877-48dc-84c9-7849cd646784 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:00.303928 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6982b-f877-48dc-84c9-7849cd646784 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:00.304655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6982b-f877-48dc-84c9-7849cd646784 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:00.307337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6982b-f877-48dc-84c9-7849cd646784 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:00.314627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b73be10b-4f82-4104-94c6-7f801a5c2d70 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:00.315965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b73be10b-4f82-4104-94c6-7f801a5c2d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-1da6982b-f877-48dc-84c9-7849cd646784 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:00.318261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:00.321288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:00.326478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:00.326478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:00.326478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:00.326478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:00.326478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:00.326478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:00.326478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:00.326478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:00.326478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:00.326478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:00.326478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:57:00.326478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:00.326478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:57:00.326478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:00.326478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 444/881] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:57:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:00.327308 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6982b-f877-48dc-84c9-7849cd646784 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:00.433995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 438/882] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:00 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:57:00.435847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c9e29-3e27-4f10-aa7d-558d66741807 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:00.436348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c9e29-3e27-4f10-aa7d-558d66741807 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:00.436825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c9e29-3e27-4f10-aa7d-558d66741807 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:00.439380 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 439/883] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:00.440831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c9e29-3e27-4f10-aa7d-558d66741807 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:00.485649 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6982b-f877-48dc-84c9-7849cd646784 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:00.510680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:00.533957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f95f84-cd6d-49fb-8e01-ea2af76828ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:00.534925 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f95f84-cd6d-49fb-8e01-ea2af76828ce None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:00.535413 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f95f84-cd6d-49fb-8e01-ea2af76828ce None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:00.535647 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:00.535858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f95f84-cd6d-49fb-8e01-ea2af76828ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:00.553086 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f95f84-cd6d-49fb-8e01-ea2af76828ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:00.555916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f95f84-cd6d-49fb-8e01-ea2af76828ce None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:00.574844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-16f95f84-cd6d-49fb-8e01-ea2af76828ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:00.574844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:00.574844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:00.574844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:00.574844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:00.574844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:00.574844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:00.574844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:00.574844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:00.574844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:00.574844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:00.574844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:00.574844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:57:00.574844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:57:00.574844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:00.576527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:00.578293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:57:00.578293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:57:00.578293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:00.578293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:00.578293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 445/884] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:00.578293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756e01d-91c3-45c8-8d17-016632b6dafe None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:00.579057 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756e01d-91c3-45c8-8d17-016632b6dafe None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:00.579057 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756e01d-91c3-45c8-8d17-016632b6dafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:00.618762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5756e01d-91c3-45c8-8d17-016632b6dafe None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:00.620150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5756e01d-91c3-45c8-8d17-016632b6dafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:00.626159 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c9e29-3e27-4f10-aa7d-558d66741807 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:00.779791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0ad9e-f3ef-4981-8c9d-0fc3c6eaaad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:00.780770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0ad9e-f3ef-4981-8c9d-0fc3c6eaaad4 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:00.781347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0ad9e-f3ef-4981-8c9d-0fc3c6eaaad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:00.781850 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0ad9e-f3ef-4981-8c9d-0fc3c6eaaad4 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:00.783184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0ad9e-f3ef-4981-8c9d-0fc3c6eaaad4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:00.783817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0ad9e-f3ef-4981-8c9d-0fc3c6eaaad4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:00.786684 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0ad9e-f3ef-4981-8c9d-0fc3c6eaaad4 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:00.794243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 440/885] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:57:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:00.795278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0ad9e-f3ef-4981-8c9d-0fc3c6eaaad4 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:00.828456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 446/886] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:00 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:00.829961 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756e01d-91c3-45c8-8d17-016632b6dafe None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:00.983466 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0ad9e-f3ef-4981-8c9d-0fc3c6eaaad4 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:01.002393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:01.036990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:01.045251 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756e01d-91c3-45c8-8d17-016632b6dafe None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:01.054662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bcac2-0b16-40c6-b181-299645da45c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:01.055789 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bcac2-0b16-40c6-b181-299645da45c7 None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:01.056319 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bcac2-0b16-40c6-b181-299645da45c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:01.056831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bcac2-0b16-40c6-b181-299645da45c7 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:01.058221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bcac2-0b16-40c6-b181-299645da45c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:01.060913 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bcac2-0b16-40c6-b181-299645da45c7 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:01.112585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc46db-7e62-4f4c-9fe5-d8291e3bd035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:01.113635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc46db-7e62-4f4c-9fe5-d8291e3bd035 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:01.114130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc46db-7e62-4f4c-9fe5-d8291e3bd035 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:01.114721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc46db-7e62-4f4c-9fe5-d8291e3bd035 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:01.116511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc46db-7e62-4f4c-9fe5-d8291e3bd035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:01.117076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc46db-7e62-4f4c-9fe5-d8291e3bd035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:01.119789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc46db-7e62-4f4c-9fe5-d8291e3bd035 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:01.142330 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 447/887] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:01.144089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc46db-7e62-4f4c-9fe5-d8291e3bd035 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:01.175814 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 441/888] 10.222.0.98 () {60 vars in 1141 bytes} [Tue Jul 26 14:57:00 2022] POST /identity/v3/services => generated 269 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:57:01.176719 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bcac2-0b16-40c6-b181-299645da45c7 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:01.340219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc46db-7e62-4f4c-9fe5-d8291e3bd035 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:01.402087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bcac2-0b16-40c6-b181-299645da45c7 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:01.413712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31817b11-9469-43ad-8e97-f41eebde729c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:01.414538 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31817b11-9469-43ad-8e97-f41eebde729c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:01.414825 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31817b11-9469-43ad-8e97-f41eebde729c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:01.415097 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31817b11-9469-43ad-8e97-f41eebde729c None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:01.415829 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31817b11-9469-43ad-8e97-f41eebde729c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:01.416134 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31817b11-9469-43ad-8e97-f41eebde729c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:01.417594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31817b11-9469-43ad-8e97-f41eebde729c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:01.432856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 448/889] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:57:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:01.432856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31817b11-9469-43ad-8e97-f41eebde729c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:01.480572 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fcfdc-d0dc-4b1b-abd4-ca866a441d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:01.482220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fcfdc-d0dc-4b1b-abd4-ca866a441d27 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:01.482533 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fcfdc-d0dc-4b1b-abd4-ca866a441d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:01.482798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fcfdc-d0dc-4b1b-abd4-ca866a441d27 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:01.483548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fcfdc-d0dc-4b1b-abd4-ca866a441d27 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:01.484515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:01.485875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fcfdc-d0dc-4b1b-abd4-ca866a441d27 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-0a6fcfdc-d0dc-4b1b-abd4-ca866a441d27 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:01.502024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:01.507830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:01.510418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:01.510418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:01.510418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:01.510418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:01.510418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:01.510418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:01.510418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:01.510418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:01.510418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:01.510418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:01.510418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:57:01.510418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:01.510418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:57:01.510418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:01.510418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 442/890] 10.222.0.98 () {56 vars in 1126 bytes} [Tue Jul 26 14:57:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:01.512348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fcfdc-d0dc-4b1b-abd4-ca866a441d27 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:01.557556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:01.657490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31817b11-9469-43ad-8e97-f41eebde729c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:01.685873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fcfdc-d0dc-4b1b-abd4-ca866a441d27 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:01.736600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44658457-b4f8-4fc3-b679-19a194cd4ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:01.737967 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44658457-b4f8-4fc3-b679-19a194cd4ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:01.738559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44658457-b4f8-4fc3-b679-19a194cd4ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:01.739304 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44658457-b4f8-4fc3-b679-19a194cd4ca2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:01.744767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e62d5-183d-4222-a638-b9757d2692d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:01.745789 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e62d5-183d-4222-a638-b9757d2692d6 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:01.746289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e62d5-183d-4222-a638-b9757d2692d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:01.746787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e62d5-183d-4222-a638-b9757d2692d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:01.747790 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e62d5-183d-4222-a638-b9757d2692d6 None admin] RBAC: Adding query filter params (interface=public, service_id=e9da97c7667b4a20881b413418dbdbf8, region_id=RegionOne) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:01.748238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e62d5-183d-4222-a638-b9757d2692d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:01.749967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e62d5-183d-4222-a638-b9757d2692d6 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:01.756291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44658457-b4f8-4fc3-b679-19a194cd4ca2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:01.758719 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 443/891] 10.222.0.98 () {56 vars in 1251 bytes} [Tue Jul 26 14:57:01 2022] GET /identity/v3/endpoints?service_id=e9da97c7667b4a20881b413418dbdbf8&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:01.760203 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44658457-b4f8-4fc3-b679-19a194cd4ca2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:01.764500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e62d5-183d-4222-a638-b9757d2692d6 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-44658457-b4f8-4fc3-b679-19a194cd4ca2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:57:01.787632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:01.789315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:01.792437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:01.792437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:01.792437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:57:01.792437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:57:01.792437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:57:01.792437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:57:01.792437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:57:01.792437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:57:01.792437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:57:01.792437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:01.792437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 449/892] 10.222.0.98 () {56 vars in 1117 bytes} [Tue Jul 26 14:57:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:01.792437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44658457-b4f8-4fc3-b679-19a194cd4ca2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:01.908320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:01.931146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e62d5-183d-4222-a638-b9757d2692d6 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:01.979211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:02.009049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44658457-b4f8-4fc3-b679-19a194cd4ca2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:02.012635 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be907e-d7a4-4650-8d75-acc1500a0587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:02.013699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be907e-d7a4-4650-8d75-acc1500a0587 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:02.014186 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be907e-d7a4-4650-8d75-acc1500a0587 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:02.014686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be907e-d7a4-4650-8d75-acc1500a0587 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:02.015935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be907e-d7a4-4650-8d75-acc1500a0587 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:02.016451 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be907e-d7a4-4650-8d75-acc1500a0587 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:02.019016 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be907e-d7a4-4650-8d75-acc1500a0587 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:02.037530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 444/893] 10.222.0.98 () {56 vars in 1122 bytes} [Tue Jul 26 14:57:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:02.037530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be907e-d7a4-4650-8d75-acc1500a0587 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:02.094923 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabff6a5-c0ad-4dc6-ac60-17ec137f9619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:02.096051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabff6a5-c0ad-4dc6-ac60-17ec137f9619 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:02.097054 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabff6a5-c0ad-4dc6-ac60-17ec137f9619 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:02.097460 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabff6a5-c0ad-4dc6-ac60-17ec137f9619 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:02.098763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabff6a5-c0ad-4dc6-ac60-17ec137f9619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:02.102023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabff6a5-c0ad-4dc6-ac60-17ec137f9619 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:02.118474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 450/894] 10.222.0.98 () {56 vars in 1087 bytes} [Tue Jul 26 14:57:01 2022] GET /identity/v3/services => generated 1268 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:57:02.118474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabff6a5-c0ad-4dc6-ac60-17ec137f9619 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:02.248065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be907e-d7a4-4650-8d75-acc1500a0587 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:02.319936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabff6a5-c0ad-4dc6-ac60-17ec137f9619 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:02.326294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d2e83-9b8f-42ef-81ee-2734129bd669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:02.327555 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d2e83-9b8f-42ef-81ee-2734129bd669 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:02.328140 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d2e83-9b8f-42ef-81ee-2734129bd669 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:02.328720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d2e83-9b8f-42ef-81ee-2734129bd669 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:02.330472 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d2e83-9b8f-42ef-81ee-2734129bd669 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:02.331131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d2e83-9b8f-42ef-81ee-2734129bd669 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:02.334076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d2e83-9b8f-42ef-81ee-2734129bd669 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:02.380460 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43873d18-6cf1-4ab1-8795-293425079f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:02.381987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43873d18-6cf1-4ab1-8795-293425079f9e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:02.382656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43873d18-6cf1-4ab1-8795-293425079f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:02.383143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43873d18-6cf1-4ab1-8795-293425079f9e None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:02.384121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43873d18-6cf1-4ab1-8795-293425079f9e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:02.384656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43873d18-6cf1-4ab1-8795-293425079f9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:02.386656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43873d18-6cf1-4ab1-8795-293425079f9e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:02.387034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 445/895] 10.222.0.98 () {56 vars in 1149 bytes} [Tue Jul 26 14:57:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:02.392844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d2e83-9b8f-42ef-81ee-2734129bd669 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:02.398769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 451/896] 10.222.0.98 () {56 vars in 1122 bytes} [Tue Jul 26 14:57:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:02.429844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:02.623906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d2e83-9b8f-42ef-81ee-2734129bd669 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:02.697587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8d180-696a-4536-b8a9-0600b737ce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:02.699293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8d180-696a-4536-b8a9-0600b737ce0f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:02.699985 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8d180-696a-4536-b8a9-0600b737ce0f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:02.700638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8d180-696a-4536-b8a9-0600b737ce0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:02.847157 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8d180-696a-4536-b8a9-0600b737ce0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:02.850066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8d180-696a-4536-b8a9-0600b737ce0f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:02.883618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:03.062435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 446/897] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:57:02 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:57:03.072267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43873d18-6cf1-4ab1-8795-293425079f9e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:03.102505 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:03.304757 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43873d18-6cf1-4ab1-8795-293425079f9e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:03.378394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b2f7a-ee9d-4a15-9842-77bbe97ae18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:03.379545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b2f7a-ee9d-4a15-9842-77bbe97ae18c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:03.380044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b2f7a-ee9d-4a15-9842-77bbe97ae18c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:03.380497 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b2f7a-ee9d-4a15-9842-77bbe97ae18c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:03.402799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b2f7a-ee9d-4a15-9842-77bbe97ae18c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:03.405540 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b2f7a-ee9d-4a15-9842-77bbe97ae18c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:03.427938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-eb3b2f7a-ee9d-4a15-9842-77bbe97ae18c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:03.427938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:03.427938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:03.427938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:03.427938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:03.427938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:03.427938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:03.427938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:03.427938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:03.427938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:03.427938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:03.427938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:03.427938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:57:03.427938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:57:03.427938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:03.428945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:03.429860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:57:03.429860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:57:03.429860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:03.429860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:03.432400 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 452/898] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:03.438632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8d180-696a-4536-b8a9-0600b737ce0f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:03.689780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8d180-696a-4536-b8a9-0600b737ce0f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:03.724311 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:03.771136 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cce76-46af-4cad-94cf-0c51f2d0406d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:03.773975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cce76-46af-4cad-94cf-0c51f2d0406d None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:03.774520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cce76-46af-4cad-94cf-0c51f2d0406d None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:03.775041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cce76-46af-4cad-94cf-0c51f2d0406d None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:03.776432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cce76-46af-4cad-94cf-0c51f2d0406d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:03.776972 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cce76-46af-4cad-94cf-0c51f2d0406d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:03.779695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cce76-46af-4cad-94cf-0c51f2d0406d None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:03.817069 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 447/899] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:03.827700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b2f7a-ee9d-4a15-9842-77bbe97ae18c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:03.970598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:04.058991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b2f7a-ee9d-4a15-9842-77bbe97ae18c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:04.135091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2d913-cf96-478e-93f0-1d203ad9d96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:04.137646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2d913-cf96-478e-93f0-1d203ad9d96d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:04.138567 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2d913-cf96-478e-93f0-1d203ad9d96d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:04.139393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2d913-cf96-478e-93f0-1d203ad9d96d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:04.154451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2d913-cf96-478e-93f0-1d203ad9d96d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:04.157988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2d913-cf96-478e-93f0-1d203ad9d96d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:04.181467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-42e2d913-cf96-478e-93f0-1d203ad9d96d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:57:04.181467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:04.181467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:04.181467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:04.181467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:04.181467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:04.181467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:04.181467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:04.181467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:04.181467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:04.181467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:04.181467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:04.181467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:57:04.181467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:57:04.181467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:04.183052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:04.184863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:57:04.184863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:57:04.184863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:57:04.184863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:57:04.184863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:57:04.184863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:57:04.184863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:57:04.184863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:04.188605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 453/900] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:57:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:04.200188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cce76-46af-4cad-94cf-0c51f2d0406d None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:04.436224 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cce76-46af-4cad-94cf-0c51f2d0406d None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:04.511717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e2317-797b-4653-b7c7-c67bc51f7fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:04.512803 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e2317-797b-4653-b7c7-c67bc51f7fef None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:04.513297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e2317-797b-4653-b7c7-c67bc51f7fef None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:04.513793 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e2317-797b-4653-b7c7-c67bc51f7fef None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:04.515353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e2317-797b-4653-b7c7-c67bc51f7fef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:04.515908 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e2317-797b-4653-b7c7-c67bc51f7fef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:04.518985 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e2317-797b-4653-b7c7-c67bc51f7fef None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:04.546591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 448/901] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:57:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:04.561393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2d913-cf96-478e-93f0-1d203ad9d96d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:04.773242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2d913-cf96-478e-93f0-1d203ad9d96d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:04.822690 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:04.845572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624f1f2-a7da-490f-9a5c-d86fc93e4176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:04.847286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624f1f2-a7da-490f-9a5c-d86fc93e4176 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:04.848146 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624f1f2-a7da-490f-9a5c-d86fc93e4176 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:04.848884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624f1f2-a7da-490f-9a5c-d86fc93e4176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:04.851299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624f1f2-a7da-490f-9a5c-d86fc93e4176 None admin] RBAC: Adding query filter params (role.id=79c75f5a5a5e44df9e723176a6ca33d8, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=3497ed5c5d204d088a178a9560ee83cf) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:04.852194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624f1f2-a7da-490f-9a5c-d86fc93e4176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:04.855261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624f1f2-a7da-490f-9a5c-d86fc93e4176 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:04.867684 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 454/902] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:57:04 2022] GET /identity/v3/role_assignments?user.id=3497ed5c5d204d088a178a9560ee83cf&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=79c75f5a5a5e44df9e723176a6ca33d8 => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:04.976594 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d272fc-19cf-4319-98e2-bc68169ee193 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:04.977423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d272fc-19cf-4319-98e2-bc68169ee193 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:04.977561 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d272fc-19cf-4319-98e2-bc68169ee193 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:04.980774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 449/903] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:04.989957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded72aa-9e44-4d56-a7c7-799e0042fe54 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:04.991406 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded72aa-9e44-4d56-a7c7-799e0042fe54 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:04.992153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded72aa-9e44-4d56-a7c7-799e0042fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:05.026114 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5ded72aa-9e44-4d56-a7c7-799e0042fe54 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:05.028944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5ded72aa-9e44-4d56-a7c7-799e0042fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:05.132418 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 455/904] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:05.174609 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d272fc-19cf-4319-98e2-bc68169ee193 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:05.249233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:05.308513 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d6e1e-5105-4e98-a5f9-3090d6ef8633 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:05.309336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d6e1e-5105-4e98-a5f9-3090d6ef8633 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:05.309336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d6e1e-5105-4e98-a5f9-3090d6ef8633 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:05.311979 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 456/905] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:57:05.317683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447949f7-91b7-4442-8125-e9e1874d62ab None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:05.317949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447949f7-91b7-4442-8125-e9e1874d62ab None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:05.318233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447949f7-91b7-4442-8125-e9e1874d62ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:05.341572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-447949f7-91b7-4442-8125-e9e1874d62ab None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:05.343621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-447949f7-91b7-4442-8125-e9e1874d62ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:05.394423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d272fc-19cf-4319-98e2-bc68169ee193 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:05.455326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 457/906] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:05.481640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447949f7-91b7-4442-8125-e9e1874d62ab None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:05.484964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0b068-a3de-4cf2-81b2-735b389163a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:05.486119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0b068-a3de-4cf2-81b2-735b389163a7 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:05.486743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0b068-a3de-4cf2-81b2-735b389163a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:05.487272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0b068-a3de-4cf2-81b2-735b389163a7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:05.488547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0b068-a3de-4cf2-81b2-735b389163a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:05.493969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0b068-a3de-4cf2-81b2-735b389163a7 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-64f0b068-a3de-4cf2-81b2-735b389163a7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:05.510951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:05.513059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:05.516078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:05.516078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:05.516078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:05.516078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:05.516078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:05.516078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:05.516078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:05.516078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:05.516078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:05.516078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:05.516078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:05.516078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:57:05.516078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:05.516078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:57:05.516078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:05.520481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 450/907] 10.222.0.98 () {56 vars in 1132 bytes} [Tue Jul 26 14:57:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:05.523516 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e083f3e-b6e2-4a41-bd1a-36a6aae2eb39 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:05.524003 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e083f3e-b6e2-4a41-bd1a-36a6aae2eb39 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:05.524498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e083f3e-b6e2-4a41-bd1a-36a6aae2eb39 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:05.527532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 451/908] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:05.528977 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e083f3e-b6e2-4a41-bd1a-36a6aae2eb39 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:05.577389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:05.689888 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447949f7-91b7-4442-8125-e9e1874d62ab None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:05.720563 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:05.729966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e083f3e-b6e2-4a41-bd1a-36a6aae2eb39 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:05.770858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54454942-16fd-42fb-947a-3ecac3072a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:05.772468 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54454942-16fd-42fb-947a-3ecac3072a43 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:05.772964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54454942-16fd-42fb-947a-3ecac3072a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:05.773460 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54454942-16fd-42fb-947a-3ecac3072a43 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:05.774837 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54454942-16fd-42fb-947a-3ecac3072a43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:05.777454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54454942-16fd-42fb-947a-3ecac3072a43 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:05.785743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d4d54-49e5-4c4f-84d2-7f4872ca11e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:05.787035 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d4d54-49e5-4c4f-84d2-7f4872ca11e8 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:05.788040 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d4d54-49e5-4c4f-84d2-7f4872ca11e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:05.788513 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d4d54-49e5-4c4f-84d2-7f4872ca11e8 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:05.789586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d4d54-49e5-4c4f-84d2-7f4872ca11e8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:05.789929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d4d54-49e5-4c4f-84d2-7f4872ca11e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:05.792033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d4d54-49e5-4c4f-84d2-7f4872ca11e8 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:05.799872 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 452/909] 10.222.0.98 () {56 vars in 1126 bytes} [Tue Jul 26 14:57:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:05.801631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e742df-676a-4989-9d06-014add7881e5 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:05.802089 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e742df-676a-4989-9d06-014add7881e5 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:05.802329 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e742df-676a-4989-9d06-014add7881e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:05.831139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-75e742df-676a-4989-9d06-014add7881e5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:05.833028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-75e742df-676a-4989-9d06-014add7881e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:05.905352 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 458/910] 10.222.0.98 () {60 vars in 1141 bytes} [Tue Jul 26 14:57:05 2022] POST /identity/v3/services => generated 241 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:57:05.907010 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54454942-16fd-42fb-947a-3ecac3072a43 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:05.999019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 453/911] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:06.041883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e742df-676a-4989-9d06-014add7881e5 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:06.133765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54454942-16fd-42fb-947a-3ecac3072a43 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:06.147234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:06.212987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59720d0-fded-4fd9-a053-686c5b50bf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:06.214549 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59720d0-fded-4fd9-a053-686c5b50bf58 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:06.215382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59720d0-fded-4fd9-a053-686c5b50bf58 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:06.216075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59720d0-fded-4fd9-a053-686c5b50bf58 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:06.217236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59720d0-fded-4fd9-a053-686c5b50bf58 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:06.217765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59720d0-fded-4fd9-a053-686c5b50bf58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:06.220332 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59720d0-fded-4fd9-a053-686c5b50bf58 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:06.228428 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 459/912] 10.222.0.98 () {56 vars in 1126 bytes} [Tue Jul 26 14:57:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:06.235539 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59720d0-fded-4fd9-a053-686c5b50bf58 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:06.246506 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:06.268672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e742df-676a-4989-9d06-014add7881e5 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:06.337322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb694dc-d474-4867-821a-83cd7062f899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:06.338532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb694dc-d474-4867-821a-83cd7062f899 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:06.339356 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb694dc-d474-4867-821a-83cd7062f899 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:06.340011 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb694dc-d474-4867-821a-83cd7062f899 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:06.341224 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb694dc-d474-4867-821a-83cd7062f899 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:06.344560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb694dc-d474-4867-821a-83cd7062f899 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-1eb694dc-d474-4867-821a-83cd7062f899 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:06.364669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:06.367626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:06.369979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:06.369979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:06.369979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:06.369979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:06.369979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:06.369979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:06.369979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:06.369979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:06.369979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:06.369979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:06.369979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:57:06.369979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:06.369979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:57:06.369979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:06.369979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 454/913] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:57:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:06.374830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb694dc-d474-4867-821a-83cd7062f899 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:06.408825 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59720d0-fded-4fd9-a053-686c5b50bf58 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:06.460748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaff707-9569-4c42-8307-e470b7183249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:06.461542 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaff707-9569-4c42-8307-e470b7183249 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:06.461982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaff707-9569-4c42-8307-e470b7183249 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:06.462336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaff707-9569-4c42-8307-e470b7183249 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:06.463324 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaff707-9569-4c42-8307-e470b7183249 None admin] RBAC: Adding query filter params (interface=public, service_id=582ca18922d54d879d248a66f3202b27, region_id=RegionOne) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:06.463646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaff707-9569-4c42-8307-e470b7183249 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:06.466322 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaff707-9569-4c42-8307-e470b7183249 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:06.478493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 460/914] 10.222.0.98 () {56 vars in 1251 bytes} [Tue Jul 26 14:57:06 2022] GET /identity/v3/endpoints?service_id=582ca18922d54d879d248a66f3202b27&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:06.482348 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaff707-9569-4c42-8307-e470b7183249 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:06.566156 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:06.582413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb694dc-d474-4867-821a-83cd7062f899 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:06.668367 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e9e8f-3918-403e-8df1-15b3f40c9a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:06.669473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e9e8f-3918-403e-8df1-15b3f40c9a7e None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:06.670679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e9e8f-3918-403e-8df1-15b3f40c9a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:06.671186 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e9e8f-3918-403e-8df1-15b3f40c9a7e None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:06.672426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e9e8f-3918-403e-8df1-15b3f40c9a7e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:06.673038 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e9e8f-3918-403e-8df1-15b3f40c9a7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:06.675569 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e9e8f-3918-403e-8df1-15b3f40c9a7e None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:06.684543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 455/915] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:57:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:06.691432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaff707-9569-4c42-8307-e470b7183249 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:06.699220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e9e8f-3918-403e-8df1-15b3f40c9a7e None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:06.759532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846016e-eb3f-42d4-92fe-5ec83578c548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:06.759869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:06.760732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846016e-eb3f-42d4-92fe-5ec83578c548 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:06.761208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846016e-eb3f-42d4-92fe-5ec83578c548 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:06.761801 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846016e-eb3f-42d4-92fe-5ec83578c548 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:06.763035 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846016e-eb3f-42d4-92fe-5ec83578c548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:06.765512 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846016e-eb3f-42d4-92fe-5ec83578c548 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:06.777377 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 461/916] 10.222.0.98 () {56 vars in 1087 bytes} [Tue Jul 26 14:57:06 2022] GET /identity/v3/services => generated 1497 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 14:57:06.906412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e9e8f-3918-403e-8df1-15b3f40c9a7e None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:06.988501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca1dfb-025d-4967-914e-0e0da19ef4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:06.989043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca1dfb-025d-4967-914e-0e0da19ef4cc None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:06.989353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca1dfb-025d-4967-914e-0e0da19ef4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:06.989601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca1dfb-025d-4967-914e-0e0da19ef4cc None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:06.990700 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca1dfb-025d-4967-914e-0e0da19ef4cc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:06.991037 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca1dfb-025d-4967-914e-0e0da19ef4cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:06.992544 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca1dfb-025d-4967-914e-0e0da19ef4cc None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:07.003372 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 456/917] 10.222.0.98 () {56 vars in 1114 bytes} [Tue Jul 26 14:57:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:07.011914 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846016e-eb3f-42d4-92fe-5ec83578c548 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:07.187854 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:07.195402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846016e-eb3f-42d4-92fe-5ec83578c548 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:07.245722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59e452-642e-44fe-80fe-936192557385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:07.246273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59e452-642e-44fe-80fe-936192557385 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:07.246593 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59e452-642e-44fe-80fe-936192557385 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:07.246866 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59e452-642e-44fe-80fe-936192557385 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:07.247691 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59e452-642e-44fe-80fe-936192557385 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:07.249245 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59e452-642e-44fe-80fe-936192557385 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:07.429222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 462/918] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 14:57:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:57:07.592876 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9887a2d-7008-4feb-aff9-66e2f2937436 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:07.593322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9887a2d-7008-4feb-aff9-66e2f2937436 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:07.593322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9887a2d-7008-4feb-aff9-66e2f2937436 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:07.595219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 457/919] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:57:07.601647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c294d2-babc-4779-8dc0-689c151c0f9f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:07.602126 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c294d2-babc-4779-8dc0-689c151c0f9f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:07.602405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c294d2-babc-4779-8dc0-689c151c0f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:07.624853 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-97c294d2-babc-4779-8dc0-689c151c0f9f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:07.626314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-97c294d2-babc-4779-8dc0-689c151c0f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:07.723667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 463/920] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:07.749038 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9887a2d-7008-4feb-aff9-66e2f2937436 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:07.914853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:07.954566 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9887a2d-7008-4feb-aff9-66e2f2937436 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:08.025293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f1779-630b-4bf8-880d-174cda47570f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:08.026499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f1779-630b-4bf8-880d-174cda47570f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:08.026960 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f1779-630b-4bf8-880d-174cda47570f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:08.027480 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f1779-630b-4bf8-880d-174cda47570f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:08.045558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f1779-630b-4bf8-880d-174cda47570f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-771f1779-630b-4bf8-880d-174cda47570f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:57:08.051482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:08.053471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:08.054501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:08.054501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:08.054501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:08.054501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:08.054501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:57:08.054501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:57:08.054501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:57:08.054501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:57:08.054501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:57:08.054501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:57:08.054501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:57:08.054501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:08.054501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 458/921] 10.222.0.98 () {56 vars in 1120 bytes} [Tue Jul 26 14:57:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:08.064507 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c294d2-babc-4779-8dc0-689c151c0f9f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:08.221386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:08.263057 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c294d2-babc-4779-8dc0-689c151c0f9f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:08.331450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40676190-dd05-4dbb-8e1c-6e36faef23df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:08.332286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40676190-dd05-4dbb-8e1c-6e36faef23df None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:08.332778 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40676190-dd05-4dbb-8e1c-6e36faef23df None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:08.333234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40676190-dd05-4dbb-8e1c-6e36faef23df None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:08.334954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40676190-dd05-4dbb-8e1c-6e36faef23df None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:08.335437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40676190-dd05-4dbb-8e1c-6e36faef23df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:08.337515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40676190-dd05-4dbb-8e1c-6e36faef23df None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:08.351848 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 464/922] 10.222.0.98 () {56 vars in 1115 bytes} [Tue Jul 26 14:57:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:08.357582 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f1779-630b-4bf8-880d-174cda47570f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:08.479143 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f1779-630b-4bf8-880d-174cda47570f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:08.523574 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ce009-3b9c-4d82-a0dc-5440ac309586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:08.524329 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ce009-3b9c-4d82-a0dc-5440ac309586 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:08.524737 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ce009-3b9c-4d82-a0dc-5440ac309586 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:08.525138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ce009-3b9c-4d82-a0dc-5440ac309586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:08.537241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:08.539691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ce009-3b9c-4d82-a0dc-5440ac309586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:08.541327 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ce009-3b9c-4d82-a0dc-5440ac309586 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:08.558252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-707ce009-3b9c-4d82-a0dc-5440ac309586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:08.558252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:08.558252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:08.558252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:08.558252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:08.558252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:08.558252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:08.558252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:08.558252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:08.558252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:08.558252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:08.558252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:08.558252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:57:08.558252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:57:08.558252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:08.559623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:08.560720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:57:08.560720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:57:08.560720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:08.560720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:08.560720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 459/923] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:08.567344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40676190-dd05-4dbb-8e1c-6e36faef23df None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:08.663898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65375129-b615-4a72-8238-839feb98cb75 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:08.664204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65375129-b615-4a72-8238-839feb98cb75 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:08.664639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65375129-b615-4a72-8238-839feb98cb75 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:08.666508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 460/924] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:08.672205 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660c420-0d8a-4071-82a3-da712d556cee None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:08.672557 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660c420-0d8a-4071-82a3-da712d556cee None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:08.672922 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660c420-0d8a-4071-82a3-da712d556cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:08.706197 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b660c420-0d8a-4071-82a3-da712d556cee None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:08.708604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b660c420-0d8a-4071-82a3-da712d556cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:08.760125 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40676190-dd05-4dbb-8e1c-6e36faef23df None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:08.804578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 461/925] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:57:08.824069 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660c420-0d8a-4071-82a3-da712d556cee None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:08.837108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e350ec-ed22-44d7-855c-d8e2e1914903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:08.838136 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e350ec-ed22-44d7-855c-d8e2e1914903 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:08.840731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e350ec-ed22-44d7-855c-d8e2e1914903 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:08.840731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e350ec-ed22-44d7-855c-d8e2e1914903 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:08.840731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e350ec-ed22-44d7-855c-d8e2e1914903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:08.841048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e350ec-ed22-44d7-855c-d8e2e1914903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:08.843610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e350ec-ed22-44d7-855c-d8e2e1914903 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:08.867209 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 465/926] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:08.875881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e350ec-ed22-44d7-855c-d8e2e1914903 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:08.881040 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:08.958211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660c420-0d8a-4071-82a3-da712d556cee None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:08.991434 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:09.004858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5084f-10b9-4583-8ff1-8a724299aae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:09.007206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5084f-10b9-4583-8ff1-8a724299aae2 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:09.007206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5084f-10b9-4583-8ff1-8a724299aae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:09.007206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5084f-10b9-4583-8ff1-8a724299aae2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:09.008123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5084f-10b9-4583-8ff1-8a724299aae2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:09.009874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5084f-10b9-4583-8ff1-8a724299aae2 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-d9b5084f-10b9-4583-8ff1-8a724299aae2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:09.020858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:09.021975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:09.023093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:09.023093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:09.023093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:09.023093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:09.023093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:09.023093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:09.023093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:09.023093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:09.023093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:09.023093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:09.023093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:57:09.023093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:09.023093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:57:09.023093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:09.026546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 462/927] 10.222.0.98 () {56 vars in 1126 bytes} [Tue Jul 26 14:57:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:09.038683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5084f-10b9-4583-8ff1-8a724299aae2 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:09.084460 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e350ec-ed22-44d7-855c-d8e2e1914903 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:09.159729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e699cc-2d5e-4296-9e16-cde55bee5c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:09.160628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e699cc-2d5e-4296-9e16-cde55bee5c3b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:09.161132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e699cc-2d5e-4296-9e16-cde55bee5c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:09.162196 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e699cc-2d5e-4296-9e16-cde55bee5c3b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:09.178404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e699cc-2d5e-4296-9e16-cde55bee5c3b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:09.181158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e699cc-2d5e-4296-9e16-cde55bee5c3b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:09.195953 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5084f-10b9-4583-8ff1-8a724299aae2 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-91e699cc-2d5e-4296-9e16-cde55bee5c3b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:57:09.206353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:09.222301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:09.223388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:09.223388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:09.223388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:57:09.223388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:57:09.223388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:57:09.223388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:57:09.223388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:57:09.223388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:57:09.223388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:57:09.223388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:09.223388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 466/928] 10.222.0.98 () {56 vars in 1117 bytes} [Tue Jul 26 14:57:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:09.223388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e699cc-2d5e-4296-9e16-cde55bee5c3b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:09.247344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df7f6c-f94c-41c3-909c-495bb75e9534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:09.248914 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df7f6c-f94c-41c3-909c-495bb75e9534 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:09.249440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df7f6c-f94c-41c3-909c-495bb75e9534 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:09.249926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df7f6c-f94c-41c3-909c-495bb75e9534 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:09.251209 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df7f6c-f94c-41c3-909c-495bb75e9534 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:09.251728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df7f6c-f94c-41c3-909c-495bb75e9534 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:09.253759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df7f6c-f94c-41c3-909c-495bb75e9534 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:09.267387 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 463/929] 10.222.0.98 () {56 vars in 1122 bytes} [Tue Jul 26 14:57:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:09.271534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df7f6c-f94c-41c3-909c-495bb75e9534 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:09.347263 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:09.361344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:09.420865 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df7f6c-f94c-41c3-909c-495bb75e9534 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:09.451368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e699cc-2d5e-4296-9e16-cde55bee5c3b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:09.499546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573606b-0bbc-4232-81a7-9850d42613cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:09.500633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573606b-0bbc-4232-81a7-9850d42613cc None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:09.501121 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573606b-0bbc-4232-81a7-9850d42613cc None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:09.501601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573606b-0bbc-4232-81a7-9850d42613cc None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:09.502967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573606b-0bbc-4232-81a7-9850d42613cc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:09.503510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573606b-0bbc-4232-81a7-9850d42613cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:09.506183 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573606b-0bbc-4232-81a7-9850d42613cc None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:09.522509 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 464/930] 10.222.0.98 () {56 vars in 1122 bytes} [Tue Jul 26 14:57:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:09.530691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573606b-0bbc-4232-81a7-9850d42613cc None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:09.562333 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0653f5d-532e-4621-88a2-764c04413733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:09.563704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0653f5d-532e-4621-88a2-764c04413733 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:09.564336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0653f5d-532e-4621-88a2-764c04413733 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:09.564945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0653f5d-532e-4621-88a2-764c04413733 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:09.567101 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0653f5d-532e-4621-88a2-764c04413733 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:09.567836 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0653f5d-532e-4621-88a2-764c04413733 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:09.571202 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0653f5d-532e-4621-88a2-764c04413733 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:09.618853 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 467/931] 10.222.0.98 () {56 vars in 1149 bytes} [Tue Jul 26 14:57:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:09.623342 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0653f5d-532e-4621-88a2-764c04413733 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:09.812977 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573606b-0bbc-4232-81a7-9850d42613cc None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:09.842659 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:09.847550 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0653f5d-532e-4621-88a2-764c04413733 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:09.882011 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2e93f-8634-409c-ae25-e30d89236e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:09.882836 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2e93f-8634-409c-ae25-e30d89236e4e None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:09.883206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2e93f-8634-409c-ae25-e30d89236e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:09.883647 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2e93f-8634-409c-ae25-e30d89236e4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:09.884975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2e93f-8634-409c-ae25-e30d89236e4e None admin] RBAC: Adding query filter params (interface=public, service_id=69535835d4c74e69a0457043fcb06405, region_id=RegionOne) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:09.885603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2e93f-8634-409c-ae25-e30d89236e4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:09.888068 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2e93f-8634-409c-ae25-e30d89236e4e None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:09.889014 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:09.897968 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 465/932] 10.222.0.98 () {56 vars in 1251 bytes} [Tue Jul 26 14:57:09 2022] GET /identity/v3/endpoints?service_id=69535835d4c74e69a0457043fcb06405&interface=public®ion_id=RegionOne => generated 194 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:09.907678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ff87d-f974-4e16-9b97-783f6f37c34c None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:09.907678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ff87d-f974-4e16-9b97-783f6f37c34c None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:09.907678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ff87d-f974-4e16-9b97-783f6f37c34c None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:09.907678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 466/933] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:09.907678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ff87d-f974-4e16-9b97-783f6f37c34c None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:09.924486 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be7246-b529-434b-9c4b-e196476d1b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:09.925463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be7246-b529-434b-9c4b-e196476d1b21 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:09.925856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be7246-b529-434b-9c4b-e196476d1b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:09.926293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be7246-b529-434b-9c4b-e196476d1b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:09.940058 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be7246-b529-434b-9c4b-e196476d1b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:09.942059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be7246-b529-434b-9c4b-e196476d1b21 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:09.964921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-58be7246-b529-434b-9c4b-e196476d1b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:09.964921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:09.964921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:09.964921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:09.964921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:09.964921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:09.964921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:09.964921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:09.964921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:09.964921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:09.964921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:09.964921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:09.964921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:57:09.964921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:57:09.964921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:09.966780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:09.968671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:57:09.968671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:57:09.968671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:09.968671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:09.968671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 468/934] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:09.971073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bdac3-ea1d-471e-975f-35df00c6ced1 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:09.971073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bdac3-ea1d-471e-975f-35df00c6ced1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:09.971073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bdac3-ea1d-471e-975f-35df00c6ced1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:09.994694 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-433bdac3-ea1d-471e-975f-35df00c6ced1 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:09.996383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-433bdac3-ea1d-471e-975f-35df00c6ced1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:10.088505 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 469/935] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:10.089281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bdac3-ea1d-471e-975f-35df00c6ced1 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:10.140640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ff87d-f974-4e16-9b97-783f6f37c34c None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:10.202735 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb18373-583d-440b-9ae7-c90d381aac59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:10.203375 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb18373-583d-440b-9ae7-c90d381aac59 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:10.203654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb18373-583d-440b-9ae7-c90d381aac59 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:10.203933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb18373-583d-440b-9ae7-c90d381aac59 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:10.204611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb18373-583d-440b-9ae7-c90d381aac59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:10.206127 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb18373-583d-440b-9ae7-c90d381aac59 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:10.213529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 467/936] 10.222.0.98 () {56 vars in 1087 bytes} [Tue Jul 26 14:57:09 2022] GET /identity/v3/services => generated 1497 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 14:57:10.219372 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9449b-7105-4d5f-8062-859c7c501ce4 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:10.219372 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9449b-7105-4d5f-8062-859c7c501ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:10.219372 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9449b-7105-4d5f-8062-859c7c501ce4 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:10.219372 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 468/937] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:10.219372 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9449b-7105-4d5f-8062-859c7c501ce4 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:10.273794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bdac3-ea1d-471e-975f-35df00c6ced1 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:10.277531 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:10.295964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:10.349258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fd076-0338-4507-8c06-bb54d1615881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:10.351063 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd076-0338-4507-8c06-bb54d1615881 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:10.351678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd076-0338-4507-8c06-bb54d1615881 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:10.352256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd076-0338-4507-8c06-bb54d1615881 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:10.353587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fd076-0338-4507-8c06-bb54d1615881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:10.354151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fd076-0338-4507-8c06-bb54d1615881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:10.357008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fd076-0338-4507-8c06-bb54d1615881 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:10.379666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 470/938] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:10.385333 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48bc06-d96f-499e-85c5-fe1c7be7e920 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:10.385333 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48bc06-d96f-499e-85c5-fe1c7be7e920 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:10.385333 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48bc06-d96f-499e-85c5-fe1c7be7e920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:10.426222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ce48bc06-d96f-499e-85c5-fe1c7be7e920 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:10.428999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ce48bc06-d96f-499e-85c5-fe1c7be7e920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:10.448985 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9449b-7105-4d5f-8062-859c7c501ce4 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:10.527567 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27a7b0-467d-4501-9f82-8299e4d4a4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:10.528705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a7b0-467d-4501-9f82-8299e4d4a4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:10.529214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a7b0-467d-4501-9f82-8299e4d4a4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:10.529695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a7b0-467d-4501-9f82-8299e4d4a4c9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:10.530881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27a7b0-467d-4501-9f82-8299e4d4a4c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:10.534930 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27a7b0-467d-4501-9f82-8299e4d4a4c9 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-2b27a7b0-467d-4501-9f82-8299e4d4a4c9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:10.547044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:10.549260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:10.551130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 469/939] 10.222.0.98 () {56 vars in 1132 bytes} [Tue Jul 26 14:57:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:10.553198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27a7b0-467d-4501-9f82-8299e4d4a4c9 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:10.622449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 471/940] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:10.622449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48bc06-d96f-499e-85c5-fe1c7be7e920 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:10.789371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27a7b0-467d-4501-9f82-8299e4d4a4c9 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:10.796539 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:10.801146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:10.811021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48bc06-d96f-499e-85c5-fe1c7be7e920 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:10.839847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904753e-0f44-4aa3-a3ba-e3af953f2ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:10.841645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904753e-0f44-4aa3-a3ba-e3af953f2ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:10.841645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904753e-0f44-4aa3-a3ba-e3af953f2ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:10.841943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904753e-0f44-4aa3-a3ba-e3af953f2ff5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:10.852654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904753e-0f44-4aa3-a3ba-e3af953f2ff5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:10.854490 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904753e-0f44-4aa3-a3ba-e3af953f2ff5 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:10.873383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfdde8-c327-4da1-b510-29ac4d967933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:10.874236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfdde8-c327-4da1-b510-29ac4d967933 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:10.874682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfdde8-c327-4da1-b510-29ac4d967933 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:10.875088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfdde8-c327-4da1-b510-29ac4d967933 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:10.876216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfdde8-c327-4da1-b510-29ac4d967933 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:10.876748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfdde8-c327-4da1-b510-29ac4d967933 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:10.879471 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfdde8-c327-4da1-b510-29ac4d967933 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:10.889047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-4904753e-0f44-4aa3-a3ba-e3af953f2ff5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:57:10.889047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:10.889047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:10.889047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:10.889047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:10.889047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:10.889047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:10.889047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:10.889047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:10.889047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:10.889047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:10.889047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:10.889047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:57:10.889047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:57:10.889047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:10.890896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:10.892645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:57:10.892645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:57:10.892645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:57:10.892645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:57:10.892645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:57:10.892645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:57:10.892645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:57:10.892645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:10.893514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 472/941] 10.222.0.98 () {56 vars in 1126 bytes} [Tue Jul 26 14:57:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:10.893514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfdde8-c327-4da1-b510-29ac4d967933 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:10.904362 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 470/942] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:57:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:10.904362 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904753e-0f44-4aa3-a3ba-e3af953f2ff5 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:11.057638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfdde8-c327-4da1-b510-29ac4d967933 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:11.064767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904753e-0f44-4aa3-a3ba-e3af953f2ff5 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:11.121119 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6ead0-c415-4f72-b7e9-237770fca22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:11.122039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6ead0-c415-4f72-b7e9-237770fca22f None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:11.122525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6ead0-c415-4f72-b7e9-237770fca22f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:11.122712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf950a4-1639-4fa5-9081-1cd336c8bf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:11.123017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6ead0-c415-4f72-b7e9-237770fca22f None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:11.123320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf950a4-1639-4fa5-9081-1cd336c8bf66 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:11.123742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf950a4-1639-4fa5-9081-1cd336c8bf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:11.124001 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf950a4-1639-4fa5-9081-1cd336c8bf66 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:11.124282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6ead0-c415-4f72-b7e9-237770fca22f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:11.124718 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf950a4-1639-4fa5-9081-1cd336c8bf66 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:11.125149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf950a4-1639-4fa5-9081-1cd336c8bf66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:11.126132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6ead0-c415-4f72-b7e9-237770fca22f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:11.126632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf950a4-1639-4fa5-9081-1cd336c8bf66 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:11.130161 dv-cinder-851032-1-smb devstack@keystone.service[80488]: WARNING keystone.server.flask.common [None req-c3a6ead0-c415-4f72-b7e9-237770fca22f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 14:57:11.143335 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 471/943] 10.222.0.98 () {56 vars in 1126 bytes} [Tue Jul 26 14:57:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:11.143335 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf950a4-1639-4fa5-9081-1cd336c8bf66 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:11.172010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:11.264468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf950a4-1639-4fa5-9081-1cd336c8bf66 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:11.281076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.sql.core [None req-c3a6ead0-c415-4f72-b7e9-237770fca22f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 14:57:11.281076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 14:57:11.281076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [parameters: {'id': '11a45e2d1c284f4099d4a8cc430acfbe', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 14:57:11.281076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80488) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 14:57:11.289712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-c3a6ead0-c415-4f72-b7e9-237770fca22f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 11a45e2d1c284f4099d4a8cc430acfbe.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 11a45e2d1c284f4099d4a8cc430acfbe. Jul 26 14:57:11.289712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:11.289712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:57:11.289712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:57:11.289712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:57:11.289712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:57:11.289712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:57:11.289712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:57:11.289712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:57:11.289712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:57:11.289712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:57:11.289712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:57:11.289712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result.read() Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 26 14:57:11.294762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application yield resource Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise self.value Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application session.commit() Jul 26 14:57:11.299595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.session.flush() Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application compat.raise_( Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 14:57:11.301689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 14:57:11.303824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 14:57:11.303824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 14:57:11.303824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 14:57:11.303824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 14:57:11.303824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 14:57:11.303824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 14:57:11.303824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 14:57:11.303824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 14:57:11.303824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 14:57:11.303824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 14:57:11.303824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 14:57:11.303824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 14:57:11.303824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 14:57:11.303824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 14:57:11.303824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result.read() Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:57:11.305597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:57:11.308001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:57:11.308001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:57:11.308001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:57:11.308001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:57:11.308001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:57:11.308001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:57:11.308001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 14:57:11.308001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 14:57:11.308001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [parameters: {'id': '11a45e2d1c284f4099d4a8cc430acfbe', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 14:57:11.308001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 14:57:11.308001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:11.308001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:11.308001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:11.308001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:11.308001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:11.309104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:11.310337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:11.310337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 26 14:57:11.310337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 26 14:57:11.310337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:11.310337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:11.310337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 26 14:57:11.310337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 26 14:57:11.310337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 11a45e2d1c284f4099d4a8cc430acfbe. Jul 26 14:57:11.310337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:11.310337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 473/944] 10.222.0.98 () {60 vars in 1140 bytes} [Tue Jul 26 14:57:10 2022] POST /identity/v3/projects => generated 262 bytes in 401 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:11.310337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6ead0-c415-4f72-b7e9-237770fca22f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:11.317786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:11.332587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c93af-e258-49d0-a217-9860a5d724bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:11.339077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c93af-e258-49d0-a217-9860a5d724bf None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:11.339077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c93af-e258-49d0-a217-9860a5d724bf None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:11.339077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c93af-e258-49d0-a217-9860a5d724bf None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:11.339077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c93af-e258-49d0-a217-9860a5d724bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:11.339077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c93af-e258-49d0-a217-9860a5d724bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:11.340379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c93af-e258-49d0-a217-9860a5d724bf None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:11.374839 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 472/945] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:57:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:11.374839 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c93af-e258-49d0-a217-9860a5d724bf None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:11.457386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6ead0-c415-4f72-b7e9-237770fca22f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:11.513781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebf340-6f1d-4e43-8876-88e6ff0bd239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:11.514677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebf340-6f1d-4e43-8876-88e6ff0bd239 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:11.514991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebf340-6f1d-4e43-8876-88e6ff0bd239 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:11.515442 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebf340-6f1d-4e43-8876-88e6ff0bd239 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:11.516747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebf340-6f1d-4e43-8876-88e6ff0bd239 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:11.518747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebf340-6f1d-4e43-8876-88e6ff0bd239 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:11.547195 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:11.566626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c93af-e258-49d0-a217-9860a5d724bf None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:11.623937 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6532e63-e751-4d0d-a233-3bee8f78bd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:11.624631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6532e63-e751-4d0d-a233-3bee8f78bd90 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:11.624981 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6532e63-e751-4d0d-a233-3bee8f78bd90 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:11.625188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6532e63-e751-4d0d-a233-3bee8f78bd90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:11.637075 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6532e63-e751-4d0d-a233-3bee8f78bd90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:11.642049 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6532e63-e751-4d0d-a233-3bee8f78bd90 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:11.654290 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 474/946] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 14:57:11 2022] POST /identity/v3/endpoints => generated 347 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:57:11.656606 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebf340-6f1d-4e43-8876-88e6ff0bd239 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:11.656864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-b6532e63-e751-4d0d-a233-3bee8f78bd90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:57:11.656864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:11.656864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:11.656864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:11.656864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:11.656864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:11.656864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:11.656864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:11.656864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:11.656864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:11.656864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:11.656864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:11.656864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:57:11.656864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:57:11.656864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:11.657779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:11.658794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:57:11.658794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:57:11.658794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:57:11.658794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:57:11.658794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:57:11.658794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:57:11.658794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:57:11.658794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:11.666298 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 473/947] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:57:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:11.668122 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6532e63-e751-4d0d-a233-3bee8f78bd90 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:11.788591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:11.878030 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebf340-6f1d-4e43-8876-88e6ff0bd239 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:11.909516 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6532e63-e751-4d0d-a233-3bee8f78bd90 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:11.960075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76750660-cbac-47be-a71e-f6f4f25819eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:11.960792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76750660-cbac-47be-a71e-f6f4f25819eb None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:11.961080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76750660-cbac-47be-a71e-f6f4f25819eb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:11.961362 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76750660-cbac-47be-a71e-f6f4f25819eb None admin] PATH_INFO: `/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/3497ed5c5d204d088a178a9560ee83cf/roles/79c75f5a5a5e44df9e723176a6ca33d8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:11.965719 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76750660-cbac-47be-a71e-f6f4f25819eb None admin] RBAC: Authorizing `identity:create_grant(project_id=7f750777b75f49a19a5019c4fc2c00f5, user_id=3497ed5c5d204d088a178a9560ee83cf, role_id=79c75f5a5a5e44df9e723176a6ca33d8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:11.967469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76750660-cbac-47be-a71e-f6f4f25819eb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:11.992064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed22364-9a29-4544-b41f-c72ca030df3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:11.992927 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed22364-9a29-4544-b41f-c72ca030df3d None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:11.993284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed22364-9a29-4544-b41f-c72ca030df3d None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:11.993629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed22364-9a29-4544-b41f-c72ca030df3d None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:11.994540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed22364-9a29-4544-b41f-c72ca030df3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:11.994863 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed22364-9a29-4544-b41f-c72ca030df3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:11.996383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed22364-9a29-4544-b41f-c72ca030df3d None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:12.019376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 474/948] 10.222.0.98 () {56 vars in 1112 bytes} [Tue Jul 26 14:57:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:12.144221 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 475/949] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:57:11 2022] PUT /identity/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/3497ed5c5d204d088a178a9560ee83cf/roles/79c75f5a5a5e44df9e723176a6ca33d8 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:57:13.493950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f19d4-eaa2-4eb8-aad0-d50cbfb445fc None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:13.494766 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f19d4-eaa2-4eb8-aad0-d50cbfb445fc None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:13.494766 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f19d4-eaa2-4eb8-aad0-d50cbfb445fc None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:13.496747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 475/950] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:13.507611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41350f45-45c6-41e5-a68b-0cce449f6033 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:13.508404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41350f45-45c6-41e5-a68b-0cce449f6033 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:13.508404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41350f45-45c6-41e5-a68b-0cce449f6033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:13.529915 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-41350f45-45c6-41e5-a68b-0cce449f6033 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:13.531668 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-41350f45-45c6-41e5-a68b-0cce449f6033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:13.639509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 476/951] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:13.683967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f19d4-eaa2-4eb8-aad0-d50cbfb445fc None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:13.712840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:13.926051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f19d4-eaa2-4eb8-aad0-d50cbfb445fc None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:14.003846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12e1d1-4634-42d6-85dc-dff3317590e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:14.005669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12e1d1-4634-42d6-85dc-dff3317590e9 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:14.006448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12e1d1-4634-42d6-85dc-dff3317590e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:14.006988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12e1d1-4634-42d6-85dc-dff3317590e9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:14.009468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12e1d1-4634-42d6-85dc-dff3317590e9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:14.013068 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12e1d1-4634-42d6-85dc-dff3317590e9 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-da12e1d1-4634-42d6-85dc-dff3317590e9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:14.032662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:14.034882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:14.037904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:14.037904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:14.037904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:14.037904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:14.037904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:14.037904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:14.037904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:14.037904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:14.037904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:14.037904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:14.037904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:57:14.037904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:14.037904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:57:14.037904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:14.037904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 476/952] 10.222.0.98 () {56 vars in 1126 bytes} [Tue Jul 26 14:57:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:14.043154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41350f45-45c6-41e5-a68b-0cce449f6033 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:14.172311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:14.293016 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41350f45-45c6-41e5-a68b-0cce449f6033 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:14.341980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff7cfd-3e88-49a6-b695-5cab930b69e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:14.343031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff7cfd-3e88-49a6-b695-5cab930b69e1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:14.343528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff7cfd-3e88-49a6-b695-5cab930b69e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:14.343999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff7cfd-3e88-49a6-b695-5cab930b69e1 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:14.345088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff7cfd-3e88-49a6-b695-5cab930b69e1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:14.345625 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff7cfd-3e88-49a6-b695-5cab930b69e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:14.347269 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff7cfd-3e88-49a6-b695-5cab930b69e1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:14.357304 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 477/953] 10.222.0.98 () {56 vars in 1122 bytes} [Tue Jul 26 14:57:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:14.366312 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12e1d1-4634-42d6-85dc-dff3317590e9 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:14.534931 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:14.594579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12e1d1-4634-42d6-85dc-dff3317590e9 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:14.649064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b271530-955d-43c8-985a-ff7872ea302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:14.649723 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b271530-955d-43c8-985a-ff7872ea302e None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:14.650004 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b271530-955d-43c8-985a-ff7872ea302e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:14.650351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b271530-955d-43c8-985a-ff7872ea302e None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:14.651177 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b271530-955d-43c8-985a-ff7872ea302e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:14.651479 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b271530-955d-43c8-985a-ff7872ea302e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:14.652979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b271530-955d-43c8-985a-ff7872ea302e None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:14.660361 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 477/954] 10.222.0.98 () {56 vars in 1122 bytes} [Tue Jul 26 14:57:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:14.669577 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff7cfd-3e88-49a6-b695-5cab930b69e1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:14.774416 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe71cb-83a6-48f2-9174-6fd03a5e99c7 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:14.774918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe71cb-83a6-48f2-9174-6fd03a5e99c7 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:14.775481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe71cb-83a6-48f2-9174-6fd03a5e99c7 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:14.778728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 478/955] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:14.792066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9482502-9dc4-46f2-8058-126ad48f3a08 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:14.792770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9482502-9dc4-46f2-8058-126ad48f3a08 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:14.793445 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9482502-9dc4-46f2-8058-126ad48f3a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:14.831521 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-e9482502-9dc4-46f2-8058-126ad48f3a08 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:14.834725 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e9482502-9dc4-46f2-8058-126ad48f3a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:14.856827 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff7cfd-3e88-49a6-b695-5cab930b69e1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:14.886453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:14.911686 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a0a6e-43d2-4d13-a215-748a31206863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:14.912851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a0a6e-43d2-4d13-a215-748a31206863 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:14.913290 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a0a6e-43d2-4d13-a215-748a31206863 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:14.913784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a0a6e-43d2-4d13-a215-748a31206863 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:14.915000 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a0a6e-43d2-4d13-a215-748a31206863 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:14.917882 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a0a6e-43d2-4d13-a215-748a31206863 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:14.980845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 479/956] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:57:15.004528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9482502-9dc4-46f2-8058-126ad48f3a08 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:15.013425 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 478/957] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 14:57:14 2022] POST /identity/v3/endpoints => generated 349 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:57:15.097966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b985c-24b4-42d5-8bae-2de2e6d095f0 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:15.099784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b985c-24b4-42d5-8bae-2de2e6d095f0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:15.100581 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b985c-24b4-42d5-8bae-2de2e6d095f0 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:15.106577 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 479/958] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:15.110128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0330e-4901-49b0-9372-1ed81b5ccc0d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:15.110791 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0330e-4901-49b0-9372-1ed81b5ccc0d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:15.111303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0330e-4901-49b0-9372-1ed81b5ccc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:15.135242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-22b0330e-4901-49b0-9372-1ed81b5ccc0d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:15.137081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-22b0330e-4901-49b0-9372-1ed81b5ccc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:15.160166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:15.235149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9482502-9dc4-46f2-8058-126ad48f3a08 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:15.255382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 480/959] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:15.282175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0330e-4901-49b0-9372-1ed81b5ccc0d None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:15.326529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfe0eb-ca96-4a82-950d-b6b609cde465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:15.327630 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfe0eb-ca96-4a82-950d-b6b609cde465 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:15.328108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfe0eb-ca96-4a82-950d-b6b609cde465 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:15.329209 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfe0eb-ca96-4a82-950d-b6b609cde465 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:15.332559 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfe0eb-ca96-4a82-950d-b6b609cde465 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:15.337612 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfe0eb-ca96-4a82-950d-b6b609cde465 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-cccfe0eb-ca96-4a82-950d-b6b609cde465 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:15.354753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:15.355856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:15.357425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:15.357425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:15.357425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:15.357425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:15.357425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:15.357425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:15.357425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:15.357425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:15.357425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:15.357425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:15.357425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:57:15.357425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:15.357425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:57:15.357425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:15.357425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 480/960] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:57:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:15.371913 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfe0eb-ca96-4a82-950d-b6b609cde465 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:15.499730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:15.507250 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0330e-4901-49b0-9372-1ed81b5ccc0d None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:15.566313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfe0eb-ca96-4a82-950d-b6b609cde465 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:15.595836 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c110fa-d1f1-4f13-b29d-3781b4eb2ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:15.596719 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c110fa-d1f1-4f13-b29d-3781b4eb2ade None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:15.597180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c110fa-d1f1-4f13-b29d-3781b4eb2ade None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:15.597612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c110fa-d1f1-4f13-b29d-3781b4eb2ade None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:15.598570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c110fa-d1f1-4f13-b29d-3781b4eb2ade None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:15.600911 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c110fa-d1f1-4f13-b29d-3781b4eb2ade None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:15.632679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:15.640918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70997647-f6a2-4b5f-8e37-59503607b830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:15.641817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70997647-f6a2-4b5f-8e37-59503607b830 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:15.642297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70997647-f6a2-4b5f-8e37-59503607b830 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:15.642692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70997647-f6a2-4b5f-8e37-59503607b830 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:15.643605 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70997647-f6a2-4b5f-8e37-59503607b830 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:15.643986 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70997647-f6a2-4b5f-8e37-59503607b830 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:15.646304 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70997647-f6a2-4b5f-8e37-59503607b830 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:15.652814 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 481/961] 10.222.0.98 () {56 vars in 1112 bytes} [Tue Jul 26 14:57:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:15.656390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadcc3e-3376-41b3-8c9b-3bc64817f2e8 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:15.656868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadcc3e-3376-41b3-8c9b-3bc64817f2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:15.657261 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadcc3e-3376-41b3-8c9b-3bc64817f2e8 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:15.659544 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 482/962] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:15.662870 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadcc3e-3376-41b3-8c9b-3bc64817f2e8 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:15.686850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.sql.core [None req-49c110fa-d1f1-4f13-b29d-3781b4eb2ade None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 14:57:15.686850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 14:57:15.686850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [parameters: {'user_id': 'bd97ce672fa94a29b89d80df7785fd73', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 14:57:15.686850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80488) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 14:57:15.694412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-49c110fa-d1f1-4f13-b29d-3781b4eb2ade None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 14:57:15.694412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:15.694412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:57:15.694412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:57:15.694412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:57:15.694412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:57:15.694412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:57:15.694412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:57:15.694412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:57:15.694412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:57:15.694412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:57:15.694412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:57:15.694412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:57:15.694412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result.read() Jul 26 14:57:15.694412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:57:15.698588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application yield resource Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise self.value Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application session.commit() Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 14:57:15.700445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.session.flush() Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application compat.raise_( Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 14:57:15.702150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:57:15.705355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result.read() Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:57:15.708792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:57:15.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:57:15.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:57:15.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:57:15.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:57:15.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 14:57:15.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 14:57:15.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bd97ce672fa94a29b89d80df7785fd73', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 14:57:15.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 14:57:15.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:15.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:15.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:15.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:15.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:15.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:15.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 26 14:57:15.714535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 26 14:57:15.717601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 26 14:57:15.717601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 26 14:57:15.717601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 14:57:15.717601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 14:57:15.717601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 14:57:15.717601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:15.717601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 481/963] 10.222.0.98 () {60 vars in 1131 bytes} [Tue Jul 26 14:57:15 2022] POST /identity/v3/users => generated 160 bytes in 414 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:15.717601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146edf5d-9aff-4755-9623-62cabcad226f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:15.717601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146edf5d-9aff-4755-9623-62cabcad226f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:15.717601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146edf5d-9aff-4755-9623-62cabcad226f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:15.735414 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-146edf5d-9aff-4755-9623-62cabcad226f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:15.740398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-146edf5d-9aff-4755-9623-62cabcad226f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:15.851291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadcc3e-3376-41b3-8c9b-3bc64817f2e8 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:15.902828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 482/964] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:15.904736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146edf5d-9aff-4755-9623-62cabcad226f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:15.937036 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167b27a-5f12-4ddf-8a2c-4d5d87ad4ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:15.938134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167b27a-5f12-4ddf-8a2c-4d5d87ad4ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:15.938818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167b27a-5f12-4ddf-8a2c-4d5d87ad4ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:15.939363 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167b27a-5f12-4ddf-8a2c-4d5d87ad4ee7 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:15.940691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167b27a-5f12-4ddf-8a2c-4d5d87ad4ee7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:15.941194 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167b27a-5f12-4ddf-8a2c-4d5d87ad4ee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:15.944306 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167b27a-5f12-4ddf-8a2c-4d5d87ad4ee7 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:15.961014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 483/965] 10.222.0.98 () {56 vars in 1112 bytes} [Tue Jul 26 14:57:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:15.961014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167b27a-5f12-4ddf-8a2c-4d5d87ad4ee7 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:16.084054 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:16.091261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:16.115520 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146edf5d-9aff-4755-9623-62cabcad226f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:16.176469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167b27a-5f12-4ddf-8a2c-4d5d87ad4ee7 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:16.192171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08869a-2cc2-4e7f-841e-382310280261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:16.194483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08869a-2cc2-4e7f-841e-382310280261 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:16.195354 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08869a-2cc2-4e7f-841e-382310280261 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:16.196090 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08869a-2cc2-4e7f-841e-382310280261 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:16.212447 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08869a-2cc2-4e7f-841e-382310280261 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:16.214840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08869a-2cc2-4e7f-841e-382310280261 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-9a08869a-2cc2-4e7f-841e-382310280261 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:57:16.243646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:16.245716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:16.248403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:16.248403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:16.248403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:57:16.248403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:57:16.248403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:57:16.248403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:57:16.248403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:57:16.248403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:57:16.248403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:57:16.248403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:16.248403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 483/966] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:57:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:16.253272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08869a-2cc2-4e7f-841e-382310280261 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:16.259337 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fd421-4f10-40a3-9a3f-e4041674fbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:16.260028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fd421-4f10-40a3-9a3f-e4041674fbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:16.260374 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fd421-4f10-40a3-9a3f-e4041674fbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:16.260823 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fd421-4f10-40a3-9a3f-e4041674fbb9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:16.278290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fd421-4f10-40a3-9a3f-e4041674fbb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-4e3fd421-4f10-40a3-9a3f-e4041674fbb9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:57:16.290685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:16.293765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:16.296504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:16.296504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:16.296504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:16.296504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:16.296504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:57:16.296504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:57:16.296504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:57:16.296504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:57:16.296504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:57:16.296504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:57:16.296504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:57:16.296504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:16.296504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 484/967] 10.222.0.98 () {56 vars in 1120 bytes} [Tue Jul 26 14:57:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:16.304332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fd421-4f10-40a3-9a3f-e4041674fbb9 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:16.458680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fd421-4f10-40a3-9a3f-e4041674fbb9 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:16.490222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08869a-2cc2-4e7f-841e-382310280261 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:16.535000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:16.547091 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91f6e9-0309-4d19-9ff6-2d8c7830711c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:16.547517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91f6e9-0309-4d19-9ff6-2d8c7830711c None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:16.547808 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91f6e9-0309-4d19-9ff6-2d8c7830711c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:16.548121 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91f6e9-0309-4d19-9ff6-2d8c7830711c None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:16.549061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91f6e9-0309-4d19-9ff6-2d8c7830711c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:16.551498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91f6e9-0309-4d19-9ff6-2d8c7830711c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:16.551498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91f6e9-0309-4d19-9ff6-2d8c7830711c None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:16.559780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766ad3c-3ba4-4e5e-8453-ebc12e54bdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:16.562785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766ad3c-3ba4-4e5e-8453-ebc12e54bdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:16.563404 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 485/968] 10.222.0.98 () {56 vars in 1115 bytes} [Tue Jul 26 14:57:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:16.567080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766ad3c-3ba4-4e5e-8453-ebc12e54bdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:16.567472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766ad3c-3ba4-4e5e-8453-ebc12e54bdc8 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:16.569399 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766ad3c-3ba4-4e5e-8453-ebc12e54bdc8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:16.569815 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766ad3c-3ba4-4e5e-8453-ebc12e54bdc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:16.571624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766ad3c-3ba4-4e5e-8453-ebc12e54bdc8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:16.576560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91f6e9-0309-4d19-9ff6-2d8c7830711c None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:16.625932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 484/969] 10.222.0.98 () {56 vars in 1101 bytes} [Tue Jul 26 14:57:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:16.805086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91f6e9-0309-4d19-9ff6-2d8c7830711c None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:16.876190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f61d21-f8d6-44ed-a4e0-98e66a80ed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:16.877671 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f61d21-f8d6-44ed-a4e0-98e66a80ed33 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:16.878486 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f61d21-f8d6-44ed-a4e0-98e66a80ed33 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:16.879182 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f61d21-f8d6-44ed-a4e0-98e66a80ed33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:16.903387 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f61d21-f8d6-44ed-a4e0-98e66a80ed33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:16.906549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f61d21-f8d6-44ed-a4e0-98e66a80ed33 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:16.935165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-c2f61d21-f8d6-44ed-a4e0-98e66a80ed33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:16.935165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:16.935165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:16.935165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:16.935165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:16.935165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:16.935165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:16.935165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:16.935165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:16.935165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:16.935165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:16.935165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:16.935165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:57:16.935165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:57:16.935165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:16.936896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:16.938651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:57:16.938651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:57:16.938651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:16.938651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:16.942209 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 486/970] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:16.950270 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766ad3c-3ba4-4e5e-8453-ebc12e54bdc8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:16.976331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:17.105417 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766ad3c-3ba4-4e5e-8453-ebc12e54bdc8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:17.174174 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529e81c-b259-48f3-a1b6-a36bbb30eab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:17.175306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529e81c-b259-48f3-a1b6-a36bbb30eab2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:17.175806 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529e81c-b259-48f3-a1b6-a36bbb30eab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:17.176301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529e81c-b259-48f3-a1b6-a36bbb30eab2 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:17.179660 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529e81c-b259-48f3-a1b6-a36bbb30eab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:17.179660 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529e81c-b259-48f3-a1b6-a36bbb30eab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:17.181712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529e81c-b259-48f3-a1b6-a36bbb30eab2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:17.211880 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 485/971] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:17.213836 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f61d21-f8d6-44ed-a4e0-98e66a80ed33 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:17.283834 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:17.432580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f61d21-f8d6-44ed-a4e0-98e66a80ed33 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:17.516257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25c44a-8c48-467e-873a-9f91c67ab4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:17.516556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25c44a-8c48-467e-873a-9f91c67ab4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:17.516950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25c44a-8c48-467e-873a-9f91c67ab4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:17.517527 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25c44a-8c48-467e-873a-9f91c67ab4f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:17.534712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25c44a-8c48-467e-873a-9f91c67ab4f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:17.537476 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25c44a-8c48-467e-873a-9f91c67ab4f9 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-7c25c44a-8c48-467e-873a-9f91c67ab4f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:57:17.562015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:17.564156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:17.566066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:17.566066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:17.566066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:57:17.566066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:57:17.566066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:57:17.566066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:57:17.566066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:57:17.566066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:57:17.566066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:57:17.566066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:17.566066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 487/972] 10.222.0.98 () {56 vars in 1117 bytes} [Tue Jul 26 14:57:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:17.578182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529e81c-b259-48f3-a1b6-a36bbb30eab2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:17.735820 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:17.802133 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529e81c-b259-48f3-a1b6-a36bbb30eab2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:17.869495 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b55f0-09f6-4795-becd-9e38487160db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:17.870582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b55f0-09f6-4795-becd-9e38487160db None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:17.871100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b55f0-09f6-4795-becd-9e38487160db None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:17.871791 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b55f0-09f6-4795-becd-9e38487160db None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:17.873373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b55f0-09f6-4795-becd-9e38487160db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:17.873929 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b55f0-09f6-4795-becd-9e38487160db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:17.876760 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b55f0-09f6-4795-becd-9e38487160db None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:17.906307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 486/973] 10.222.0.98 () {56 vars in 1149 bytes} [Tue Jul 26 14:57:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:17.913174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25c44a-8c48-467e-873a-9f91c67ab4f9 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:18.060559 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:18.073088 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25c44a-8c48-467e-873a-9f91c67ab4f9 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:18.075151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ffffd-1c30-4e7d-90bb-c39e31e84943 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:18.075926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ffffd-1c30-4e7d-90bb-c39e31e84943 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:18.075926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ffffd-1c30-4e7d-90bb-c39e31e84943 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:18.077498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 487/974] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:18.083501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4030e-f167-4a0e-8d10-dc8116e29fcd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:18.084677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4030e-f167-4a0e-8d10-dc8116e29fcd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:18.085108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4030e-f167-4a0e-8d10-dc8116e29fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:18.107460 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8bc4030e-f167-4a0e-8d10-dc8116e29fcd None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:18.109378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8bc4030e-f167-4a0e-8d10-dc8116e29fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:18.132163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4b973-4f17-418f-8a92-fc96d8b4e7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:18.133220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4b973-4f17-418f-8a92-fc96d8b4e7cf None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:18.133681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4b973-4f17-418f-8a92-fc96d8b4e7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:18.134139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4b973-4f17-418f-8a92-fc96d8b4e7cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:18.231420 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 488/975] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:57:18.236612 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4b973-4f17-418f-8a92-fc96d8b4e7cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:18.238110 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4b973-4f17-418f-8a92-fc96d8b4e7cf None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:18.255616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4030e-f167-4a0e-8d10-dc8116e29fcd None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:18.361927 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:18.379259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:18.388732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 488/976] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:57:17 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:57:18.395415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4b973-4f17-418f-8a92-fc96d8b4e7cf None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:18.424898 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4030e-f167-4a0e-8d10-dc8116e29fcd None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:18.500448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f98fcc-dfe6-41c6-93f2-41fe2e7364d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:18.501481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f98fcc-dfe6-41c6-93f2-41fe2e7364d5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:18.501953 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f98fcc-dfe6-41c6-93f2-41fe2e7364d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:18.502350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f98fcc-dfe6-41c6-93f2-41fe2e7364d5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:18.503470 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f98fcc-dfe6-41c6-93f2-41fe2e7364d5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:18.505337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f98fcc-dfe6-41c6-93f2-41fe2e7364d5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-e4f98fcc-dfe6-41c6-93f2-41fe2e7364d5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:18.521931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:18.524306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:18.525985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:18.525985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:18.525985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:18.525985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:18.525985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:18.525985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:18.525985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:18.525985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:18.525985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:18.525985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:18.525985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:57:18.525985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:18.525985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:57:18.525985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:18.525985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 489/977] 10.222.0.98 () {56 vars in 1126 bytes} [Tue Jul 26 14:57:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:18.530498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f98fcc-dfe6-41c6-93f2-41fe2e7364d5 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:18.583832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4b973-4f17-418f-8a92-fc96d8b4e7cf None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:18.662071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04586f93-3319-482e-b623-c9e33b9aaff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:18.663297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04586f93-3319-482e-b623-c9e33b9aaff0 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:18.663660 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04586f93-3319-482e-b623-c9e33b9aaff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:18.663937 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04586f93-3319-482e-b623-c9e33b9aaff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:18.676617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04586f93-3319-482e-b623-c9e33b9aaff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:18.678761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04586f93-3319-482e-b623-c9e33b9aaff0 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:18.704460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-04586f93-3319-482e-b623-c9e33b9aaff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:18.704460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:18.704460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:18.704460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:18.704460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:18.704460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:18.704460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:18.704460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:18.704460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:18.704460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:18.704460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:18.704460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:18.704460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:57:18.704460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:57:18.704460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:18.706313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:18.709676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:57:18.709676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:57:18.709676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:18.709676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:18.714836 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 489/978] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:18.716753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04586f93-3319-482e-b623-c9e33b9aaff0 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:18.720680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f98fcc-dfe6-41c6-93f2-41fe2e7364d5 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:18.763170 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:18.797788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2617da-0f6a-432a-90ed-4888b5f9ef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:18.798625 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2617da-0f6a-432a-90ed-4888b5f9ef0c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:18.798917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2617da-0f6a-432a-90ed-4888b5f9ef0c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:18.799200 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2617da-0f6a-432a-90ed-4888b5f9ef0c None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:18.799949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2617da-0f6a-432a-90ed-4888b5f9ef0c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:18.800333 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2617da-0f6a-432a-90ed-4888b5f9ef0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:18.801852 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2617da-0f6a-432a-90ed-4888b5f9ef0c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:18.821740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 490/979] 10.222.0.98 () {56 vars in 1122 bytes} [Tue Jul 26 14:57:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:18.823122 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2617da-0f6a-432a-90ed-4888b5f9ef0c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:18.828070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:18.955450 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04586f93-3319-482e-b623-c9e33b9aaff0 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:19.022889 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2617da-0f6a-432a-90ed-4888b5f9ef0c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:19.037786 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48010ef8-d61f-4369-a8fb-438a24211efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:19.037786 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48010ef8-d61f-4369-a8fb-438a24211efd None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:19.038141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48010ef8-d61f-4369-a8fb-438a24211efd None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:19.038610 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48010ef8-d61f-4369-a8fb-438a24211efd None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:19.039976 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48010ef8-d61f-4369-a8fb-438a24211efd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:19.040555 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48010ef8-d61f-4369-a8fb-438a24211efd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:19.043145 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48010ef8-d61f-4369-a8fb-438a24211efd None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:19.066675 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 490/980] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:19.076892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48010ef8-d61f-4369-a8fb-438a24211efd None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:19.098182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fc31f-aa5a-4559-a288-ec85f3313b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:19.099243 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fc31f-aa5a-4559-a288-ec85f3313b1c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:19.099243 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fc31f-aa5a-4559-a288-ec85f3313b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:19.099582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fc31f-aa5a-4559-a288-ec85f3313b1c None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:19.100828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fc31f-aa5a-4559-a288-ec85f3313b1c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:19.101180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fc31f-aa5a-4559-a288-ec85f3313b1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:19.102978 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fc31f-aa5a-4559-a288-ec85f3313b1c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:19.109529 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 491/981] 10.222.0.98 () {56 vars in 1122 bytes} [Tue Jul 26 14:57:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:19.115219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205e4b6-a9ad-46b4-be64-3b7ae966c1bf None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:19.115740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205e4b6-a9ad-46b4-be64-3b7ae966c1bf None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:19.116032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205e4b6-a9ad-46b4-be64-3b7ae966c1bf None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:19.117625 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 492/982] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:57:19.119706 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205e4b6-a9ad-46b4-be64-3b7ae966c1bf None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:19.195995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:19.266152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48010ef8-d61f-4369-a8fb-438a24211efd None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:19.288654 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205e4b6-a9ad-46b4-be64-3b7ae966c1bf None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:19.290898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:19.344796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b21e91-4a0e-4280-b0c6-92cef06041be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:19.345406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0353bb-c23a-4506-92d3-641b522d0ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:19.345707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b21e91-4a0e-4280-b0c6-92cef06041be None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:19.346101 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b21e91-4a0e-4280-b0c6-92cef06041be None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:19.346513 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b21e91-4a0e-4280-b0c6-92cef06041be None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:19.346694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0353bb-c23a-4506-92d3-641b522d0ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:19.347125 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0353bb-c23a-4506-92d3-641b522d0ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:19.347630 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0353bb-c23a-4506-92d3-641b522d0ad5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:19.347792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b21e91-4a0e-4280-b0c6-92cef06041be None admin] RBAC: Adding query filter params (interface=admin, service_id=69535835d4c74e69a0457043fcb06405, region_id=RegionOne) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:19.348138 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b21e91-4a0e-4280-b0c6-92cef06041be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:19.349997 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b21e91-4a0e-4280-b0c6-92cef06041be None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:19.358029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 493/983] 10.222.0.98 () {56 vars in 1249 bytes} [Tue Jul 26 14:57:19 2022] GET /identity/v3/endpoints?service_id=69535835d4c74e69a0457043fcb06405&interface=admin®ion_id=RegionOne => generated 193 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:19.361269 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626520e-7e5d-40d0-94dc-e86f2e0007c6 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:19.361834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626520e-7e5d-40d0-94dc-e86f2e0007c6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:19.362084 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0353bb-c23a-4506-92d3-641b522d0ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:19.362390 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626520e-7e5d-40d0-94dc-e86f2e0007c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:19.364981 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0353bb-c23a-4506-92d3-641b522d0ad5 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:19.389818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-6e0353bb-c23a-4506-92d3-641b522d0ad5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:57:19.389818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:19.389818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:19.389818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:19.389818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:19.389818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:19.389818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:19.389818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:19.389818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:19.389818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:19.389818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:19.389818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:19.389818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:57:19.389818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:57:19.389818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:19.391662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:19.393763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:57:19.393763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:57:19.393763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:57:19.393763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:57:19.393763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:57:19.393763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:57:19.393763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:57:19.393763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:19.395029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2626520e-7e5d-40d0-94dc-e86f2e0007c6 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:19.395029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2626520e-7e5d-40d0-94dc-e86f2e0007c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:19.395393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 491/984] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:57:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:19.395393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0353bb-c23a-4506-92d3-641b522d0ad5 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:19.520703 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 494/985] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:19.522734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626520e-7e5d-40d0-94dc-e86f2e0007c6 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:19.594304 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0353bb-c23a-4506-92d3-641b522d0ad5 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:19.621556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:19.648053 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f357aa9-a85d-4482-8bf1-2d603a5c9909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:19.649135 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f357aa9-a85d-4482-8bf1-2d603a5c9909 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:19.649739 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f357aa9-a85d-4482-8bf1-2d603a5c9909 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:19.650224 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f357aa9-a85d-4482-8bf1-2d603a5c9909 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:19.651531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f357aa9-a85d-4482-8bf1-2d603a5c9909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:19.654305 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f357aa9-a85d-4482-8bf1-2d603a5c9909 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:19.678674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 492/986] 10.222.0.98 () {56 vars in 1087 bytes} [Tue Jul 26 14:57:19 2022] GET /identity/v3/services => generated 1497 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:57:19.678674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f357aa9-a85d-4482-8bf1-2d603a5c9909 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:19.730517 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626520e-7e5d-40d0-94dc-e86f2e0007c6 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:19.760874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:19.796389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eaa9b-09ad-437c-beba-3f4e89a04a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:19.797249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eaa9b-09ad-437c-beba-3f4e89a04a9b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:19.797671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eaa9b-09ad-437c-beba-3f4e89a04a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:19.798135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eaa9b-09ad-437c-beba-3f4e89a04a9b None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:19.799521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eaa9b-09ad-437c-beba-3f4e89a04a9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:19.799988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eaa9b-09ad-437c-beba-3f4e89a04a9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:19.802558 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eaa9b-09ad-437c-beba-3f4e89a04a9b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:19.839060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 495/987] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:57:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:19.841688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eaa9b-09ad-437c-beba-3f4e89a04a9b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:19.915963 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f357aa9-a85d-4482-8bf1-2d603a5c9909 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:19.989192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1afa22-a2ef-4774-b273-a305a8712d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:19.990478 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1afa22-a2ef-4774-b273-a305a8712d8a None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:19.992240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1afa22-a2ef-4774-b273-a305a8712d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:19.992240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1afa22-a2ef-4774-b273-a305a8712d8a None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:19.993626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1afa22-a2ef-4774-b273-a305a8712d8a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:19.996235 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1afa22-a2ef-4774-b273-a305a8712d8a None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:20.023539 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eaa9b-09ad-437c-beba-3f4e89a04a9b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:20.026713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:20.082336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadd958-287c-4094-b12d-7a1faa0fe7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:20.083368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadd958-287c-4094-b12d-7a1faa0fe7bb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:20.083873 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadd958-287c-4094-b12d-7a1faa0fe7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:20.084371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadd958-287c-4094-b12d-7a1faa0fe7bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:20.086333 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadd958-287c-4094-b12d-7a1faa0fe7bb None admin] RBAC: Adding query filter params (role.id=79c75f5a5a5e44df9e723176a6ca33d8, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=3497ed5c5d204d088a178a9560ee83cf) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:20.086919 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadd958-287c-4094-b12d-7a1faa0fe7bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:20.089066 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadd958-287c-4094-b12d-7a1faa0fe7bb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:20.098916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 496/988] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:57:19 2022] GET /identity/v3/role_assignments?user.id=3497ed5c5d204d088a178a9560ee83cf&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=79c75f5a5a5e44df9e723176a6ca33d8 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:20.126059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 493/989] 10.222.0.98 () {60 vars in 1141 bytes} [Tue Jul 26 14:57:19 2022] POST /identity/v3/services => generated 242 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:57:22.668476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543c007-2aad-40ea-aa6e-164cc66684e9 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:22.669269 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543c007-2aad-40ea-aa6e-164cc66684e9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:22.669406 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543c007-2aad-40ea-aa6e-164cc66684e9 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:22.671711 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 497/990] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:22.678338 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ba458-543c-4043-a4f0-d71cb6da91e0 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:22.679694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ba458-543c-4043-a4f0-d71cb6da91e0 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:22.680038 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ba458-543c-4043-a4f0-d71cb6da91e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:22.703806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-f69ba458-543c-4043-a4f0-d71cb6da91e0 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:22.705341 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f69ba458-543c-4043-a4f0-d71cb6da91e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:22.866906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 494/991] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:57:22.907299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543c007-2aad-40ea-aa6e-164cc66684e9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:22.967791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc8565-597d-43ef-ac33-06882ad7053e None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:22.968236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc8565-597d-43ef-ac33-06882ad7053e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:22.968711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc8565-597d-43ef-ac33-06882ad7053e None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:22.971206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 495/992] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:57:22.977935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb8cbe-3f08-47cd-9df7-0c58805213af None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:22.978391 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb8cbe-3f08-47cd-9df7-0c58805213af None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:22.978873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb8cbe-3f08-47cd-9df7-0c58805213af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:23.010259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-dabb8cbe-3f08-47cd-9df7-0c58805213af None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:23.013282 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-dabb8cbe-3f08-47cd-9df7-0c58805213af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:23.042198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:23.153271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543c007-2aad-40ea-aa6e-164cc66684e9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:23.155686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 496/993] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:57:23.199367 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb8cbe-3f08-47cd-9df7-0c58805213af None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:23.216949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42176bcd-e47d-4122-8dbb-557ed4122669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:23.217720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42176bcd-e47d-4122-8dbb-557ed4122669 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:23.218078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42176bcd-e47d-4122-8dbb-557ed4122669 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:23.218410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42176bcd-e47d-4122-8dbb-557ed4122669 None admin] PATH_INFO: `/v3/services/image` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:23.219408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42176bcd-e47d-4122-8dbb-557ed4122669 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:23.221588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42176bcd-e47d-4122-8dbb-557ed4122669 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-42176bcd-e47d-4122-8dbb-557ed4122669 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:23.235752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:23.237908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:23.239632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:23.239632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:23.239632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:23.239632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:23.239632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:23.239632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:23.239632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:23.239632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:23.239632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:23.239632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:23.239632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:57:23.239632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:23.239632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:57:23.239632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:23.239632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 498/994] 10.222.0.98 () {56 vars in 1105 bytes} [Tue Jul 26 14:57:22 2022] GET /identity/v3/services/image => generated 86 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:23.250461 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42176bcd-e47d-4122-8dbb-557ed4122669 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:23.316597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:23.469730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42176bcd-e47d-4122-8dbb-557ed4122669 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:23.469951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb8cbe-3f08-47cd-9df7-0c58805213af None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:23.549075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835bf00-928a-45a3-85ed-ea018cc5f1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:23.549730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835bf00-928a-45a3-85ed-ea018cc5f1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:23.550080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835bf00-928a-45a3-85ed-ea018cc5f1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:23.550498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835bf00-928a-45a3-85ed-ea018cc5f1f6 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:23.551345 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835bf00-928a-45a3-85ed-ea018cc5f1f6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:23.551832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835bf00-928a-45a3-85ed-ea018cc5f1f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:23.555668 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835bf00-928a-45a3-85ed-ea018cc5f1f6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:23.555893 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750e6af-b4fa-4d58-a8c0-3b0c1031eb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:23.555893 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750e6af-b4fa-4d58-a8c0-3b0c1031eb29 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:23.556099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750e6af-b4fa-4d58-a8c0-3b0c1031eb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:23.556572 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750e6af-b4fa-4d58-a8c0-3b0c1031eb29 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:23.557776 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750e6af-b4fa-4d58-a8c0-3b0c1031eb29 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:23.560512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750e6af-b4fa-4d58-a8c0-3b0c1031eb29 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:23.562611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 499/995] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:23.568846 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835bf00-928a-45a3-85ed-ea018cc5f1f6 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-a750e6af-b4fa-4d58-a8c0-3b0c1031eb29 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:23.584009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:23.586289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:23.588468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:23.588468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:23.588468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:23.588468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:23.588468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:23.588468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:23.588468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:23.588468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:23.588468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:23.588468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:23.588468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:57:23.588468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:23.588468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:57:23.588468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:23.590286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 497/996] 10.222.0.98 () {56 vars in 1126 bytes} [Tue Jul 26 14:57:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:23.598089 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750e6af-b4fa-4d58-a8c0-3b0c1031eb29 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:23.627181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:23.737249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:23.746713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835bf00-928a-45a3-85ed-ea018cc5f1f6 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:23.788560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750e6af-b4fa-4d58-a8c0-3b0c1031eb29 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:23.810804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213091e-e242-4f05-9b25-02fe898d2e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:23.811801 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213091e-e242-4f05-9b25-02fe898d2e51 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:23.812271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213091e-e242-4f05-9b25-02fe898d2e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:23.812735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213091e-e242-4f05-9b25-02fe898d2e51 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:23.813967 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213091e-e242-4f05-9b25-02fe898d2e51 None admin] RBAC: Adding query filter params (type=image) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:23.814537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213091e-e242-4f05-9b25-02fe898d2e51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:23.817026 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213091e-e242-4f05-9b25-02fe898d2e51 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:23.825766 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 500/997] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:23.827969 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556c86e-368a-459a-9289-c31abd020930 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:23.828418 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556c86e-368a-459a-9289-c31abd020930 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:23.828944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556c86e-368a-459a-9289-c31abd020930 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:23.831694 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 501/998] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:23.841035 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f95b3-204e-4afe-8c7e-266322655ac7 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:23.841514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f95b3-204e-4afe-8c7e-266322655ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:23.841966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f95b3-204e-4afe-8c7e-266322655ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:23.856650 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fb378-5a8c-4cb1-8de4-196c0f77f6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:23.858575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fb378-5a8c-4cb1-8de4-196c0f77f6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:23.858575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fb378-5a8c-4cb1-8de4-196c0f77f6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:23.858575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fb378-5a8c-4cb1-8de4-196c0f77f6e0 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:23.859242 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fb378-5a8c-4cb1-8de4-196c0f77f6e0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:23.859698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fb378-5a8c-4cb1-8de4-196c0f77f6e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:23.861699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fb378-5a8c-4cb1-8de4-196c0f77f6e0 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:23.871284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 498/999] 10.222.0.98 () {56 vars in 1122 bytes} [Tue Jul 26 14:57:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:23.876820 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1a2f95b3-204e-4afe-8c7e-266322655ac7 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:23.877650 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fb378-5a8c-4cb1-8de4-196c0f77f6e0 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:23.879187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1a2f95b3-204e-4afe-8c7e-266322655ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:24.047646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 502/1000] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:57:24.052101 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:24.091727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f95b3-204e-4afe-8c7e-266322655ac7 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:24.123331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fb378-5a8c-4cb1-8de4-196c0f77f6e0 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:24.192377 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea85d9-3b8a-41e3-a2ac-c03a0c08215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:24.193220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea85d9-3b8a-41e3-a2ac-c03a0c08215e None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:24.193588 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea85d9-3b8a-41e3-a2ac-c03a0c08215e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:24.193870 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea85d9-3b8a-41e3-a2ac-c03a0c08215e None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:24.194836 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea85d9-3b8a-41e3-a2ac-c03a0c08215e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:24.195901 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea85d9-3b8a-41e3-a2ac-c03a0c08215e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:24.197687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea85d9-3b8a-41e3-a2ac-c03a0c08215e None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:24.211153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 499/1001] 10.222.0.98 () {56 vars in 1122 bytes} [Tue Jul 26 14:57:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:24.214012 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea85d9-3b8a-41e3-a2ac-c03a0c08215e None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:24.314192 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:24.334756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f95b3-204e-4afe-8c7e-266322655ac7 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:24.418667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c6455-b4c2-48bf-ac1d-88bee48eeee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:24.419951 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c6455-b4c2-48bf-ac1d-88bee48eeee6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:24.420179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c6455-b4c2-48bf-ac1d-88bee48eeee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:24.421300 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c6455-b4c2-48bf-ac1d-88bee48eeee6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:24.422650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c6455-b4c2-48bf-ac1d-88bee48eeee6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:24.426214 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c6455-b4c2-48bf-ac1d-88bee48eeee6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-264c6455-b4c2-48bf-ac1d-88bee48eeee6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:24.444404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:24.446895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:24.448628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:24.448628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:24.448628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:24.448628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:24.448628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:24.448628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:24.448628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:24.448628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:24.448628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:24.448628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:24.448628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:57:24.448628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:24.448628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:57:24.448628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:24.452451 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea85d9-3b8a-41e3-a2ac-c03a0c08215e None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:24.453058 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 503/1002] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:57:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:24.453058 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c6455-b4c2-48bf-ac1d-88bee48eeee6 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:24.530511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18825132-fab5-4d64-9530-476ae304aac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:24.531777 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18825132-fab5-4d64-9530-476ae304aac7 None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:24.532293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18825132-fab5-4d64-9530-476ae304aac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:24.532799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18825132-fab5-4d64-9530-476ae304aac7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:24.534156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18825132-fab5-4d64-9530-476ae304aac7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:24.536897 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18825132-fab5-4d64-9530-476ae304aac7 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:24.631641 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c6455-b4c2-48bf-ac1d-88bee48eeee6 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:24.656446 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:24.664695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 500/1003] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 14:57:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:57:24.714769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f96247-e3bf-4d81-9b61-6ec21d2ac3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:24.715764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f96247-e3bf-4d81-9b61-6ec21d2ac3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:24.716239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f96247-e3bf-4d81-9b61-6ec21d2ac3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:24.716639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f96247-e3bf-4d81-9b61-6ec21d2ac3c4 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:24.717712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f96247-e3bf-4d81-9b61-6ec21d2ac3c4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:24.718175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f96247-e3bf-4d81-9b61-6ec21d2ac3c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:24.720687 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f96247-e3bf-4d81-9b61-6ec21d2ac3c4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:24.733569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 504/1004] 10.222.0.98 () {56 vars in 1112 bytes} [Tue Jul 26 14:57:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:24.743692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18825132-fab5-4d64-9530-476ae304aac7 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:24.951665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18825132-fab5-4d64-9530-476ae304aac7 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:25.021612 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a00c6-52b1-42f8-a7a3-91036593f0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:25.022684 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a00c6-52b1-42f8-a7a3-91036593f0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:25.023953 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a00c6-52b1-42f8-a7a3-91036593f0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:25.024433 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a00c6-52b1-42f8-a7a3-91036593f0c6 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:25.025700 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a00c6-52b1-42f8-a7a3-91036593f0c6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:25.026260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a00c6-52b1-42f8-a7a3-91036593f0c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:25.028891 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a00c6-52b1-42f8-a7a3-91036593f0c6 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:25.039282 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 501/1005] 10.222.0.98 () {56 vars in 1112 bytes} [Tue Jul 26 14:57:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:25.048748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f96247-e3bf-4d81-9b61-6ec21d2ac3c4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:25.083302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:25.283645 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f96247-e3bf-4d81-9b61-6ec21d2ac3c4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:25.362530 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af09fd-d9bd-4fa1-93f7-bdb292f52dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:25.363627 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af09fd-d9bd-4fa1-93f7-bdb292f52dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:25.364119 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af09fd-d9bd-4fa1-93f7-bdb292f52dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:25.364623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af09fd-d9bd-4fa1-93f7-bdb292f52dc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:25.366118 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af09fd-d9bd-4fa1-93f7-bdb292f52dc3 None admin] RBAC: Adding query filter params (interface=public, service_id=21e107e438604254912582de3ad343d4, region_id=RegionOne) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:25.366751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af09fd-d9bd-4fa1-93f7-bdb292f52dc3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:25.370571 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af09fd-d9bd-4fa1-93f7-bdb292f52dc3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:25.385311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 505/1006] 10.222.0.98 () {56 vars in 1251 bytes} [Tue Jul 26 14:57:25 2022] GET /identity/v3/endpoints?service_id=21e107e438604254912582de3ad343d4&interface=public®ion_id=RegionOne => generated 194 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:25.394630 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a00c6-52b1-42f8-a7a3-91036593f0c6 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:25.557008 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:25.646384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a00c6-52b1-42f8-a7a3-91036593f0c6 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:25.729615 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa166bb8-bc25-4fac-8ef8-c133edc5c813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:25.730767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa166bb8-bc25-4fac-8ef8-c133edc5c813 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:25.731260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa166bb8-bc25-4fac-8ef8-c133edc5c813 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:25.731738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa166bb8-bc25-4fac-8ef8-c133edc5c813 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:25.732978 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa166bb8-bc25-4fac-8ef8-c133edc5c813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:25.735821 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa166bb8-bc25-4fac-8ef8-c133edc5c813 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:25.750528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 502/1007] 10.222.0.98 () {56 vars in 1087 bytes} [Tue Jul 26 14:57:25 2022] GET /identity/v3/services => generated 1727 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:57:27.017867 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac146887-33ab-477d-8782-1b11732e2e9d None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:27.018738 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac146887-33ab-477d-8782-1b11732e2e9d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:27.019043 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac146887-33ab-477d-8782-1b11732e2e9d None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:27.021706 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 506/1008] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:27.031102 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f2e56-0b26-4070-9010-261f774a5f9b None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:27.031925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f2e56-0b26-4070-9010-261f774a5f9b None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:27.031925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f2e56-0b26-4070-9010-261f774a5f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:27.057615 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-ea8f2e56-0b26-4070-9010-261f774a5f9b None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:27.058937 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ea8f2e56-0b26-4070-9010-261f774a5f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:27.198990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 503/1009] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:27 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:27.237655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac146887-33ab-477d-8782-1b11732e2e9d None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:27.432482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:27.514611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac146887-33ab-477d-8782-1b11732e2e9d None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:27.606529 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb83b4c-4cce-429f-9b19-ac6cc8b56033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:27.608087 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb83b4c-4cce-429f-9b19-ac6cc8b56033 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:27.608301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb83b4c-4cce-429f-9b19-ac6cc8b56033 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:27.608782 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb83b4c-4cce-429f-9b19-ac6cc8b56033 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:27.610130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb83b4c-4cce-429f-9b19-ac6cc8b56033 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:27.612852 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb83b4c-4cce-429f-9b19-ac6cc8b56033 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:27.634806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b45dc2-8d75-4582-a706-15719c3dc6b1 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:27.635104 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b45dc2-8d75-4582-a706-15719c3dc6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:27.635604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b45dc2-8d75-4582-a706-15719c3dc6b1 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:27.638423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 504/1010] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:57:27.645711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0227301-93d5-463c-a94f-ae6bcf93ca11 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:27.646286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0227301-93d5-463c-a94f-ae6bcf93ca11 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:27.646286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0227301-93d5-463c-a94f-ae6bcf93ca11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:27.674301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-e0227301-93d5-463c-a94f-ae6bcf93ca11 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:27.675598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e0227301-93d5-463c-a94f-ae6bcf93ca11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:27.746611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 507/1011] 10.222.0.98 () {60 vars in 1141 bytes} [Tue Jul 26 14:57:27 2022] POST /identity/v3/services => generated 242 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:57:27.798124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:27.876803 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 505/1012] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:27 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:57:27.919214 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb83b4c-4cce-429f-9b19-ac6cc8b56033 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:28.155238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb83b4c-4cce-429f-9b19-ac6cc8b56033 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:28.225438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d86e7-5812-495b-bd48-17b155e6fe6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:28.226705 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d86e7-5812-495b-bd48-17b155e6fe6b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:28.227160 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d86e7-5812-495b-bd48-17b155e6fe6b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:28.227648 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d86e7-5812-495b-bd48-17b155e6fe6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:28.229924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d86e7-5812-495b-bd48-17b155e6fe6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:28.232750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d86e7-5812-495b-bd48-17b155e6fe6b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:28.242472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 508/1013] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:28.246228 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0227301-93d5-463c-a94f-ae6bcf93ca11 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:28.532987 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0227301-93d5-463c-a94f-ae6bcf93ca11 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:28.618885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c446cd1-3e2a-45d5-870b-1be99873452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:28.618885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c446cd1-3e2a-45d5-870b-1be99873452e None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:28.618885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c446cd1-3e2a-45d5-870b-1be99873452e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:28.618885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c446cd1-3e2a-45d5-870b-1be99873452e None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:28.620412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c446cd1-3e2a-45d5-870b-1be99873452e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:28.623753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c446cd1-3e2a-45d5-870b-1be99873452e None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:28.759327 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 506/1014] 10.222.0.98 () {60 vars in 1141 bytes} [Tue Jul 26 14:57:28 2022] POST /identity/v3/projects => generated 311 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:57:29.086075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff55c2-e0e4-4bda-9d72-8b4aa10eeb8a None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:29.086429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff55c2-e0e4-4bda-9d72-8b4aa10eeb8a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:29.086902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff55c2-e0e4-4bda-9d72-8b4aa10eeb8a None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:29.090296 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 509/1015] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:57:29.099563 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a94b4-14e7-4742-b601-22e14ae363ac None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:29.100063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a94b4-14e7-4742-b601-22e14ae363ac None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:29.100548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a94b4-14e7-4742-b601-22e14ae363ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:29.135588 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-f42a94b4-14e7-4742-b601-22e14ae363ac None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:29.137680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f42a94b4-14e7-4742-b601-22e14ae363ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:29.211741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:29.316625 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 507/1016] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:29 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:29.350249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff55c2-e0e4-4bda-9d72-8b4aa10eeb8a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:29.364309 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:29.607412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff55c2-e0e4-4bda-9d72-8b4aa10eeb8a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:29.672733 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb340452-df0e-44c8-8f8d-2d6087f63cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:29.673806 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb340452-df0e-44c8-8f8d-2d6087f63cfc None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:29.674219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb340452-df0e-44c8-8f8d-2d6087f63cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:29.674543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb340452-df0e-44c8-8f8d-2d6087f63cfc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:29.675244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb340452-df0e-44c8-8f8d-2d6087f63cfc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:29.676664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb340452-df0e-44c8-8f8d-2d6087f63cfc None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-fb340452-df0e-44c8-8f8d-2d6087f63cfc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:29.694722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:29.698833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:29.703065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:29.703065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:29.703065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:29.703065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:29.703065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:29.703065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:29.703065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:29.703065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:29.703065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:29.703065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:29.703065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:57:29.703065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:29.703065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:57:29.703065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:29.703065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 510/1017] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:57:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:29.707836 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a94b4-14e7-4742-b601-22e14ae363ac None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:29.893190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a94b4-14e7-4742-b601-22e14ae363ac None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:29.966742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b4fcd-ba3c-4bfa-affe-d5a7ab680639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:29.967570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b4fcd-ba3c-4bfa-affe-d5a7ab680639 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:29.968037 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b4fcd-ba3c-4bfa-affe-d5a7ab680639 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:29.968488 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b4fcd-ba3c-4bfa-affe-d5a7ab680639 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:29.969430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b4fcd-ba3c-4bfa-affe-d5a7ab680639 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:29.969835 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b4fcd-ba3c-4bfa-affe-d5a7ab680639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:29.972062 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b4fcd-ba3c-4bfa-affe-d5a7ab680639 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:29.979794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 508/1018] 10.222.0.98 () {56 vars in 1112 bytes} [Tue Jul 26 14:57:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:29.987728 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb340452-df0e-44c8-8f8d-2d6087f63cfc None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:30.157538 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:30.217778 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb340452-df0e-44c8-8f8d-2d6087f63cfc None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:30.268064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9c946-afd8-4f4a-809a-ac32f6b9cb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:30.268727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9c946-afd8-4f4a-809a-ac32f6b9cb22 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:30.269152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9c946-afd8-4f4a-809a-ac32f6b9cb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:30.269651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9c946-afd8-4f4a-809a-ac32f6b9cb22 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:30.271062 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9c946-afd8-4f4a-809a-ac32f6b9cb22 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:30.271599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9c946-afd8-4f4a-809a-ac32f6b9cb22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:30.274065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9c946-afd8-4f4a-809a-ac32f6b9cb22 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:30.283222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 511/1019] 10.222.0.98 () {56 vars in 1112 bytes} [Tue Jul 26 14:57:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:30.292520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b4fcd-ba3c-4bfa-affe-d5a7ab680639 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:30.330909 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:30.521801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b4fcd-ba3c-4bfa-affe-d5a7ab680639 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:30.602750 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda2113-1c55-4dc3-aa22-ab54448a7cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:30.604096 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda2113-1c55-4dc3-aa22-ab54448a7cc4 None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:30.604470 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda2113-1c55-4dc3-aa22-ab54448a7cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:30.604913 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda2113-1c55-4dc3-aa22-ab54448a7cc4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:30.606288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda2113-1c55-4dc3-aa22-ab54448a7cc4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:30.608991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda2113-1c55-4dc3-aa22-ab54448a7cc4 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:30.718404 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 509/1020] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 14:57:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:57:31.210659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d0ede-6334-4c02-8b99-7a09e3f4d5ba None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:31.211478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d0ede-6334-4c02-8b99-7a09e3f4d5ba None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:31.211611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d0ede-6334-4c02-8b99-7a09e3f4d5ba None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:31.215678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 512/1021] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:31.224590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3e496-c502-42db-b767-03d1da18a195 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:31.225105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3e496-c502-42db-b767-03d1da18a195 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:31.225616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3e496-c502-42db-b767-03d1da18a195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:31.259450 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-acd3e496-c502-42db-b767-03d1da18a195 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:31.262665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-acd3e496-c502-42db-b767-03d1da18a195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:31.447380 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 510/1022] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:31.488667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d0ede-6334-4c02-8b99-7a09e3f4d5ba None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:31.731945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d0ede-6334-4c02-8b99-7a09e3f4d5ba None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:31.821029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe8ecf-7d61-45a6-9a99-deacef90a53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:31.822144 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe8ecf-7d61-45a6-9a99-deacef90a53e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:31.824020 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe8ecf-7d61-45a6-9a99-deacef90a53e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:31.824475 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe8ecf-7d61-45a6-9a99-deacef90a53e None admin] PATH_INFO: `/v3/services/image` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:31.825932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe8ecf-7d61-45a6-9a99-deacef90a53e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:31.828961 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe8ecf-7d61-45a6-9a99-deacef90a53e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:31.832724 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-85fe8ecf-7d61-45a6-9a99-deacef90a53e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:31.847765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:31.852074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:31.854029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:31.854029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:31.854029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:31.854029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:31.854029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:31.854029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:31.854029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:31.854029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:31.854029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:31.854029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:31.854029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:57:31.854029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:31.854029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:57:31.854029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:31.854029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 513/1023] 10.222.0.98 () {56 vars in 1105 bytes} [Tue Jul 26 14:57:31 2022] GET /identity/v3/services/image => generated 86 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:31.861501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3e496-c502-42db-b767-03d1da18a195 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:31.886970 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:32.085547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3e496-c502-42db-b767-03d1da18a195 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:32.155172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb41a69-465a-40af-ad14-0687cd7cddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:32.155831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb41a69-465a-40af-ad14-0687cd7cddfe None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:32.156119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb41a69-465a-40af-ad14-0687cd7cddfe None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:32.156455 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb41a69-465a-40af-ad14-0687cd7cddfe None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:32.157266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb41a69-465a-40af-ad14-0687cd7cddfe None admin] RBAC: Adding query filter params (name=image) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:32.157657 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb41a69-465a-40af-ad14-0687cd7cddfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:32.159196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb41a69-465a-40af-ad14-0687cd7cddfe None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:32.172585 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 511/1024] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:32.175634 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe8ecf-7d61-45a6-9a99-deacef90a53e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:32.374674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0db73-6be1-4fb9-880b-eedc02eeb8dc None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:32.375366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0db73-6be1-4fb9-880b-eedc02eeb8dc None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:32.375883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0db73-6be1-4fb9-880b-eedc02eeb8dc None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:32.379124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 512/1025] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:32.387052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe8ecf-7d61-45a6-9a99-deacef90a53e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:32.387875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1fac8-1096-49a1-b16f-65dbf24a5947 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:32.388115 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1fac8-1096-49a1-b16f-65dbf24a5947 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:32.388326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1fac8-1096-49a1-b16f-65dbf24a5947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:32.426147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-85e1fac8-1096-49a1-b16f-65dbf24a5947 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:32.429154 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-85e1fac8-1096-49a1-b16f-65dbf24a5947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:32.457631 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4053f4-c58b-4f6d-840c-48307ea04338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:32.458282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4053f4-c58b-4f6d-840c-48307ea04338 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:32.458618 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4053f4-c58b-4f6d-840c-48307ea04338 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:32.458898 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4053f4-c58b-4f6d-840c-48307ea04338 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:32.459623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4053f4-c58b-4f6d-840c-48307ea04338 None admin] RBAC: Adding query filter params (type=image) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:32.459932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4053f4-c58b-4f6d-840c-48307ea04338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:32.461466 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4053f4-c58b-4f6d-840c-48307ea04338 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:32.469683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 514/1026] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:32.480979 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4053f4-c58b-4f6d-840c-48307ea04338 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:32.602809 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 513/1027] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:32.610784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:32.630935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1fac8-1096-49a1-b16f-65dbf24a5947 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:32.634469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:32.707015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4053f4-c58b-4f6d-840c-48307ea04338 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:32.801494 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd807d-8998-4b4f-8ad0-24dc15460368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:32.802403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd807d-8998-4b4f-8ad0-24dc15460368 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:32.802858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd807d-8998-4b4f-8ad0-24dc15460368 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:32.803312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd807d-8998-4b4f-8ad0-24dc15460368 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:32.804468 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd807d-8998-4b4f-8ad0-24dc15460368 None admin] RBAC: Adding query filter params (interface=public, service_id=db05464acab64d12a556c12e8dd7d596, region_id=RegionOne) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:32.804956 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd807d-8998-4b4f-8ad0-24dc15460368 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:32.807902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd807d-8998-4b4f-8ad0-24dc15460368 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:32.824249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 515/1028] 10.222.0.98 () {56 vars in 1251 bytes} [Tue Jul 26 14:57:32 2022] GET /identity/v3/endpoints?service_id=db05464acab64d12a556c12e8dd7d596&interface=public®ion_id=RegionOne => generated 194 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:32.826883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd807d-8998-4b4f-8ad0-24dc15460368 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:32.845605 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1fac8-1096-49a1-b16f-65dbf24a5947 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:32.913103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc79ab-8724-4525-910f-5a5e1e5bd1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:32.914878 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc79ab-8724-4525-910f-5a5e1e5bd1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:32.915573 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc79ab-8724-4525-910f-5a5e1e5bd1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:32.916014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc79ab-8724-4525-910f-5a5e1e5bd1c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:32.919421 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc79ab-8724-4525-910f-5a5e1e5bd1c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:32.921069 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc79ab-8724-4525-910f-5a5e1e5bd1c5 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:32.926413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 514/1029] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:32.933288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc79ab-8724-4525-910f-5a5e1e5bd1c5 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:33.048986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd807d-8998-4b4f-8ad0-24dc15460368 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:33.092031 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:33.094913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:33.113913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f9a09-214f-4da4-b138-acda6177103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:33.114963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9a09-214f-4da4-b138-acda6177103c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:33.115422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9a09-214f-4da4-b138-acda6177103c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:33.115879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9a09-214f-4da4-b138-acda6177103c None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:33.117114 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f9a09-214f-4da4-b138-acda6177103c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:33.120350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f9a09-214f-4da4-b138-acda6177103c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:33.133543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 516/1030] 10.222.0.98 () {56 vars in 1087 bytes} [Tue Jul 26 14:57:32 2022] GET /identity/v3/services => generated 1957 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:57:33.157109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc79ab-8724-4525-910f-5a5e1e5bd1c5 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:33.233079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085ddcd-705b-4625-92af-c694eab75752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:33.233998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085ddcd-705b-4625-92af-c694eab75752 None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:33.234540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085ddcd-705b-4625-92af-c694eab75752 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:33.235014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085ddcd-705b-4625-92af-c694eab75752 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:33.236159 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085ddcd-705b-4625-92af-c694eab75752 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:33.238570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085ddcd-705b-4625-92af-c694eab75752 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:33.397902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 515/1031] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:57:32 2022] POST /identity/v3/users => generated 285 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:57:33.990330 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15bebd-178f-4c92-aac9-e7d8cfb512f4 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:33.991178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15bebd-178f-4c92-aac9-e7d8cfb512f4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:33.991613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15bebd-178f-4c92-aac9-e7d8cfb512f4 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:33.994244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 517/1032] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:34.003983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1656d6-b62d-460f-b18e-edc2dff8c26c None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:34.004972 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1656d6-b62d-460f-b18e-edc2dff8c26c None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:34.004972 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1656d6-b62d-460f-b18e-edc2dff8c26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:34.037849 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-0e1656d6-b62d-460f-b18e-edc2dff8c26c None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:34.040120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0e1656d6-b62d-460f-b18e-edc2dff8c26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:34.189759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 516/1033] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:34.216840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15bebd-178f-4c92-aac9-e7d8cfb512f4 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:34.455782 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15bebd-178f-4c92-aac9-e7d8cfb512f4 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:34.550902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fcaf3-4e82-425a-958d-0fd602f2e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:34.552830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fcaf3-4e82-425a-958d-0fd602f2e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:34.553382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fcaf3-4e82-425a-958d-0fd602f2e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:34.553977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fcaf3-4e82-425a-958d-0fd602f2e1c2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:34.578374 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fcaf3-4e82-425a-958d-0fd602f2e1c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-df6fcaf3-4e82-425a-958d-0fd602f2e1c2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:57:34.589696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:34.591622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:34.600183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:34.600183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:34.600183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:34.600183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:34.600183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:57:34.600183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:57:34.600183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:57:34.600183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:57:34.600183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:57:34.600183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:57:34.600183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:57:34.600183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:34.600183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 518/1034] 10.222.0.98 () {56 vars in 1120 bytes} [Tue Jul 26 14:57:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:34.606397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1656d6-b62d-460f-b18e-edc2dff8c26c None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:34.728083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:34.821144 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1656d6-b62d-460f-b18e-edc2dff8c26c None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:34.883211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1935337-7970-4f87-b46a-724eeda76545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:34.884414 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1935337-7970-4f87-b46a-724eeda76545 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:34.884899 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1935337-7970-4f87-b46a-724eeda76545 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:34.885537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1935337-7970-4f87-b46a-724eeda76545 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:34.886888 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1935337-7970-4f87-b46a-724eeda76545 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:34.887370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1935337-7970-4f87-b46a-724eeda76545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:34.889916 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1935337-7970-4f87-b46a-724eeda76545 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:34.913707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 517/1035] 10.222.0.98 () {56 vars in 1115 bytes} [Tue Jul 26 14:57:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:34.916516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fcaf3-4e82-425a-958d-0fd602f2e1c2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:35.036704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:35.136515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fcaf3-4e82-425a-958d-0fd602f2e1c2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:35.203845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f139ff4-7c1f-4112-a4aa-cb2b6e3d8d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:35.205049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f139ff4-7c1f-4112-a4aa-cb2b6e3d8d25 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:35.205455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f139ff4-7c1f-4112-a4aa-cb2b6e3d8d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:35.205871 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f139ff4-7c1f-4112-a4aa-cb2b6e3d8d25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:35.220076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f139ff4-7c1f-4112-a4aa-cb2b6e3d8d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:35.222762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f139ff4-7c1f-4112-a4aa-cb2b6e3d8d25 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:35.250511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-7f139ff4-7c1f-4112-a4aa-cb2b6e3d8d25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:35.250511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:35.250511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:35.250511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:35.250511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:35.250511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:35.250511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:35.250511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:35.250511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:35.250511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:35.250511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:35.250511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:35.250511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:57:35.250511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:57:35.250511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:35.252276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:35.260024 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:57:35.260024 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:57:35.260024 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:35.260024 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:35.260024 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 519/1036] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:35.263914 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1935337-7970-4f87-b46a-724eeda76545 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:35.480831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1935337-7970-4f87-b46a-724eeda76545 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:35.526938 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:35.564604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad7327-6298-44f6-92a4-6cf01d9dda9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:35.565845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad7327-6298-44f6-92a4-6cf01d9dda9a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:35.567642 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad7327-6298-44f6-92a4-6cf01d9dda9a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:35.567642 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad7327-6298-44f6-92a4-6cf01d9dda9a None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:35.567642 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad7327-6298-44f6-92a4-6cf01d9dda9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:35.567642 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad7327-6298-44f6-92a4-6cf01d9dda9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:35.569183 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad7327-6298-44f6-92a4-6cf01d9dda9a None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:35.601552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 518/1037] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:35.610408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f139ff4-7c1f-4112-a4aa-cb2b6e3d8d25 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:35.836611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f139ff4-7c1f-4112-a4aa-cb2b6e3d8d25 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:35.840467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:35.921925 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679f9bd-e718-4c4c-913f-4eb30fb0fd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:35.923078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679f9bd-e718-4c4c-913f-4eb30fb0fd55 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:35.923561 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679f9bd-e718-4c4c-913f-4eb30fb0fd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:35.924043 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679f9bd-e718-4c4c-913f-4eb30fb0fd55 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:35.939353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679f9bd-e718-4c4c-913f-4eb30fb0fd55 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:35.941998 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679f9bd-e718-4c4c-913f-4eb30fb0fd55 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-c679f9bd-e718-4c4c-913f-4eb30fb0fd55 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:57:35.967980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:35.969855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:35.980902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:35.980902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:35.980902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:57:35.980902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:57:35.980902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:57:35.980902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:57:35.980902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:57:35.980902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:57:35.980902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:57:35.980902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:35.980902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 520/1038] 10.222.0.98 () {56 vars in 1093 bytes} [Tue Jul 26 14:57:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:35.985248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad7327-6298-44f6-92a4-6cf01d9dda9a None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:36.221434 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad7327-6298-44f6-92a4-6cf01d9dda9a None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:36.300008 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361e3a1-6e3e-4a23-9b28-b06c9c08c8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:36.301084 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361e3a1-6e3e-4a23-9b28-b06c9c08c8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:36.301572 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361e3a1-6e3e-4a23-9b28-b06c9c08c8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:36.302063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361e3a1-6e3e-4a23-9b28-b06c9c08c8f5 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:36.303729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361e3a1-6e3e-4a23-9b28-b06c9c08c8f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:36.304328 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361e3a1-6e3e-4a23-9b28-b06c9c08c8f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:36.307298 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361e3a1-6e3e-4a23-9b28-b06c9c08c8f5 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:36.346425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 519/1039] 10.222.0.98 () {56 vars in 1133 bytes} [Tue Jul 26 14:57:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:36.356340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679f9bd-e718-4c4c-913f-4eb30fb0fd55 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:36.470755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93a959-39da-4bf8-992e-adde6e2e415d None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:36.471224 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93a959-39da-4bf8-992e-adde6e2e415d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:36.471777 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93a959-39da-4bf8-992e-adde6e2e415d None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:36.473873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 520/1040] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:57:36.480970 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c8c88-d455-4b03-960e-0da0ac44d176 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:36.481440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c8c88-d455-4b03-960e-0da0ac44d176 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:36.481929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c8c88-d455-4b03-960e-0da0ac44d176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:36.522560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-873c8c88-d455-4b03-960e-0da0ac44d176 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:36.524720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-873c8c88-d455-4b03-960e-0da0ac44d176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:36.592989 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:36.595736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679f9bd-e718-4c4c-913f-4eb30fb0fd55 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:36.675394 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 521/1041] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:57:36.677356 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb8305-2a80-4425-adbf-3ef037970efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:36.678597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb8305-2a80-4425-adbf-3ef037970efd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:36.679035 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb8305-2a80-4425-adbf-3ef037970efd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:36.679537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb8305-2a80-4425-adbf-3ef037970efd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:36.706259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b4bec-98de-4fa3-8053-103e520f3064 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:36.706758 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b4bec-98de-4fa3-8053-103e520f3064 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:36.707256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b4bec-98de-4fa3-8053-103e520f3064 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:36.710027 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 522/1042] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:36.716035 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b4bec-98de-4fa3-8053-103e520f3064 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:36.751833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:36.824561 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb8305-2a80-4425-adbf-3ef037970efd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:36.826538 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb8305-2a80-4425-adbf-3ef037970efd None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:36.875129 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b4bec-98de-4fa3-8053-103e520f3064 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:36.935347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca1a42-61e0-4991-81e8-eddd554abab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:36.936271 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca1a42-61e0-4991-81e8-eddd554abab5 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:36.936560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca1a42-61e0-4991-81e8-eddd554abab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:36.936964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca1a42-61e0-4991-81e8-eddd554abab5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:36.937922 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca1a42-61e0-4991-81e8-eddd554abab5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:36.939794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca1a42-61e0-4991-81e8-eddd554abab5 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-8bca1a42-61e0-4991-81e8-eddd554abab5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:36.956829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:36.958331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:36.960169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:36.960169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:36.960169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:36.960169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:36.960169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:36.960169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:36.960169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:36.960169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:36.960169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:36.960169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:36.960169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:57:36.960169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:57:36.960169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:57:36.960169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:36.960169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 523/1043] 10.222.0.98 () {56 vars in 1105 bytes} [Tue Jul 26 14:57:36 2022] GET /identity/v3/services/image => generated 86 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:36.961396 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfea67-24d9-4d4a-a080-6a0034b33199 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:36.961830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfea67-24d9-4d4a-a080-6a0034b33199 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:36.962314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfea67-24d9-4d4a-a080-6a0034b33199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:36.995430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-5ebfea67-24d9-4d4a-a080-6a0034b33199 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:36.998242 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5ebfea67-24d9-4d4a-a080-6a0034b33199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:37.005441 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 521/1044] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:57:36 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:57:37.005441 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb8305-2a80-4425-adbf-3ef037970efd None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:37.044973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:37.110235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:37.115614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 524/1045] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:37.116518 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfea67-24d9-4d4a-a080-6a0034b33199 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:37.184034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb8305-2a80-4425-adbf-3ef037970efd None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:37.239656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceba790-0d90-464e-9fa0-fbd8299755df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:37.240552 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceba790-0d90-464e-9fa0-fbd8299755df None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:37.240914 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceba790-0d90-464e-9fa0-fbd8299755df None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:37.241309 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceba790-0d90-464e-9fa0-fbd8299755df None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:37.242286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceba790-0d90-464e-9fa0-fbd8299755df None admin] RBAC: Adding query filter params (name=image) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:37.242725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceba790-0d90-464e-9fa0-fbd8299755df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:37.244380 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceba790-0d90-464e-9fa0-fbd8299755df None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:37.252429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 522/1046] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:37.253352 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceba790-0d90-464e-9fa0-fbd8299755df None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:37.307773 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfea67-24d9-4d4a-a080-6a0034b33199 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:37.373077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e30440-7eae-4318-a6bd-7593ffcc8bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:37.374499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e30440-7eae-4318-a6bd-7593ffcc8bba None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:37.375006 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e30440-7eae-4318-a6bd-7593ffcc8bba None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:37.375515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e30440-7eae-4318-a6bd-7593ffcc8bba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:37.406013 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e30440-7eae-4318-a6bd-7593ffcc8bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:37.408896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e30440-7eae-4318-a6bd-7593ffcc8bba None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:37.425726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceba790-0d90-464e-9fa0-fbd8299755df None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:37.441141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-e9e30440-7eae-4318-a6bd-7593ffcc8bba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:37.441141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:37.441141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:37.441141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:37.441141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:37.441141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:37.441141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:37.441141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:37.441141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:37.441141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:37.441141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:37.441141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:37.441141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:57:37.441141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:57:37.441141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:37.442339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:37.443515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:57:37.443515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:57:37.443515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:37.443515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:37.443515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 525/1047] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:37.444911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e30440-7eae-4318-a6bd-7593ffcc8bba None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:37.470584 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:37.478008 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:37.486126 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503940aa-27ee-4268-9538-76db5b080743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:37.487211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503940aa-27ee-4268-9538-76db5b080743 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:37.487721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503940aa-27ee-4268-9538-76db5b080743 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:37.489942 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503940aa-27ee-4268-9538-76db5b080743 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:37.505924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503940aa-27ee-4268-9538-76db5b080743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-503940aa-27ee-4268-9538-76db5b080743 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:57:37.513228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:37.514981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:37.516107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:37.516107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:37.516107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:37.516107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:37.516107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:57:37.516107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:57:37.516107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:57:37.516107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:57:37.516107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:57:37.516107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:57:37.516107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:57:37.516107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:37.516107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 523/1048] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:57:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:37.523514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503940aa-27ee-4268-9538-76db5b080743 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:37.644313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e30440-7eae-4318-a6bd-7593ffcc8bba None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:37.691053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503940aa-27ee-4268-9538-76db5b080743 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:37.715952 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7209f-627f-46dc-874a-0d4f7c4d1140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:37.717080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7209f-627f-46dc-874a-0d4f7c4d1140 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:37.717599 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7209f-627f-46dc-874a-0d4f7c4d1140 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:37.718111 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7209f-627f-46dc-874a-0d4f7c4d1140 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:37.719606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7209f-627f-46dc-874a-0d4f7c4d1140 None admin] RBAC: Adding query filter params (type=image) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:37.720140 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7209f-627f-46dc-874a-0d4f7c4d1140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:37.722808 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7209f-627f-46dc-874a-0d4f7c4d1140 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:37.731159 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 526/1049] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:37.732005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7209f-627f-46dc-874a-0d4f7c4d1140 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:37.756638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3d990-d6a4-4323-a945-cabf95e94ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:37.757775 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3d990-d6a4-4323-a945-cabf95e94ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:37.758318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3d990-d6a4-4323-a945-cabf95e94ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:37.758832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3d990-d6a4-4323-a945-cabf95e94ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:37.760197 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3d990-d6a4-4323-a945-cabf95e94ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:37.760711 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3d990-d6a4-4323-a945-cabf95e94ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:37.763954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3d990-d6a4-4323-a945-cabf95e94ab9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:37.786125 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 524/1050] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:37.787127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3d990-d6a4-4323-a945-cabf95e94ab9 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:37.849143 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:37.855212 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:37.879369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7209f-627f-46dc-874a-0d4f7c4d1140 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:37.931271 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dafcc6-e79d-4186-825f-3aaf7fb43ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:37.932266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dafcc6-e79d-4186-825f-3aaf7fb43ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:37.932756 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dafcc6-e79d-4186-825f-3aaf7fb43ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:37.933134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dafcc6-e79d-4186-825f-3aaf7fb43ba3 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:37.934723 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dafcc6-e79d-4186-825f-3aaf7fb43ba3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:37.935091 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dafcc6-e79d-4186-825f-3aaf7fb43ba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:37.936528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dafcc6-e79d-4186-825f-3aaf7fb43ba3 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:37.939196 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3d990-d6a4-4323-a945-cabf95e94ab9 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:37.948654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 527/1051] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:57:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:37.950517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dafcc6-e79d-4186-825f-3aaf7fb43ba3 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:38.003679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2813479-25a4-44a5-bc1d-3f137deadf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:38.004498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2813479-25a4-44a5-bc1d-3f137deadf17 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:38.004922 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2813479-25a4-44a5-bc1d-3f137deadf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:38.005557 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2813479-25a4-44a5-bc1d-3f137deadf17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:38.008000 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2813479-25a4-44a5-bc1d-3f137deadf17 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:38.009684 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2813479-25a4-44a5-bc1d-3f137deadf17 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:38.108474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dafcc6-e79d-4186-825f-3aaf7fb43ba3 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:38.152719 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db337ffb-ed3c-4146-8db5-2772ffa14d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:38.153456 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db337ffb-ed3c-4146-8db5-2772ffa14d49 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:38.153802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db337ffb-ed3c-4146-8db5-2772ffa14d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:38.154121 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db337ffb-ed3c-4146-8db5-2772ffa14d49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:38.162522 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db337ffb-ed3c-4146-8db5-2772ffa14d49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:38.164143 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db337ffb-ed3c-4146-8db5-2772ffa14d49 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:38.167514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:38.180131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-db337ffb-ed3c-4146-8db5-2772ffa14d49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:57:38.180131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:38.180131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:38.180131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:38.180131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:38.180131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:38.180131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:38.180131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:38.180131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:38.180131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:38.180131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:38.180131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:38.180131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:57:38.180131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:57:38.180131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:38.182156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:38.184163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:57:38.184163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:57:38.184163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:57:38.184163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:57:38.184163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:57:38.184163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:57:38.184163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:57:38.184163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:38.184163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 528/1052] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:57:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:38.184163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db337ffb-ed3c-4146-8db5-2772ffa14d49 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:38.194561 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 525/1053] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 14:57:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:57:38.196070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2813479-25a4-44a5-bc1d-3f137deadf17 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:38.400000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db337ffb-ed3c-4146-8db5-2772ffa14d49 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:38.422236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:38.435984 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2813479-25a4-44a5-bc1d-3f137deadf17 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:38.495708 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cfe1f-69d4-471a-a9d8-8972a822cb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:38.497626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cfe1f-69d4-471a-a9d8-8972a822cb40 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:38.499370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cfe1f-69d4-471a-a9d8-8972a822cb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:38.499370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cfe1f-69d4-471a-a9d8-8972a822cb40 None admin] PATH_INFO: `/v3/users/4718f05b975e4bcabd31c2fe9338f39f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:38.510297 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84072f21-8666-4661-80f2-56a7c6048c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:38.511335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84072f21-8666-4661-80f2-56a7c6048c3d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:38.511824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84072f21-8666-4661-80f2-56a7c6048c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:38.512276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84072f21-8666-4661-80f2-56a7c6048c3d None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:38.513559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84072f21-8666-4661-80f2-56a7c6048c3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:38.513938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84072f21-8666-4661-80f2-56a7c6048c3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:38.516627 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84072f21-8666-4661-80f2-56a7c6048c3d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:38.534894 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cfe1f-69d4-471a-a9d8-8972a822cb40 None admin] RBAC: Authorizing `identity:get_user(user_id=4718f05b975e4bcabd31c2fe9338f39f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:38.538608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cfe1f-69d4-471a-a9d8-8972a822cb40 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:38.539532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 526/1054] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:57:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:38.546762 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 529/1055] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:57:38 2022] GET /identity/v3/users/4718f05b975e4bcabd31c2fe9338f39f => generated 285 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:38.550252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84072f21-8666-4661-80f2-56a7c6048c3d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:38.552674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cfe1f-69d4-471a-a9d8-8972a822cb40 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:38.707214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:38.782417 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84072f21-8666-4661-80f2-56a7c6048c3d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:38.809942 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cfe1f-69d4-471a-a9d8-8972a822cb40 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:38.865977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f7703-4173-402a-80a2-a8123d76990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:38.867152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f7703-4173-402a-80a2-a8123d76990d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:38.867152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f7703-4173-402a-80a2-a8123d76990d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:38.867983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f7703-4173-402a-80a2-a8123d76990d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:38.868499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f7703-4173-402a-80a2-a8123d76990d None admin] RBAC: Adding query filter params (role.id=79c75f5a5a5e44df9e723176a6ca33d8, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=a4a6c0e7ca434010980d7cac1800dbe9) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:38.868910 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f7703-4173-402a-80a2-a8123d76990d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:38.870698 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f7703-4173-402a-80a2-a8123d76990d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:38.881792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8186ba-cfc5-4fce-a91d-8c005e6f9aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:38.881792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8186ba-cfc5-4fce-a91d-8c005e6f9aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:38.881792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8186ba-cfc5-4fce-a91d-8c005e6f9aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:38.885234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8186ba-cfc5-4fce-a91d-8c005e6f9aa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:38.893169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 527/1056] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:57:38 2022] GET /identity/v3/role_assignments?user.id=a4a6c0e7ca434010980d7cac1800dbe9&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=79c75f5a5a5e44df9e723176a6ca33d8 => generated 259 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:39.058827 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8186ba-cfc5-4fce-a91d-8c005e6f9aa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:39.061666 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8186ba-cfc5-4fce-a91d-8c005e6f9aa8 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:39.195380 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:39.300069 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 530/1057] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:57:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:57:39.308341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f7703-4173-402a-80a2-a8123d76990d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:39.361660 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:39.518443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f7703-4173-402a-80a2-a8123d76990d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:39.594813 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ea840-261a-4944-a547-4135fd188e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:39.595938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ea840-261a-4944-a547-4135fd188e5e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:39.596393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ea840-261a-4944-a547-4135fd188e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:39.596862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ea840-261a-4944-a547-4135fd188e5e None admin] PATH_INFO: `/v3/projects/b31e543eb0a641989b594b7ff83263e2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:39.599342 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ea840-261a-4944-a547-4135fd188e5e None admin] RBAC: Authorizing `identity:get_project(project_id=b31e543eb0a641989b594b7ff83263e2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:39.602165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ea840-261a-4944-a547-4135fd188e5e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:39.605714 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 528/1058] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:57:39 2022] GET /identity/v3/projects/b31e543eb0a641989b594b7ff83263e2 => generated 311 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:39.616148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8186ba-cfc5-4fce-a91d-8c005e6f9aa8 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:39.826636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8186ba-cfc5-4fce-a91d-8c005e6f9aa8 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:39.893483 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8f389-0cee-40ee-a8aa-392d41b5093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:39.894031 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8f389-0cee-40ee-a8aa-392d41b5093c None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:39.894306 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8f389-0cee-40ee-a8aa-392d41b5093c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:39.894607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8f389-0cee-40ee-a8aa-392d41b5093c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:39.895423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8f389-0cee-40ee-a8aa-392d41b5093c None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=b31e543eb0a641989b594b7ff83263e2, user.id=4718f05b975e4bcabd31c2fe9338f39f) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:39.895738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8f389-0cee-40ee-a8aa-392d41b5093c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:39.897272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8f389-0cee-40ee-a8aa-392d41b5093c None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:39.914488 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 531/1059] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:57:39 2022] GET /identity/v3/role_assignments?user.id=4718f05b975e4bcabd31c2fe9338f39f&scope.project.id=b31e543eb0a641989b594b7ff83263e2&role.id=17054492864541709fda49dbf677a7a2 => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:41.600477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f92f7d-6d0b-46b9-ac5e-8941ef812244 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:41.601346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f92f7d-6d0b-46b9-ac5e-8941ef812244 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:41.601346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f92f7d-6d0b-46b9-ac5e-8941ef812244 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:41.602804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 529/1060] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:57:41.609422 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f32c5-7bbe-47ff-8c0b-5c6a2008bf7e None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:41.610224 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f32c5-7bbe-47ff-8c0b-5c6a2008bf7e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:41.610224 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f32c5-7bbe-47ff-8c0b-5c6a2008bf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:41.620924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4d08b-e2a0-44ea-976c-24f4ecf97154 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:41.621345 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4d08b-e2a0-44ea-976c-24f4ecf97154 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:41.621531 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4d08b-e2a0-44ea-976c-24f4ecf97154 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:41.623532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 530/1061] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:57:41.634546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32411e48-6225-4b0c-b506-e40e75080c66 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:41.635796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32411e48-6225-4b0c-b506-e40e75080c66 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:41.636575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32411e48-6225-4b0c-b506-e40e75080c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:41.641399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-3d3f32c5-7bbe-47ff-8c0b-5c6a2008bf7e None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:41.643499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3d3f32c5-7bbe-47ff-8c0b-5c6a2008bf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:41.672036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-32411e48-6225-4b0c-b506-e40e75080c66 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:41.674313 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-32411e48-6225-4b0c-b506-e40e75080c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:41.675930 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:41.762269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 532/1062] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:41.791706 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f32c5-7bbe-47ff-8c0b-5c6a2008bf7e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:41.802531 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 531/1063] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:57:41.836579 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32411e48-6225-4b0c-b506-e40e75080c66 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:41.882799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:41.973900 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f32c5-7bbe-47ff-8c0b-5c6a2008bf7e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:42.056905 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd0f8e-34c8-4c0e-9b6d-d27d1f19a1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:42.057473 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32411e48-6225-4b0c-b506-e40e75080c66 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:42.057830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd0f8e-34c8-4c0e-9b6d-d27d1f19a1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:42.058281 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd0f8e-34c8-4c0e-9b6d-d27d1f19a1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:42.058764 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd0f8e-34c8-4c0e-9b6d-d27d1f19a1c1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:42.079241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd0f8e-34c8-4c0e-9b6d-d27d1f19a1c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-d2dd0f8e-34c8-4c0e-9b6d-d27d1f19a1c1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:57:42.087993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:42.089946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:42.091514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:42.091514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:42.091514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:42.091514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:42.091514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:57:42.091514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:57:42.091514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:57:42.091514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:57:42.091514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:57:42.091514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:57:42.091514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:57:42.091514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:42.091514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 533/1064] 10.222.0.98 () {56 vars in 1120 bytes} [Tue Jul 26 14:57:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:42.098579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd0f8e-34c8-4c0e-9b6d-d27d1f19a1c1 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:42.130871 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:42.140864 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c625af-e861-478f-b4e6-315a342613ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:42.142219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c625af-e861-478f-b4e6-315a342613ea None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:42.142219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c625af-e861-478f-b4e6-315a342613ea None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:42.143076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c625af-e861-478f-b4e6-315a342613ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:42.268474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c625af-e861-478f-b4e6-315a342613ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:42.271386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c625af-e861-478f-b4e6-315a342613ea None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:42.324269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd0f8e-34c8-4c0e-9b6d-d27d1f19a1c1 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:42.329959 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:42.388283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d779ad1-e0a2-4601-905a-5f5aa87e01ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:42.389586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d779ad1-e0a2-4601-905a-5f5aa87e01ce None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:42.390328 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d779ad1-e0a2-4601-905a-5f5aa87e01ce None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:42.391203 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d779ad1-e0a2-4601-905a-5f5aa87e01ce None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:42.392733 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d779ad1-e0a2-4601-905a-5f5aa87e01ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:42.393701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d779ad1-e0a2-4601-905a-5f5aa87e01ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:42.396440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d779ad1-e0a2-4601-905a-5f5aa87e01ce None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:42.423975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 534/1065] 10.222.0.98 () {56 vars in 1115 bytes} [Tue Jul 26 14:57:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:42.427824 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d779ad1-e0a2-4601-905a-5f5aa87e01ce None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:42.531051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 532/1066] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:57:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:57:42.536424 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c625af-e861-478f-b4e6-315a342613ea None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:42.596704 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:42.652839 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d779ad1-e0a2-4601-905a-5f5aa87e01ce None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:42.715178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a5432-066b-4466-8014-dcb52c572bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:42.716760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a5432-066b-4466-8014-dcb52c572bfa None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:42.717234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a5432-066b-4466-8014-dcb52c572bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:42.717506 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a5432-066b-4466-8014-dcb52c572bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:42.743759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a5432-066b-4466-8014-dcb52c572bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:42.746604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a5432-066b-4466-8014-dcb52c572bfa None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:42.757375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c625af-e861-478f-b4e6-315a342613ea None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:42.778142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-055a5432-066b-4466-8014-dcb52c572bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:42.778142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:42.778142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:42.778142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:42.778142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:42.778142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:42.778142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:42.778142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:42.778142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:42.778142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:42.778142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:42.778142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:42.778142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:57:42.778142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:57:42.778142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:42.779458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:42.780692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:57:42.780692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:57:42.780692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:42.780692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:42.780692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 535/1067] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:42.782908 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42b6ae-0890-4f11-a546-b06b5279b52d None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:42.783458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42b6ae-0890-4f11-a546-b06b5279b52d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:42.783889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42b6ae-0890-4f11-a546-b06b5279b52d None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:42.786795 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 536/1068] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:42.795950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42b6ae-0890-4f11-a546-b06b5279b52d None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:42.809889 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:42.832281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e0ff8-0aa9-4cfc-a827-a47b1d035c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:42.833137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e0ff8-0aa9-4cfc-a827-a47b1d035c30 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:42.833515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e0ff8-0aa9-4cfc-a827-a47b1d035c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:42.833986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e0ff8-0aa9-4cfc-a827-a47b1d035c30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:42.856030 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e0ff8-0aa9-4cfc-a827-a47b1d035c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:42.857930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e0ff8-0aa9-4cfc-a827-a47b1d035c30 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:42.875501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-ee7e0ff8-0aa9-4cfc-a827-a47b1d035c30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:42.875501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:42.875501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:42.875501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:42.875501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:42.875501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:42.875501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:42.875501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:42.875501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:42.875501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:42.875501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:42.875501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:42.875501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:57:42.875501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:57:42.875501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:42.877463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:42.879756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:57:42.879756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:57:42.879756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:42.879756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:42.879756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 533/1069] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:42.879756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb8439-0a1b-446a-a615-2e5c317210bd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:42.879756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb8439-0a1b-446a-a615-2e5c317210bd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:42.879756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb8439-0a1b-446a-a615-2e5c317210bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:42.905928 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b7bb8439-0a1b-446a-a615-2e5c317210bd None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:42.907728 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b7bb8439-0a1b-446a-a615-2e5c317210bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:43.017500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42b6ae-0890-4f11-a546-b06b5279b52d None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:43.020555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 534/1070] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:43.022069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb8439-0a1b-446a-a615-2e5c317210bd None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:43.058026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:43.078871 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca42e6-53b3-4131-99ec-b4c84e2bd4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:43.079692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca42e6-53b3-4131-99ec-b4c84e2bd4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:43.080133 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca42e6-53b3-4131-99ec-b4c84e2bd4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:43.080565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca42e6-53b3-4131-99ec-b4c84e2bd4a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:43.081885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca42e6-53b3-4131-99ec-b4c84e2bd4a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:43.082212 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca42e6-53b3-4131-99ec-b4c84e2bd4a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:43.084063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca42e6-53b3-4131-99ec-b4c84e2bd4a4 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:43.104997 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 537/1071] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:43.106411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca42e6-53b3-4131-99ec-b4c84e2bd4a4 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:43.312747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca42e6-53b3-4131-99ec-b4c84e2bd4a4 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:43.317151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb8439-0a1b-446a-a615-2e5c317210bd None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:43.319357 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:43.378164 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbfe91-d424-4e4f-9d24-e29d6d558415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:43.379156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbfe91-d424-4e4f-9d24-e29d6d558415 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:43.379473 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51099f89-298b-4943-b8aa-a9b04ead8a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:43.379628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbfe91-d424-4e4f-9d24-e29d6d558415 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:43.380006 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbfe91-d424-4e4f-9d24-e29d6d558415 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:43.380539 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51099f89-298b-4943-b8aa-a9b04ead8a13 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:43.381054 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51099f89-298b-4943-b8aa-a9b04ead8a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:43.381547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51099f89-298b-4943-b8aa-a9b04ead8a13 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:43.382939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51099f89-298b-4943-b8aa-a9b04ead8a13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:43.383549 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51099f89-298b-4943-b8aa-a9b04ead8a13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:43.386397 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51099f89-298b-4943-b8aa-a9b04ead8a13 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:43.400462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbfe91-d424-4e4f-9d24-e29d6d558415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:57:43.409191 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 535/1072] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-aafbfe91-d424-4e4f-9d24-e29d6d558415 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:57:43.410967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:43.421512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:43.426549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:43.426549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:43.426549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:43.426549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:43.426549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:57:43.426549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:57:43.426549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:57:43.426549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:57:43.426549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:57:43.426549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:57:43.426549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:57:43.426549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:43.428067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51099f89-298b-4943-b8aa-a9b04ead8a13 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:43.428236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 538/1073] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:57:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:43.428236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbfe91-d424-4e4f-9d24-e29d6d558415 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:43.534610 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:43.647051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51099f89-298b-4943-b8aa-a9b04ead8a13 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:43.673863 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbfe91-d424-4e4f-9d24-e29d6d558415 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:43.736629 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6779dd6-d468-41f6-9d4d-b8de7ac4d77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:43.737806 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6779dd6-d468-41f6-9d4d-b8de7ac4d77a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:43.738310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6779dd6-d468-41f6-9d4d-b8de7ac4d77a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:43.738882 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6779dd6-d468-41f6-9d4d-b8de7ac4d77a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:43.755487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cac6e-fbf5-4e16-b65b-e1a74a8a30eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:43.755780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6779dd6-d468-41f6-9d4d-b8de7ac4d77a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:43.756858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cac6e-fbf5-4e16-b65b-e1a74a8a30eb None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:43.757182 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cac6e-fbf5-4e16-b65b-e1a74a8a30eb None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:43.757485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cac6e-fbf5-4e16-b65b-e1a74a8a30eb None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:43.758478 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cac6e-fbf5-4e16-b65b-e1a74a8a30eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:43.758646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6779dd6-d468-41f6-9d4d-b8de7ac4d77a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:43.759268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cac6e-fbf5-4e16-b65b-e1a74a8a30eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:43.760567 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cac6e-fbf5-4e16-b65b-e1a74a8a30eb None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-a6779dd6-d468-41f6-9d4d-b8de7ac4d77a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:57:43.776405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:43.778389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:43.780994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:43.780994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:43.780994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:57:43.780994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:57:43.780994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:57:43.780994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:57:43.780994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:57:43.780994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:57:43.780994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:57:43.780994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:43.780994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 536/1074] 10.222.0.98 () {56 vars in 1093 bytes} [Tue Jul 26 14:57:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:43.787140 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 539/1075] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:43.788860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6779dd6-d468-41f6-9d4d-b8de7ac4d77a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:43.798572 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cac6e-fbf5-4e16-b65b-e1a74a8a30eb None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:43.835159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:43.980216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6779dd6-d468-41f6-9d4d-b8de7ac4d77a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:43.998412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cac6e-fbf5-4e16-b65b-e1a74a8a30eb None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:44.011937 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:44.037548 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acea8c-0000-4394-8d8b-58a8694a2dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:44.038798 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acea8c-0000-4394-8d8b-58a8694a2dbb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:44.039295 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acea8c-0000-4394-8d8b-58a8694a2dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:44.039727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acea8c-0000-4394-8d8b-58a8694a2dbb None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:44.040795 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acea8c-0000-4394-8d8b-58a8694a2dbb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:44.041112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acea8c-0000-4394-8d8b-58a8694a2dbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:44.042754 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acea8c-0000-4394-8d8b-58a8694a2dbb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:44.059230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950ba2f-58e1-4706-81b7-86db08486648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:44.060640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950ba2f-58e1-4706-81b7-86db08486648 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:44.060926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950ba2f-58e1-4706-81b7-86db08486648 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:44.061205 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950ba2f-58e1-4706-81b7-86db08486648 None admin] PATH_INFO: `/v3/users/4718f05b975e4bcabd31c2fe9338f39f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:44.064250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950ba2f-58e1-4706-81b7-86db08486648 None admin] RBAC: Authorizing `identity:get_user(user_id=4718f05b975e4bcabd31c2fe9338f39f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:44.066033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950ba2f-58e1-4706-81b7-86db08486648 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:44.068057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 540/1076] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:57:43 2022] GET /identity/v3/users/4718f05b975e4bcabd31c2fe9338f39f => generated 285 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:44.075020 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950ba2f-58e1-4706-81b7-86db08486648 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:44.085789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 537/1077] 10.222.0.98 () {56 vars in 1133 bytes} [Tue Jul 26 14:57:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:44.087856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acea8c-0000-4394-8d8b-58a8694a2dbb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:44.253998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950ba2f-58e1-4706-81b7-86db08486648 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:44.267051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:44.299497 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acea8c-0000-4394-8d8b-58a8694a2dbb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:44.318212 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542b90e-575d-4d21-b36e-9f88b8b94620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:44.319279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542b90e-575d-4d21-b36e-9f88b8b94620 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:44.319712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542b90e-575d-4d21-b36e-9f88b8b94620 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:44.320155 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542b90e-575d-4d21-b36e-9f88b8b94620 None admin] PATH_INFO: `/v3/projects/b31e543eb0a641989b594b7ff83263e2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:44.323454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542b90e-575d-4d21-b36e-9f88b8b94620 None admin] RBAC: Authorizing `identity:get_project(project_id=b31e543eb0a641989b594b7ff83263e2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:44.324987 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542b90e-575d-4d21-b36e-9f88b8b94620 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:44.327914 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 541/1078] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:57:44 2022] GET /identity/v3/projects/b31e543eb0a641989b594b7ff83263e2 => generated 311 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:44.337600 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542b90e-575d-4d21-b36e-9f88b8b94620 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:44.380627 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab0fce-522b-4b70-a020-04d6b4ec2945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:44.381741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab0fce-522b-4b70-a020-04d6b4ec2945 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:44.382198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab0fce-522b-4b70-a020-04d6b4ec2945 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:44.382790 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab0fce-522b-4b70-a020-04d6b4ec2945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:44.402438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab0fce-522b-4b70-a020-04d6b4ec2945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:44.405358 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab0fce-522b-4b70-a020-04d6b4ec2945 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:44.430404 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:44.432699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-3dab0fce-522b-4b70-a020-04d6b4ec2945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:44.432699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:44.432699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:44.432699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:44.432699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:44.432699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:44.432699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:44.432699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:44.432699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:44.432699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:44.432699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:44.432699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:44.432699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:57:44.432699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:57:44.432699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:44.434519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:44.435848 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:57:44.435848 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:57:44.435848 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:44.435848 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:44.435848 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 538/1079] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:44.447042 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab0fce-522b-4b70-a020-04d6b4ec2945 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:44.541411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542b90e-575d-4d21-b36e-9f88b8b94620 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:44.615711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b619b17-6a47-4027-8ee7-5325b30f10b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:44.616877 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b619b17-6a47-4027-8ee7-5325b30f10b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:44.617364 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b619b17-6a47-4027-8ee7-5325b30f10b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:44.617863 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b619b17-6a47-4027-8ee7-5325b30f10b1 None admin] PATH_INFO: `/v3/projects/b31e543eb0a641989b594b7ff83263e2/users/4718f05b975e4bcabd31c2fe9338f39f/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:44.621615 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b619b17-6a47-4027-8ee7-5325b30f10b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b31e543eb0a641989b594b7ff83263e2, user_id=4718f05b975e4bcabd31c2fe9338f39f, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:44.625008 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b619b17-6a47-4027-8ee7-5325b30f10b1 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:44.642910 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab0fce-522b-4b70-a020-04d6b4ec2945 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:44.684392 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:44.691453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455660d-a629-49de-9826-6da838d217b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:44.692151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455660d-a629-49de-9826-6da838d217b2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:44.692534 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455660d-a629-49de-9826-6da838d217b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:44.692861 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455660d-a629-49de-9826-6da838d217b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:44.693667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455660d-a629-49de-9826-6da838d217b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:44.694108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455660d-a629-49de-9826-6da838d217b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:44.695891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455660d-a629-49de-9826-6da838d217b2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:44.715280 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 539/1080] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:44.720709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 542/1081] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:57:44 2022] PUT /identity/v3/projects/b31e543eb0a641989b594b7ff83263e2/users/4718f05b975e4bcabd31c2fe9338f39f/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:57:44.724271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455660d-a629-49de-9826-6da838d217b2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:44.920942 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455660d-a629-49de-9826-6da838d217b2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:44.975624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859ddbc-b525-4160-a77f-7f9e49df658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:44.976379 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859ddbc-b525-4160-a77f-7f9e49df658d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:44.976671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859ddbc-b525-4160-a77f-7f9e49df658d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:44.976948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859ddbc-b525-4160-a77f-7f9e49df658d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:44.987595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859ddbc-b525-4160-a77f-7f9e49df658d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:44.989093 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859ddbc-b525-4160-a77f-7f9e49df658d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:45.003465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-1859ddbc-b525-4160-a77f-7f9e49df658d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:57:45.003465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:45.003465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:45.003465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:45.003465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:45.003465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:45.003465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:45.003465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:45.003465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:45.003465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:45.003465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:45.003465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:45.003465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:57:45.003465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:57:45.003465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:45.005452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:45.007444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:57:45.007444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:57:45.007444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:57:45.007444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:57:45.007444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:57:45.007444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:57:45.007444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:57:45.007444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:45.007444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 540/1082] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:57:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:45.015675 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b619b17-6a47-4027-8ee7-5325b30f10b1 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:45.195450 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b619b17-6a47-4027-8ee7-5325b30f10b1 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:45.199609 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:45.248363 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d9b6c-c807-4556-acd7-994b25474b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:45.249345 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d9b6c-c807-4556-acd7-994b25474b4c None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:45.249840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d9b6c-c807-4556-acd7-994b25474b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:45.250220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d9b6c-c807-4556-acd7-994b25474b4c None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:45.251182 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d9b6c-c807-4556-acd7-994b25474b4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:45.251563 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d9b6c-c807-4556-acd7-994b25474b4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:45.253156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d9b6c-c807-4556-acd7-994b25474b4c None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:45.270523 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 543/1083] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:45.281197 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859ddbc-b525-4160-a77f-7f9e49df658d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:45.383749 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:45.481889 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859ddbc-b525-4160-a77f-7f9e49df658d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:45.561942 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01450d4-f384-4560-be9a-7d851ac0c5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:45.563012 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01450d4-f384-4560-be9a-7d851ac0c5b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:45.563437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01450d4-f384-4560-be9a-7d851ac0c5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:45.563849 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01450d4-f384-4560-be9a-7d851ac0c5b7 None admin] PATH_INFO: `/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/a4a6c0e7ca434010980d7cac1800dbe9/roles/79c75f5a5a5e44df9e723176a6ca33d8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:45.568203 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01450d4-f384-4560-be9a-7d851ac0c5b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f750777b75f49a19a5019c4fc2c00f5, user_id=a4a6c0e7ca434010980d7cac1800dbe9, role_id=79c75f5a5a5e44df9e723176a6ca33d8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:45.571193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01450d4-f384-4560-be9a-7d851ac0c5b7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:45.714994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 541/1084] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:57:45 2022] PUT /identity/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/a4a6c0e7ca434010980d7cac1800dbe9/roles/79c75f5a5a5e44df9e723176a6ca33d8 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:57:47.494343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89cfd9-25f1-4e0d-8e80-887126c85cc9 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:47.495230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89cfd9-25f1-4e0d-8e80-887126c85cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:47.495230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89cfd9-25f1-4e0d-8e80-887126c85cc9 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:47.497172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 544/1085] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:47.505688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc03fb-43fe-46fa-92cd-89c6804e3d23 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:47.506478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc03fb-43fe-46fa-92cd-89c6804e3d23 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:47.506831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc03fb-43fe-46fa-92cd-89c6804e3d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:47.541060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-befc03fb-43fe-46fa-92cd-89c6804e3d23 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:47.543286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-befc03fb-43fe-46fa-92cd-89c6804e3d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:47.639482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 542/1086] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:47.665408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89cfd9-25f1-4e0d-8e80-887126c85cc9 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:47.811503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89cfd9-25f1-4e0d-8e80-887126c85cc9 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:47.856755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c830d-f469-44a0-82c1-0db55759733d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:47.857011 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c830d-f469-44a0-82c1-0db55759733d None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:47.857218 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c830d-f469-44a0-82c1-0db55759733d None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:47.857495 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c830d-f469-44a0-82c1-0db55759733d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:47.871149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c830d-f469-44a0-82c1-0db55759733d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-c60c830d-f469-44a0-82c1-0db55759733d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:57:47.876755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:47.878844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:47.879798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:47.879798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:47.879798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:47.879798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:47.879798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:57:47.879798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:57:47.879798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:57:47.879798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:57:47.879798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:57:47.879798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:57:47.879798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:57:47.879798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:47.879798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 545/1087] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:57:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:47.886956 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc03fb-43fe-46fa-92cd-89c6804e3d23 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:47.944397 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:48.033013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc03fb-43fe-46fa-92cd-89c6804e3d23 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:48.086161 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627c38e-5f4a-481d-a1d8-0f5aa0dad824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:48.086915 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c38e-5f4a-481d-a1d8-0f5aa0dad824 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:48.087103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c38e-5f4a-481d-a1d8-0f5aa0dad824 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:48.087453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c38e-5f4a-481d-a1d8-0f5aa0dad824 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:48.088445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627c38e-5f4a-481d-a1d8-0f5aa0dad824 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:48.088804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627c38e-5f4a-481d-a1d8-0f5aa0dad824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:48.090857 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627c38e-5f4a-481d-a1d8-0f5aa0dad824 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:48.108932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 543/1088] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:57:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:48.120357 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c830d-f469-44a0-82c1-0db55759733d None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:48.163325 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:48.270032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c830d-f469-44a0-82c1-0db55759733d None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:48.319026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c18fae-fa89-4eb9-bd1b-8f360840e293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:48.319734 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c18fae-fa89-4eb9-bd1b-8f360840e293 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:48.320031 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c18fae-fa89-4eb9-bd1b-8f360840e293 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:48.320324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c18fae-fa89-4eb9-bd1b-8f360840e293 None admin] PATH_INFO: `/v3/users/4718f05b975e4bcabd31c2fe9338f39f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:48.321796 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c18fae-fa89-4eb9-bd1b-8f360840e293 None admin] RBAC: Authorizing `identity:get_user(user_id=4718f05b975e4bcabd31c2fe9338f39f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:48.323461 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c18fae-fa89-4eb9-bd1b-8f360840e293 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:48.325946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 546/1089] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:57:48 2022] GET /identity/v3/users/4718f05b975e4bcabd31c2fe9338f39f => generated 285 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:48.335756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627c38e-5f4a-481d-a1d8-0f5aa0dad824 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:48.387033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5daaf4-dc63-4521-b10a-84a178471f37 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:48.387438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5daaf4-dc63-4521-b10a-84a178471f37 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:48.387644 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5daaf4-dc63-4521-b10a-84a178471f37 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:48.389922 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 547/1090] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:57:48.397202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f535a-e0b7-4a39-9db3-4eb6b1bfd3fd None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:48.397772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f535a-e0b7-4a39-9db3-4eb6b1bfd3fd None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:48.398204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f535a-e0b7-4a39-9db3-4eb6b1bfd3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:48.431174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-db1f535a-e0b7-4a39-9db3-4eb6b1bfd3fd None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:48.433149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-db1f535a-e0b7-4a39-9db3-4eb6b1bfd3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:48.506015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627c38e-5f4a-481d-a1d8-0f5aa0dad824 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:48.515354 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:48.567044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 548/1091] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:48.575006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab3868-2129-47d0-89a8-e32b72c800ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:48.576090 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab3868-2129-47d0-89a8-e32b72c800ae None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:48.576777 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab3868-2129-47d0-89a8-e32b72c800ae None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:48.578317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab3868-2129-47d0-89a8-e32b72c800ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:48.611522 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f535a-e0b7-4a39-9db3-4eb6b1bfd3fd None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:48.649609 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:48.718303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab3868-2129-47d0-89a8-e32b72c800ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:48.721148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab3868-2129-47d0-89a8-e32b72c800ae None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:48.739673 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f535a-e0b7-4a39-9db3-4eb6b1bfd3fd None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:48.778832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659ddee-408d-4042-9fdc-ab12fa47918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:48.779504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659ddee-408d-4042-9fdc-ab12fa47918c None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:48.779946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659ddee-408d-4042-9fdc-ab12fa47918c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:48.780332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659ddee-408d-4042-9fdc-ab12fa47918c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:48.794470 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659ddee-408d-4042-9fdc-ab12fa47918c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-c659ddee-408d-4042-9fdc-ab12fa47918c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:57:48.800510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:48.801711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:48.803219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:48.803219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:48.803219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:48.803219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:48.803219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:57:48.803219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:57:48.803219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:57:48.803219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:57:48.803219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:57:48.803219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:57:48.803219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:57:48.803219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:48.803219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 549/1092] 10.222.0.98 () {56 vars in 1120 bytes} [Tue Jul 26 14:57:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:48.808143 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659ddee-408d-4042-9fdc-ab12fa47918c None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:48.885001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 544/1093] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:57:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:57:48.892477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab3868-2129-47d0-89a8-e32b72c800ae None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:48.897011 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:48.920730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:48.940927 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659ddee-408d-4042-9fdc-ab12fa47918c None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:48.983525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7859aa8-1634-4357-b70b-797c571693ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:48.984174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7859aa8-1634-4357-b70b-797c571693ca None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:48.984456 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7859aa8-1634-4357-b70b-797c571693ca None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:48.984739 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7859aa8-1634-4357-b70b-797c571693ca None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:48.985516 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7859aa8-1634-4357-b70b-797c571693ca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:48.985818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7859aa8-1634-4357-b70b-797c571693ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:48.987312 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7859aa8-1634-4357-b70b-797c571693ca None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:48.997628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 550/1094] 10.222.0.98 () {56 vars in 1115 bytes} [Tue Jul 26 14:57:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:49.004579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7859aa8-1634-4357-b70b-797c571693ca None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:49.017694 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab3868-2129-47d0-89a8-e32b72c800ae None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:49.064242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f36ed4-7164-4c04-89fe-fab7e19f9288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:49.065048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f36ed4-7164-4c04-89fe-fab7e19f9288 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:49.065517 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f36ed4-7164-4c04-89fe-fab7e19f9288 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:49.065990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f36ed4-7164-4c04-89fe-fab7e19f9288 None admin] PATH_INFO: `/v3/projects/b31e543eb0a641989b594b7ff83263e2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:49.068001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f36ed4-7164-4c04-89fe-fab7e19f9288 None admin] RBAC: Authorizing `identity:get_project(project_id=b31e543eb0a641989b594b7ff83263e2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:49.069945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f36ed4-7164-4c04-89fe-fab7e19f9288 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:49.072196 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 545/1095] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:57:48 2022] GET /identity/v3/projects/b31e543eb0a641989b594b7ff83263e2 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:49.080704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f36ed4-7164-4c04-89fe-fab7e19f9288 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:49.154521 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7859aa8-1634-4357-b70b-797c571693ca None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:49.213188 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:49.214792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93ebc1-186c-43af-8beb-97d5d1a04653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:49.215682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93ebc1-186c-43af-8beb-97d5d1a04653 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:49.216060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93ebc1-186c-43af-8beb-97d5d1a04653 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:49.216481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93ebc1-186c-43af-8beb-97d5d1a04653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:49.229648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93ebc1-186c-43af-8beb-97d5d1a04653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:49.231180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93ebc1-186c-43af-8beb-97d5d1a04653 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:49.234913 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:49.249667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-4b93ebc1-186c-43af-8beb-97d5d1a04653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:49.249667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:49.249667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:49.249667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:49.249667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:49.249667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:49.249667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:49.249667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:49.249667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:49.249667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:49.249667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:49.249667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:49.249667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:57:49.249667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:57:49.249667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:49.251701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:49.253549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:57:49.253549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:57:49.253549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:49.253549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:49.253549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 551/1096] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:49.254087 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f36ed4-7164-4c04-89fe-fab7e19f9288 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:49.257595 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93ebc1-186c-43af-8beb-97d5d1a04653 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:49.318795 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07660d6e-cf93-4dfa-8a6f-9f633022c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:49.319783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07660d6e-cf93-4dfa-8a6f-9f633022c6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:49.320269 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07660d6e-cf93-4dfa-8a6f-9f633022c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:49.320768 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07660d6e-cf93-4dfa-8a6f-9f633022c6f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:49.322336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07660d6e-cf93-4dfa-8a6f-9f633022c6f9 None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=b31e543eb0a641989b594b7ff83263e2, user.id=4718f05b975e4bcabd31c2fe9338f39f) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:49.322915 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07660d6e-cf93-4dfa-8a6f-9f633022c6f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:49.326074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07660d6e-cf93-4dfa-8a6f-9f633022c6f9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:49.338122 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 546/1097] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:57:49 2022] GET /identity/v3/role_assignments?user.id=4718f05b975e4bcabd31c2fe9338f39f&scope.project.id=b31e543eb0a641989b594b7ff83263e2&role.id=17054492864541709fda49dbf677a7a2 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:49.388314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93ebc1-186c-43af-8beb-97d5d1a04653 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:49.439674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd570e-4d76-4431-932a-868daefda555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:49.440500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd570e-4d76-4431-932a-868daefda555 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:49.440836 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd570e-4d76-4431-932a-868daefda555 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:49.441177 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd570e-4d76-4431-932a-868daefda555 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:49.442044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd570e-4d76-4431-932a-868daefda555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:49.442445 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd570e-4d76-4431-932a-868daefda555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:49.444166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd570e-4d76-4431-932a-868daefda555 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:49.459919 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 552/1098] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:49.466833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07660d6e-cf93-4dfa-8a6f-9f633022c6f9 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:49.660315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07660d6e-cf93-4dfa-8a6f-9f633022c6f9 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:49.726934 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1e2e6-31d0-473c-9460-86a372d3633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:49.727633 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1e2e6-31d0-473c-9460-86a372d3633d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:49.727947 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1e2e6-31d0-473c-9460-86a372d3633d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:49.728224 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1e2e6-31d0-473c-9460-86a372d3633d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:49.731868 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:49.739473 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1e2e6-31d0-473c-9460-86a372d3633d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:49.753596 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1e2e6-31d0-473c-9460-86a372d3633d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-58e1e2e6-31d0-473c-9460-86a372d3633d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:57:49.754029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:49.755152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:49.756522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:49.756522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:49.756522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:57:49.756522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:57:49.756522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:57:49.756522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:57:49.756522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:57:49.756522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:57:49.756522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:57:49.756522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:57:49.756522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 547/1099] 10.222.0.98 () {56 vars in 1093 bytes} [Tue Jul 26 14:57:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:57:49.761251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd570e-4d76-4431-932a-868daefda555 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:49.836153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:49.895426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd570e-4d76-4431-932a-868daefda555 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:49.937561 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1929e19-42e9-4c02-8036-a3ea3c33b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:49.938300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1929e19-42e9-4c02-8036-a3ea3c33b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:49.938687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1929e19-42e9-4c02-8036-a3ea3c33b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:49.939027 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1929e19-42e9-4c02-8036-a3ea3c33b4e4 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:49.939956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1929e19-42e9-4c02-8036-a3ea3c33b4e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:49.940410 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1929e19-42e9-4c02-8036-a3ea3c33b4e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:49.942318 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1929e19-42e9-4c02-8036-a3ea3c33b4e4 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:49.963569 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 553/1100] 10.222.0.98 () {56 vars in 1133 bytes} [Tue Jul 26 14:57:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:49.970565 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1e2e6-31d0-473c-9460-86a372d3633d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:50.105347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1e2e6-31d0-473c-9460-86a372d3633d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:50.149599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93487c04-67ec-4750-9e99-038f1c26dcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:50.150264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93487c04-67ec-4750-9e99-038f1c26dcdd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:50.150574 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93487c04-67ec-4750-9e99-038f1c26dcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:50.150853 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93487c04-67ec-4750-9e99-038f1c26dcdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:50.260288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:50.269178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93487c04-67ec-4750-9e99-038f1c26dcdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:50.271572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93487c04-67ec-4750-9e99-038f1c26dcdd None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:50.478776 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 548/1101] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:57:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:57:50.487885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1929e19-42e9-4c02-8036-a3ea3c33b4e4 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:50.651081 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1929e19-42e9-4c02-8036-a3ea3c33b4e4 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:50.672738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:50.700162 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce4fe1-0060-4d7c-90bc-c73b18a7f37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:50.700827 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce4fe1-0060-4d7c-90bc-c73b18a7f37c None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:50.701118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce4fe1-0060-4d7c-90bc-c73b18a7f37c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:50.701395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce4fe1-0060-4d7c-90bc-c73b18a7f37c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:50.713725 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce4fe1-0060-4d7c-90bc-c73b18a7f37c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:50.715448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce4fe1-0060-4d7c-90bc-c73b18a7f37c None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:50.733057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-c3ce4fe1-0060-4d7c-90bc-c73b18a7f37c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:50.733057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:50.733057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:50.733057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:50.733057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:50.733057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:50.733057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:50.733057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:50.733057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:50.733057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:50.733057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:50.733057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:50.733057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:57:50.733057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:57:50.733057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:50.734866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:50.736824 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:57:50.736824 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:57:50.736824 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:57:50.736824 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:50.738586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 554/1102] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:50.743073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93487c04-67ec-4750-9e99-038f1c26dcdd None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:50.896327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:50.906832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93487c04-67ec-4750-9e99-038f1c26dcdd None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:50.960407 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efcffd-6481-4ec1-9a03-218eda4f0819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:50.961050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efcffd-6481-4ec1-9a03-218eda4f0819 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:50.961333 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efcffd-6481-4ec1-9a03-218eda4f0819 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:50.961606 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efcffd-6481-4ec1-9a03-218eda4f0819 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:50.962320 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efcffd-6481-4ec1-9a03-218eda4f0819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:50.962656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efcffd-6481-4ec1-9a03-218eda4f0819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:50.964043 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efcffd-6481-4ec1-9a03-218eda4f0819 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:50.977893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 549/1103] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 14:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:50.986716 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce4fe1-0060-4d7c-90bc-c73b18a7f37c None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:51.112481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce4fe1-0060-4d7c-90bc-c73b18a7f37c None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:51.153422 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab26045-5a7b-40b5-9927-1827d348db76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:51.154293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab26045-5a7b-40b5-9927-1827d348db76 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:51.154658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab26045-5a7b-40b5-9927-1827d348db76 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:51.154940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab26045-5a7b-40b5-9927-1827d348db76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:51.163614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab26045-5a7b-40b5-9927-1827d348db76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:51.165283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab26045-5a7b-40b5-9927-1827d348db76 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:51.180066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-bab26045-5a7b-40b5-9927-1827d348db76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:57:51.180066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:57:51.180066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:57:51.180066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:57:51.180066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:57:51.180066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:57:51.180066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:57:51.180066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:57:51.180066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:57:51.180066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:57:51.180066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:57:51.180066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:57:51.180066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:57:51.180066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:57:51.180066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:57:51.181454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:57:51.182621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:57:51.182621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:57:51.182621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:57:51.182621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:57:51.182621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:57:51.182621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:57:51.182621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:57:51.182621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:57:51.182621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 555/1104] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 14:57:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:57:51.192887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efcffd-6481-4ec1-9a03-218eda4f0819 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:51.332003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efcffd-6481-4ec1-9a03-218eda4f0819 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:51.382842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e75eeb-ec88-4c99-846f-21d82095a75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:51.383500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75eeb-ec88-4c99-846f-21d82095a75c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:51.383784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75eeb-ec88-4c99-846f-21d82095a75c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:51.384059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75eeb-ec88-4c99-846f-21d82095a75c None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:51.384830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e75eeb-ec88-4c99-846f-21d82095a75c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:51.385137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e75eeb-ec88-4c99-846f-21d82095a75c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:51.387044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e75eeb-ec88-4c99-846f-21d82095a75c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:51.404866 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 550/1105] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 14:57:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:51.411596 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab26045-5a7b-40b5-9927-1827d348db76 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:51.445821 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:51.567578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab26045-5a7b-40b5-9927-1827d348db76 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:51.617390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88198394-893e-428a-89a2-59df6c993dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:51.618347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88198394-893e-428a-89a2-59df6c993dab None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:51.618688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88198394-893e-428a-89a2-59df6c993dab None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:51.618963 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88198394-893e-428a-89a2-59df6c993dab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:51.619807 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88198394-893e-428a-89a2-59df6c993dab None admin] RBAC: Adding query filter params (role.id=79c75f5a5a5e44df9e723176a6ca33d8, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=a4a6c0e7ca434010980d7cac1800dbe9) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:51.620119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88198394-893e-428a-89a2-59df6c993dab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:51.621729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88198394-893e-428a-89a2-59df6c993dab None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:51.629946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 556/1106] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:57:51 2022] GET /identity/v3/role_assignments?user.id=a4a6c0e7ca434010980d7cac1800dbe9&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=79c75f5a5a5e44df9e723176a6ca33d8 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:52.138292 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383549cc-f493-420a-8927-7057f701618a None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:52.138916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383549cc-f493-420a-8927-7057f701618a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:52.138916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383549cc-f493-420a-8927-7057f701618a None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:52.140451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 551/1107] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:52.148210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad63fb5-b7f9-4398-af51-b1187fb48f81 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:52.149020 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad63fb5-b7f9-4398-af51-b1187fb48f81 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:52.149185 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad63fb5-b7f9-4398-af51-b1187fb48f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:52.178767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-fad63fb5-b7f9-4398-af51-b1187fb48f81 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:52.180076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-fad63fb5-b7f9-4398-af51-b1187fb48f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:52.292892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 557/1108] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:52.324112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383549cc-f493-420a-8927-7057f701618a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:52.369216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:52.545026 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383549cc-f493-420a-8927-7057f701618a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:52.611790 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2860352-4990-4c7a-906c-1b8a4e905d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:52.612575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2860352-4990-4c7a-906c-1b8a4e905d28 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:52.613133 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2860352-4990-4c7a-906c-1b8a4e905d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:52.613461 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2860352-4990-4c7a-906c-1b8a4e905d28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:52.614787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2860352-4990-4c7a-906c-1b8a4e905d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:52.616455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2860352-4990-4c7a-906c-1b8a4e905d28 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:52.618725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 552/1109] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:57:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:52.626298 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad63fb5-b7f9-4398-af51-b1187fb48f81 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:52.679628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:52.845254 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad63fb5-b7f9-4398-af51-b1187fb48f81 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:52.897831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41851a5-522e-4081-be59-b0670f9cae33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:52.898525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41851a5-522e-4081-be59-b0670f9cae33 None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:52.898810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41851a5-522e-4081-be59-b0670f9cae33 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:52.899095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41851a5-522e-4081-be59-b0670f9cae33 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:52.899825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41851a5-522e-4081-be59-b0670f9cae33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:52.901303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41851a5-522e-4081-be59-b0670f9cae33 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:53.029726 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 558/1110] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:57:52 2022] POST /identity/v3/users => generated 286 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:57:55.602993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5376f95-ed7c-4c19-9310-272065160c9f None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:55.603655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5376f95-ed7c-4c19-9310-272065160c9f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:55.604021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5376f95-ed7c-4c19-9310-272065160c9f None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:55.606966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 553/1111] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:57:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:55.619322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a25cf-cf0c-4252-a034-57521b2c5ece None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:55.620042 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a25cf-cf0c-4252-a034-57521b2c5ece None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:55.620299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a25cf-cf0c-4252-a034-57521b2c5ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:55.651385 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-9e5a25cf-cf0c-4252-a034-57521b2c5ece None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:55.652621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-9e5a25cf-cf0c-4252-a034-57521b2c5ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:55.768531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 559/1112] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:57:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:57:55.811698 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5376f95-ed7c-4c19-9310-272065160c9f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:55.979034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:56.010011 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5376f95-ed7c-4c19-9310-272065160c9f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:56.064538 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf3a08-9178-46e4-8415-710d104c2791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:56.065543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf3a08-9178-46e4-8415-710d104c2791 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:56.066044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf3a08-9178-46e4-8415-710d104c2791 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:56.066569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf3a08-9178-46e4-8415-710d104c2791 None admin] PATH_INFO: `/v3/roles/3b3abbcf8ee04f0387cfdede5812d226` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:56.070169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf3a08-9178-46e4-8415-710d104c2791 None admin] RBAC: Authorizing `identity:get_role(role_id=3b3abbcf8ee04f0387cfdede5812d226)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:56.072806 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf3a08-9178-46e4-8415-710d104c2791 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:56.075370 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 554/1113] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:57:55 2022] GET /identity/v3/roles/3b3abbcf8ee04f0387cfdede5812d226 => generated 223 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:56.084705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a25cf-cf0c-4252-a034-57521b2c5ece None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:56.094699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:56.255244 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a25cf-cf0c-4252-a034-57521b2c5ece None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:56.305894 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d2b74-178c-43e1-978e-36bd52d139b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:56.306665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d2b74-178c-43e1-978e-36bd52d139b7 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:56.307057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d2b74-178c-43e1-978e-36bd52d139b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:56.307395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d2b74-178c-43e1-978e-36bd52d139b7 None admin] PATH_INFO: `/v3/users/772efbab49d54b61bb9536d4b87abafe` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:56.327060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d2b74-178c-43e1-978e-36bd52d139b7 None admin] RBAC: Authorizing `identity:get_user(user_id=772efbab49d54b61bb9536d4b87abafe)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:56.329887 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d2b74-178c-43e1-978e-36bd52d139b7 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:56.332143 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 560/1114] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:57:56 2022] GET /identity/v3/users/772efbab49d54b61bb9536d4b87abafe => generated 286 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:56.339502 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf3a08-9178-46e4-8415-710d104c2791 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:56.503108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf3a08-9178-46e4-8415-710d104c2791 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:56.550895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dee4c-822f-459b-96df-b1c5f1c93bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:56.551665 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dee4c-822f-459b-96df-b1c5f1c93bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:56.552213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dee4c-822f-459b-96df-b1c5f1c93bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:56.552589 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dee4c-822f-459b-96df-b1c5f1c93bb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:56.588630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:56.675498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dee4c-822f-459b-96df-b1c5f1c93bb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:56.677274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dee4c-822f-459b-96df-b1c5f1c93bb8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:56.830799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 555/1115] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:57:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:57:56.837599 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d2b74-178c-43e1-978e-36bd52d139b7 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:56.939487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:56.993284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d2b74-178c-43e1-978e-36bd52d139b7 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:57.041555 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c049f-74e8-4ab4-8889-0cfdf554f561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:57.042275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c049f-74e8-4ab4-8889-0cfdf554f561 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:57.042590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c049f-74e8-4ab4-8889-0cfdf554f561 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:57.042868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c049f-74e8-4ab4-8889-0cfdf554f561 None admin] PATH_INFO: `/v3/projects/b31e543eb0a641989b594b7ff83263e2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:57.044160 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c049f-74e8-4ab4-8889-0cfdf554f561 None admin] RBAC: Authorizing `identity:get_project(project_id=b31e543eb0a641989b594b7ff83263e2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:57.045641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c049f-74e8-4ab4-8889-0cfdf554f561 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:57.048225 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 561/1116] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:57:56 2022] GET /identity/v3/projects/b31e543eb0a641989b594b7ff83263e2 => generated 311 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:57:57.055365 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dee4c-822f-459b-96df-b1c5f1c93bb8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:57.139202 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:57.213993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dee4c-822f-459b-96df-b1c5f1c93bb8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:57.262913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab2bed-626c-4c43-a7fa-2a95d8b79cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:57.263789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab2bed-626c-4c43-a7fa-2a95d8b79cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:57.264270 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab2bed-626c-4c43-a7fa-2a95d8b79cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:57.264782 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab2bed-626c-4c43-a7fa-2a95d8b79cc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:57.266337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab2bed-626c-4c43-a7fa-2a95d8b79cc6 None admin] RBAC: Adding query filter params (role.id=3b3abbcf8ee04f0387cfdede5812d226, scope.project.id=b31e543eb0a641989b594b7ff83263e2, user.id=772efbab49d54b61bb9536d4b87abafe) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:57.266939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab2bed-626c-4c43-a7fa-2a95d8b79cc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:57.269639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab2bed-626c-4c43-a7fa-2a95d8b79cc6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:57.280123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 556/1117] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:57:57 2022] GET /identity/v3/role_assignments?user.id=772efbab49d54b61bb9536d4b87abafe&scope.project.id=b31e543eb0a641989b594b7ff83263e2&role.id=3b3abbcf8ee04f0387cfdede5812d226 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:58:00.330763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eba307-0dbc-4a5d-8d39-da6d4632acc6 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:00.331335 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eba307-0dbc-4a5d-8d39-da6d4632acc6 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:00.331335 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eba307-0dbc-4a5d-8d39-da6d4632acc6 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:00.333505 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 562/1118] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:58:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:58:00.343755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692178c1-6ebc-4a05-bce1-9b1897d63ba5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:00.344334 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692178c1-6ebc-4a05-bce1-9b1897d63ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:00.344766 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692178c1-6ebc-4a05-bce1-9b1897d63ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:00.378089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-692178c1-6ebc-4a05-bce1-9b1897d63ba5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:58:00.380283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-692178c1-6ebc-4a05-bce1-9b1897d63ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:58:00.495379 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 557/1119] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:58:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:58:00.520865 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eba307-0dbc-4a5d-8d39-da6d4632acc6 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:00.660365 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eba307-0dbc-4a5d-8d39-da6d4632acc6 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:00.704981 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:00.710583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d3bce-60b7-4d97-90f5-2e40b4f2f0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:00.711350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3bce-60b7-4d97-90f5-2e40b4f2f0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:00.711919 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3bce-60b7-4d97-90f5-2e40b4f2f0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:00.717247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3bce-60b7-4d97-90f5-2e40b4f2f0d5 None admin] PATH_INFO: `/v3/roles/3b3abbcf8ee04f0387cfdede5812d226` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:00.717247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d3bce-60b7-4d97-90f5-2e40b4f2f0d5 None admin] RBAC: Authorizing `identity:get_role(role_id=3b3abbcf8ee04f0387cfdede5812d226)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:00.717247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d3bce-60b7-4d97-90f5-2e40b4f2f0d5 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:00.717247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 563/1120] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:58:00 2022] GET /identity/v3/roles/3b3abbcf8ee04f0387cfdede5812d226 => generated 223 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:00.724664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692178c1-6ebc-4a05-bce1-9b1897d63ba5 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:00.810868 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:00.906593 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692178c1-6ebc-4a05-bce1-9b1897d63ba5 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:00.962927 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f048317-9a91-4bdf-877d-78ac617537b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:00.963532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f048317-9a91-4bdf-877d-78ac617537b2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:00.963862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f048317-9a91-4bdf-877d-78ac617537b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:00.964184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f048317-9a91-4bdf-877d-78ac617537b2 None admin] PATH_INFO: `/v3/users/772efbab49d54b61bb9536d4b87abafe` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:00.965622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f048317-9a91-4bdf-877d-78ac617537b2 None admin] RBAC: Authorizing `identity:get_user(user_id=772efbab49d54b61bb9536d4b87abafe)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:00.967343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f048317-9a91-4bdf-877d-78ac617537b2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:00.969364 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 558/1121] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:58:00 2022] GET /identity/v3/users/772efbab49d54b61bb9536d4b87abafe => generated 286 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:00.976705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d3bce-60b7-4d97-90f5-2e40b4f2f0d5 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:01.162533 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d3bce-60b7-4d97-90f5-2e40b4f2f0d5 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:01.216921 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5996a1f-174f-47ea-ab3d-e68a7af71533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:01.217719 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5996a1f-174f-47ea-ab3d-e68a7af71533 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:01.218087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5996a1f-174f-47ea-ab3d-e68a7af71533 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:01.218585 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5996a1f-174f-47ea-ab3d-e68a7af71533 None admin] PATH_INFO: `/v3/projects/b31e543eb0a641989b594b7ff83263e2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:01.220520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5996a1f-174f-47ea-ab3d-e68a7af71533 None admin] RBAC: Authorizing `identity:get_project(project_id=b31e543eb0a641989b594b7ff83263e2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:01.222669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5996a1f-174f-47ea-ab3d-e68a7af71533 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:01.225075 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 564/1122] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:58:00 2022] GET /identity/v3/projects/b31e543eb0a641989b594b7ff83263e2 => generated 311 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:58:01.236017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f048317-9a91-4bdf-877d-78ac617537b2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:01.386621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f048317-9a91-4bdf-877d-78ac617537b2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:01.404441 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:01.432859 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eb4df-c062-4678-b42b-67eb97eb4452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:01.433556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eb4df-c062-4678-b42b-67eb97eb4452 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:01.433832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eb4df-c062-4678-b42b-67eb97eb4452 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:01.434107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eb4df-c062-4678-b42b-67eb97eb4452 None admin] PATH_INFO: `/v3/projects/b31e543eb0a641989b594b7ff83263e2/users/772efbab49d54b61bb9536d4b87abafe/roles/3b3abbcf8ee04f0387cfdede5812d226` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:01.439583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eb4df-c062-4678-b42b-67eb97eb4452 None admin] RBAC: Authorizing `identity:create_grant(project_id=b31e543eb0a641989b594b7ff83263e2, user_id=772efbab49d54b61bb9536d4b87abafe, role_id=3b3abbcf8ee04f0387cfdede5812d226)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:01.441640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eb4df-c062-4678-b42b-67eb97eb4452 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:01.547165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 559/1123] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:58:01 2022] PUT /identity/v3/projects/b31e543eb0a641989b594b7ff83263e2/users/772efbab49d54b61bb9536d4b87abafe/roles/3b3abbcf8ee04f0387cfdede5812d226 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:58:03.851239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0365b-03af-44e1-9576-807e509ad181 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:03.851779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0365b-03af-44e1-9576-807e509ad181 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:03.852128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0365b-03af-44e1-9576-807e509ad181 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:03.854814 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 565/1124] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:58:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:58:03.862754 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ded5d5-ce54-4b33-ab28-c926c6ae28e0 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:03.863340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ded5d5-ce54-4b33-ab28-c926c6ae28e0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:03.863340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ded5d5-ce54-4b33-ab28-c926c6ae28e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:03.885282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-20ded5d5-ce54-4b33-ab28-c926c6ae28e0 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:58:03.886647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-20ded5d5-ce54-4b33-ab28-c926c6ae28e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:58:03.973431 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 560/1125] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:58:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:58:03.999012 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0365b-03af-44e1-9576-807e509ad181 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:04.081906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:04.128243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0365b-03af-44e1-9576-807e509ad181 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:04.195211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fe23c-ab93-4be1-8da1-fbbe2912d4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:04.196300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fe23c-ab93-4be1-8da1-fbbe2912d4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:04.196792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fe23c-ab93-4be1-8da1-fbbe2912d4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:04.197255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fe23c-ab93-4be1-8da1-fbbe2912d4e4 None admin] PATH_INFO: `/v3/roles/3b3abbcf8ee04f0387cfdede5812d226` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:04.199751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fe23c-ab93-4be1-8da1-fbbe2912d4e4 None admin] RBAC: Authorizing `identity:get_role(role_id=3b3abbcf8ee04f0387cfdede5812d226)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:04.202333 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fe23c-ab93-4be1-8da1-fbbe2912d4e4 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:04.205061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 566/1126] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:58:03 2022] GET /identity/v3/roles/3b3abbcf8ee04f0387cfdede5812d226 => generated 223 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:04.211479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ded5d5-ce54-4b33-ab28-c926c6ae28e0 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:04.340173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ded5d5-ce54-4b33-ab28-c926c6ae28e0 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:04.343349 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:04.384396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6997d-e63a-48fa-b280-e09dfb93d496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:04.384937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6997d-e63a-48fa-b280-e09dfb93d496 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:04.385213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6997d-e63a-48fa-b280-e09dfb93d496 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:04.385484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6997d-e63a-48fa-b280-e09dfb93d496 None admin] PATH_INFO: `/v3/users/772efbab49d54b61bb9536d4b87abafe` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:04.386806 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6997d-e63a-48fa-b280-e09dfb93d496 None admin] RBAC: Authorizing `identity:get_user(user_id=772efbab49d54b61bb9536d4b87abafe)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:04.388282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6997d-e63a-48fa-b280-e09dfb93d496 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:04.390076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 561/1127] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:58:04 2022] GET /identity/v3/users/772efbab49d54b61bb9536d4b87abafe => generated 286 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:04.397024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fe23c-ab93-4be1-8da1-fbbe2912d4e4 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:04.521056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fe23c-ab93-4be1-8da1-fbbe2912d4e4 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:04.570806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af2aef-f164-4b64-ae8b-19c7c106c512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:04.571575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af2aef-f164-4b64-ae8b-19c7c106c512 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:04.571884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af2aef-f164-4b64-ae8b-19c7c106c512 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:04.572164 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af2aef-f164-4b64-ae8b-19c7c106c512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:04.578782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:04.681111 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af2aef-f164-4b64-ae8b-19c7c106c512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:04.683314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af2aef-f164-4b64-ae8b-19c7c106c512 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:04.816612 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 567/1128] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:58:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:58:04.823357 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6997d-e63a-48fa-b280-e09dfb93d496 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:04.957331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6997d-e63a-48fa-b280-e09dfb93d496 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:05.002336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48af633-ce17-44e0-bb09-9c36a4b78387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:05.003121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48af633-ce17-44e0-bb09-9c36a4b78387 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:05.003405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48af633-ce17-44e0-bb09-9c36a4b78387 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:05.003686 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48af633-ce17-44e0-bb09-9c36a4b78387 None admin] PATH_INFO: `/v3/projects/b31e543eb0a641989b594b7ff83263e2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:05.005096 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48af633-ce17-44e0-bb09-9c36a4b78387 None admin] RBAC: Authorizing `identity:get_project(project_id=b31e543eb0a641989b594b7ff83263e2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:05.006648 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48af633-ce17-44e0-bb09-9c36a4b78387 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:05.008529 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 562/1129] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:58:04 2022] GET /identity/v3/projects/b31e543eb0a641989b594b7ff83263e2 => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:05.015446 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af2aef-f164-4b64-ae8b-19c7c106c512 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:05.085594 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:05.169678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af2aef-f164-4b64-ae8b-19c7c106c512 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:05.219811 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75d6ce-d85a-4052-9602-fa4bf9af4cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:05.220402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75d6ce-d85a-4052-9602-fa4bf9af4cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:05.221432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75d6ce-d85a-4052-9602-fa4bf9af4cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:05.222086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75d6ce-d85a-4052-9602-fa4bf9af4cd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:05.223205 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75d6ce-d85a-4052-9602-fa4bf9af4cd7 None admin] RBAC: Adding query filter params (role.id=3b3abbcf8ee04f0387cfdede5812d226, scope.project.id=b31e543eb0a641989b594b7ff83263e2, user.id=772efbab49d54b61bb9536d4b87abafe) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:58:05.223571 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75d6ce-d85a-4052-9602-fa4bf9af4cd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:05.225104 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75d6ce-d85a-4052-9602-fa4bf9af4cd7 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:05.232192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 568/1130] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:58:05 2022] GET /identity/v3/role_assignments?user.id=772efbab49d54b61bb9536d4b87abafe&scope.project.id=b31e543eb0a641989b594b7ff83263e2&role.id=3b3abbcf8ee04f0387cfdede5812d226 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:58:07.455185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7a70a-6b20-4707-9f78-f885f9192097 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:07.456026 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7a70a-6b20-4707-9f78-f885f9192097 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:07.456026 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7a70a-6b20-4707-9f78-f885f9192097 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:07.457124 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 563/1131] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:58:07.464032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b941-2614-43eb-92e6-0ad48d2ff9e6 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:07.464694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b941-2614-43eb-92e6-0ad48d2ff9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:07.464694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b941-2614-43eb-92e6-0ad48d2ff9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:07.485540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-5a27b941-2614-43eb-92e6-0ad48d2ff9e6 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:58:07.487686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5a27b941-2614-43eb-92e6-0ad48d2ff9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:58:07.577376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 569/1132] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:58:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:58:07.607076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7a70a-6b20-4707-9f78-f885f9192097 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:07.666517 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:07.744288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7a70a-6b20-4707-9f78-f885f9192097 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:07.789441 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710edb1-47fb-43f1-80d4-87b250afc728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:07.790088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710edb1-47fb-43f1-80d4-87b250afc728 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:07.790411 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710edb1-47fb-43f1-80d4-87b250afc728 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:07.790671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710edb1-47fb-43f1-80d4-87b250afc728 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:07.792232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710edb1-47fb-43f1-80d4-87b250afc728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:07.793744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710edb1-47fb-43f1-80d4-87b250afc728 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:07.795499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 564/1133] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:58:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:58:07.803379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27b941-2614-43eb-92e6-0ad48d2ff9e6 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:07.841383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:07.974822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27b941-2614-43eb-92e6-0ad48d2ff9e6 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:08.039393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed92de4-43f2-41a6-8555-7df9016b08fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:08.040386 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed92de4-43f2-41a6-8555-7df9016b08fd None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:08.040898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed92de4-43f2-41a6-8555-7df9016b08fd None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:08.041395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed92de4-43f2-41a6-8555-7df9016b08fd None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:08.042670 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed92de4-43f2-41a6-8555-7df9016b08fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:08.045226 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed92de4-43f2-41a6-8555-7df9016b08fd None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:08.236393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 570/1134] 10.222.0.98 () {60 vars in 1141 bytes} [Tue Jul 26 14:58:07 2022] POST /identity/v3/projects => generated 311 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:58:10.549165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adf04a-c090-42ab-9a01-6ac3a9e3f9aa None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:10.549775 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adf04a-c090-42ab-9a01-6ac3a9e3f9aa None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:10.549775 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adf04a-c090-42ab-9a01-6ac3a9e3f9aa None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:10.551436 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 565/1135] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:58:10.557504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1007c06-ed6e-4ab1-8a63-c23e1a6a64de None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:10.558080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1007c06-ed6e-4ab1-8a63-c23e1a6a64de None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:10.558080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1007c06-ed6e-4ab1-8a63-c23e1a6a64de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:10.579093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-e1007c06-ed6e-4ab1-8a63-c23e1a6a64de None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:58:10.580448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e1007c06-ed6e-4ab1-8a63-c23e1a6a64de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:58:10.662295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 571/1136] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:58:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:58:10.688205 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adf04a-c090-42ab-9a01-6ac3a9e3f9aa None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:10.821083 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adf04a-c090-42ab-9a01-6ac3a9e3f9aa None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:10.833638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:10.866285 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663a6e4-3b4f-4e20-8d6e-cc3744a6da57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:10.867343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663a6e4-3b4f-4e20-8d6e-cc3744a6da57 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:10.867804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663a6e4-3b4f-4e20-8d6e-cc3744a6da57 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:10.868257 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663a6e4-3b4f-4e20-8d6e-cc3744a6da57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:10.869995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663a6e4-3b4f-4e20-8d6e-cc3744a6da57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:10.871538 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663a6e4-3b4f-4e20-8d6e-cc3744a6da57 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:10.873491 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 566/1137] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 14:58:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:10.881551 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1007c06-ed6e-4ab1-8a63-c23e1a6a64de None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:10.899070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:11.002237 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1007c06-ed6e-4ab1-8a63-c23e1a6a64de None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:11.045024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9137e-c1c1-4b61-a31b-2b697cb20627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:11.045662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9137e-c1c1-4b61-a31b-2b697cb20627 None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:11.045947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9137e-c1c1-4b61-a31b-2b697cb20627 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:11.046312 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9137e-c1c1-4b61-a31b-2b697cb20627 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:11.047595 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9137e-c1c1-4b61-a31b-2b697cb20627 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:11.048535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9137e-c1c1-4b61-a31b-2b697cb20627 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:11.149050 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 572/1138] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:58:10 2022] POST /identity/v3/users => generated 286 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:58:13.452971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ae602-d092-4a99-b7f7-0678867378c1 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:13.453543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ae602-d092-4a99-b7f7-0678867378c1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:13.453543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ae602-d092-4a99-b7f7-0678867378c1 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:13.455075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 567/1139] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:58:13.462278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38515c58-6508-4d04-b5ea-09044c32da20 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:13.462905 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38515c58-6508-4d04-b5ea-09044c32da20 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:13.462905 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38515c58-6508-4d04-b5ea-09044c32da20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:13.484801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-38515c58-6508-4d04-b5ea-09044c32da20 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:58:13.486118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-38515c58-6508-4d04-b5ea-09044c32da20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:58:13.599132 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:13.608483 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 573/1140] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:58:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:58:13.635754 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ae602-d092-4a99-b7f7-0678867378c1 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:13.789585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ae602-d092-4a99-b7f7-0678867378c1 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:13.915147 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb179a-94e5-4451-b328-6232a78dd532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:13.915817 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb179a-94e5-4451-b328-6232a78dd532 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:13.916102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb179a-94e5-4451-b328-6232a78dd532 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:13.916381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb179a-94e5-4451-b328-6232a78dd532 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:13.930989 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb179a-94e5-4451-b328-6232a78dd532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-3fbb179a-94e5-4451-b328-6232a78dd532 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:58:13.936366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:58:13.938317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:58:13.940061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:58:13.940061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:58:13.940061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:58:13.940061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:58:13.940061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:58:13.940061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:58:13.940061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:58:13.940061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:58:13.940061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:58:13.940061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:58:13.940061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:58:13.940061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:58:13.940061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 568/1141] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:58:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:58:13.948064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38515c58-6508-4d04-b5ea-09044c32da20 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:14.072426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38515c58-6508-4d04-b5ea-09044c32da20 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:14.113631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b735a71-796c-4071-bcbb-ee2896131a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:14.114285 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b735a71-796c-4071-bcbb-ee2896131a83 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:14.114615 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b735a71-796c-4071-bcbb-ee2896131a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:14.114996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b735a71-796c-4071-bcbb-ee2896131a83 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:14.115772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b735a71-796c-4071-bcbb-ee2896131a83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:58:14.116077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b735a71-796c-4071-bcbb-ee2896131a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:14.117521 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b735a71-796c-4071-bcbb-ee2896131a83 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:14.128034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 574/1142] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:58:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:14.135107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb179a-94e5-4451-b328-6232a78dd532 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:14.178489 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:14.258073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb179a-94e5-4451-b328-6232a78dd532 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:14.299336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55b473-0b96-4969-8ff7-2e9e580a8273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:14.300064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55b473-0b96-4969-8ff7-2e9e580a8273 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:14.300346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55b473-0b96-4969-8ff7-2e9e580a8273 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:14.301308 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55b473-0b96-4969-8ff7-2e9e580a8273 None admin] PATH_INFO: `/v3/users/98e8a1f20eb34c9999c10642ac51762c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:14.318642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55b473-0b96-4969-8ff7-2e9e580a8273 None admin] RBAC: Authorizing `identity:get_user(user_id=98e8a1f20eb34c9999c10642ac51762c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:14.320264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55b473-0b96-4969-8ff7-2e9e580a8273 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:14.322338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 569/1143] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:58:14 2022] GET /identity/v3/users/98e8a1f20eb34c9999c10642ac51762c => generated 286 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:14.328729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b735a71-796c-4071-bcbb-ee2896131a83 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:14.406646 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:14.459925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b735a71-796c-4071-bcbb-ee2896131a83 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:14.501237 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f9d23-f10d-4e9e-b46f-6d482390a69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:14.501913 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f9d23-f10d-4e9e-b46f-6d482390a69f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:14.502129 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f9d23-f10d-4e9e-b46f-6d482390a69f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:14.502432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f9d23-f10d-4e9e-b46f-6d482390a69f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:14.584422 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f9d23-f10d-4e9e-b46f-6d482390a69f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:14.585800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f9d23-f10d-4e9e-b46f-6d482390a69f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:14.683470 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:14.739643 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 575/1144] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:58:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:58:14.746714 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55b473-0b96-4969-8ff7-2e9e580a8273 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:14.895563 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:14.907296 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55b473-0b96-4969-8ff7-2e9e580a8273 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:14.973334 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc19408-82f3-49ee-96d2-430785b1495d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:14.974518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19408-82f3-49ee-96d2-430785b1495d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:14.975036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19408-82f3-49ee-96d2-430785b1495d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:14.975551 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19408-82f3-49ee-96d2-430785b1495d None admin] PATH_INFO: `/v3/projects/612124f92ce84ec3bd9458445d92ba6e` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:14.977826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc19408-82f3-49ee-96d2-430785b1495d None admin] RBAC: Authorizing `identity:get_project(project_id=612124f92ce84ec3bd9458445d92ba6e)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:14.980688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc19408-82f3-49ee-96d2-430785b1495d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:14.983900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 570/1145] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:58:14 2022] GET /identity/v3/projects/612124f92ce84ec3bd9458445d92ba6e => generated 311 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:14.990785 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f9d23-f10d-4e9e-b46f-6d482390a69f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:15.111532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f9d23-f10d-4e9e-b46f-6d482390a69f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:15.152793 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c96da-cfcf-42d3-b320-6c54986ffa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:15.153350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c96da-cfcf-42d3-b320-6c54986ffa39 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:15.153638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c96da-cfcf-42d3-b320-6c54986ffa39 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:15.153918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c96da-cfcf-42d3-b320-6c54986ffa39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:15.154768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c96da-cfcf-42d3-b320-6c54986ffa39 None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=612124f92ce84ec3bd9458445d92ba6e, user.id=98e8a1f20eb34c9999c10642ac51762c) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:58:15.155086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c96da-cfcf-42d3-b320-6c54986ffa39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:15.156539 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c96da-cfcf-42d3-b320-6c54986ffa39 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:15.163925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 576/1146] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:58:14 2022] GET /identity/v3/role_assignments?user.id=98e8a1f20eb34c9999c10642ac51762c&scope.project.id=612124f92ce84ec3bd9458445d92ba6e&role.id=17054492864541709fda49dbf677a7a2 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:17.550699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f321c4a-bbac-4ffc-be12-742617de98f1 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:17.551519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f321c4a-bbac-4ffc-be12-742617de98f1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:17.551704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f321c4a-bbac-4ffc-be12-742617de98f1 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:17.553742 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 571/1147] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:58:17.561660 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e74368-1613-4401-9e09-026b795b0b03 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:17.562403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e74368-1613-4401-9e09-026b795b0b03 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:17.562634 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e74368-1613-4401-9e09-026b795b0b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:17.593477 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-46e74368-1613-4401-9e09-026b795b0b03 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:58:17.595494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-46e74368-1613-4401-9e09-026b795b0b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:58:17.635518 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:17.714340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 577/1148] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:58:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:58:17.755759 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f321c4a-bbac-4ffc-be12-742617de98f1 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:17.950856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f321c4a-bbac-4ffc-be12-742617de98f1 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:18.003466 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b804a3-3bcc-4f99-88f0-71e611edea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:18.005938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b804a3-3bcc-4f99-88f0-71e611edea62 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:18.006436 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b804a3-3bcc-4f99-88f0-71e611edea62 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:18.006787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b804a3-3bcc-4f99-88f0-71e611edea62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:18.028644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b804a3-3bcc-4f99-88f0-71e611edea62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-99b804a3-3bcc-4f99-88f0-71e611edea62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:58:18.040051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:58:18.041912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:58:18.043599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:58:18.043599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:58:18.043599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:58:18.043599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:58:18.043599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:58:18.043599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:58:18.043599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:58:18.043599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:58:18.043599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:58:18.043599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:58:18.043599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:58:18.043599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:58:18.043599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 572/1149] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:58:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:58:18.050044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e74368-1613-4401-9e09-026b795b0b03 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:18.187399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e74368-1613-4401-9e09-026b795b0b03 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:18.234494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ec918-20bc-4b85-9a5d-1f25b758d6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:18.235250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ec918-20bc-4b85-9a5d-1f25b758d6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:18.235531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ec918-20bc-4b85-9a5d-1f25b758d6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:18.235804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ec918-20bc-4b85-9a5d-1f25b758d6c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:18.236535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ec918-20bc-4b85-9a5d-1f25b758d6c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:58:18.236838 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ec918-20bc-4b85-9a5d-1f25b758d6c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:18.238239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ec918-20bc-4b85-9a5d-1f25b758d6c5 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:18.249335 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 578/1150] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:58:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:18.256526 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b804a3-3bcc-4f99-88f0-71e611edea62 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:18.287919 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:18.383751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b804a3-3bcc-4f99-88f0-71e611edea62 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:18.427746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1805f03-f0cf-485d-9461-8eaabe9607fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:18.428550 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1805f03-f0cf-485d-9461-8eaabe9607fe None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:18.428832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1805f03-f0cf-485d-9461-8eaabe9607fe None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:18.429105 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1805f03-f0cf-485d-9461-8eaabe9607fe None admin] PATH_INFO: `/v3/users/98e8a1f20eb34c9999c10642ac51762c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:18.430473 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1805f03-f0cf-485d-9461-8eaabe9607fe None admin] RBAC: Authorizing `identity:get_user(user_id=98e8a1f20eb34c9999c10642ac51762c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:18.432019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1805f03-f0cf-485d-9461-8eaabe9607fe None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:18.433797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 573/1151] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:58:18 2022] GET /identity/v3/users/98e8a1f20eb34c9999c10642ac51762c => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:18.440399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ec918-20bc-4b85-9a5d-1f25b758d6c5 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:18.468015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:18.571997 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ec918-20bc-4b85-9a5d-1f25b758d6c5 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:18.613259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f3e8b-56b9-4827-9aa5-f948ad3b2f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:18.614495 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f3e8b-56b9-4827-9aa5-f948ad3b2f72 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:18.614958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f3e8b-56b9-4827-9aa5-f948ad3b2f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:18.615286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f3e8b-56b9-4827-9aa5-f948ad3b2f72 None admin] PATH_INFO: `/v3/projects/612124f92ce84ec3bd9458445d92ba6e` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:18.616629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f3e8b-56b9-4827-9aa5-f948ad3b2f72 None admin] RBAC: Authorizing `identity:get_project(project_id=612124f92ce84ec3bd9458445d92ba6e)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:18.618095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f3e8b-56b9-4827-9aa5-f948ad3b2f72 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:18.619967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 579/1152] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:58:18 2022] GET /identity/v3/projects/612124f92ce84ec3bd9458445d92ba6e => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:58:18.626736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1805f03-f0cf-485d-9461-8eaabe9607fe None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:18.749352 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:18.766452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1805f03-f0cf-485d-9461-8eaabe9607fe None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:18.826401 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03bb41-78e7-455d-b643-c745ccc5e3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:18.827474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03bb41-78e7-455d-b643-c745ccc5e3cd None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:18.827964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03bb41-78e7-455d-b643-c745ccc5e3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:18.828682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03bb41-78e7-455d-b643-c745ccc5e3cd None admin] PATH_INFO: `/v3/projects/612124f92ce84ec3bd9458445d92ba6e/users/98e8a1f20eb34c9999c10642ac51762c/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:18.832986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03bb41-78e7-455d-b643-c745ccc5e3cd None admin] RBAC: Authorizing `identity:create_grant(project_id=612124f92ce84ec3bd9458445d92ba6e, user_id=98e8a1f20eb34c9999c10642ac51762c, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:18.836229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03bb41-78e7-455d-b643-c745ccc5e3cd None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:18.967704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 574/1153] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:58:18 2022] PUT /identity/v3/projects/612124f92ce84ec3bd9458445d92ba6e/users/98e8a1f20eb34c9999c10642ac51762c/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:58:21.120388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22cd5b-4af4-47d7-a0aa-14c116b77bfd None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:21.120965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22cd5b-4af4-47d7-a0aa-14c116b77bfd None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:21.120965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22cd5b-4af4-47d7-a0aa-14c116b77bfd None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:21.122562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 580/1154] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:58:21.128783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc31c6-710f-4434-bcc9-fc744928a28c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:21.129368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc31c6-710f-4434-bcc9-fc744928a28c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:21.129368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc31c6-710f-4434-bcc9-fc744928a28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:21.149583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-57cc31c6-710f-4434-bcc9-fc744928a28c None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:58:21.150928 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-57cc31c6-710f-4434-bcc9-fc744928a28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:58:21.232490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 575/1155] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:58:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:58:21.257965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22cd5b-4af4-47d7-a0aa-14c116b77bfd None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:21.361749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:21.383505 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22cd5b-4af4-47d7-a0aa-14c116b77bfd None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:21.430269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ac411-a452-4858-8dc1-d509b4e2d608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:21.430984 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ac411-a452-4858-8dc1-d509b4e2d608 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:21.431274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ac411-a452-4858-8dc1-d509b4e2d608 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:21.431553 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ac411-a452-4858-8dc1-d509b4e2d608 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:21.449174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ac411-a452-4858-8dc1-d509b4e2d608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-581ac411-a452-4858-8dc1-d509b4e2d608 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:58:21.454504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:58:21.456562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:58:21.458017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:58:21.458017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:58:21.458017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:58:21.458017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:58:21.458017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:58:21.458017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:58:21.458017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:58:21.458017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:58:21.458017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:58:21.458017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:58:21.458017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:58:21.458017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:58:21.458017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 581/1156] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:58:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:58:21.466240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc31c6-710f-4434-bcc9-fc744928a28c None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:21.569934 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:21.594382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc31c6-710f-4434-bcc9-fc744928a28c None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:21.637251 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846e561-86ae-4984-9da1-a8533f3bc8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:21.637864 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846e561-86ae-4984-9da1-a8533f3bc8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:21.638275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846e561-86ae-4984-9da1-a8533f3bc8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:21.638633 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846e561-86ae-4984-9da1-a8533f3bc8f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:21.639435 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846e561-86ae-4984-9da1-a8533f3bc8f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:58:21.639783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846e561-86ae-4984-9da1-a8533f3bc8f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:21.641253 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846e561-86ae-4984-9da1-a8533f3bc8f3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:21.652597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 576/1157] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:58:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:21.659182 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ac411-a452-4858-8dc1-d509b4e2d608 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:21.789400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ac411-a452-4858-8dc1-d509b4e2d608 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:21.835721 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dd280-ca71-4c34-9dfb-d7e996941beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:21.836475 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dd280-ca71-4c34-9dfb-d7e996941beb None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:21.836813 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dd280-ca71-4c34-9dfb-d7e996941beb None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:21.837144 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dd280-ca71-4c34-9dfb-d7e996941beb None admin] PATH_INFO: `/v3/users/98e8a1f20eb34c9999c10642ac51762c` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:21.838569 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dd280-ca71-4c34-9dfb-d7e996941beb None admin] RBAC: Authorizing `identity:get_user(user_id=98e8a1f20eb34c9999c10642ac51762c)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:21.840192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dd280-ca71-4c34-9dfb-d7e996941beb None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:21.842473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 582/1158] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:58:21 2022] GET /identity/v3/users/98e8a1f20eb34c9999c10642ac51762c => generated 286 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:21.851166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846e561-86ae-4984-9da1-a8533f3bc8f3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:21.983267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846e561-86ae-4984-9da1-a8533f3bc8f3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:22.027453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05b113-2f33-4fe5-a181-e8e5d01f7eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:22.028193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05b113-2f33-4fe5-a181-e8e5d01f7eda None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:22.028483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05b113-2f33-4fe5-a181-e8e5d01f7eda None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:22.028760 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05b113-2f33-4fe5-a181-e8e5d01f7eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:22.046001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:22.119195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05b113-2f33-4fe5-a181-e8e5d01f7eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:22.120682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05b113-2f33-4fe5-a181-e8e5d01f7eda None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:22.244921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 577/1159] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:58:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:58:22.251215 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dd280-ca71-4c34-9dfb-d7e996941beb None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:22.271315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:22.393303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dd280-ca71-4c34-9dfb-d7e996941beb None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:22.434821 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a1414-19b6-40cb-bded-5da03b7b0aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:22.435583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a1414-19b6-40cb-bded-5da03b7b0aaf None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:22.435915 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a1414-19b6-40cb-bded-5da03b7b0aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:22.436241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a1414-19b6-40cb-bded-5da03b7b0aaf None admin] PATH_INFO: `/v3/projects/612124f92ce84ec3bd9458445d92ba6e` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:22.437581 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a1414-19b6-40cb-bded-5da03b7b0aaf None admin] RBAC: Authorizing `identity:get_project(project_id=612124f92ce84ec3bd9458445d92ba6e)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:22.439299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a1414-19b6-40cb-bded-5da03b7b0aaf None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:22.441268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 583/1160] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:58:22 2022] GET /identity/v3/projects/612124f92ce84ec3bd9458445d92ba6e => generated 311 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:58:22.448913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05b113-2f33-4fe5-a181-e8e5d01f7eda None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:22.509683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:22.620150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05b113-2f33-4fe5-a181-e8e5d01f7eda None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:22.685852 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b58fc-5a8f-41c1-98fa-b186fd86f0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:22.686968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b58fc-5a8f-41c1-98fa-b186fd86f0cc None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:22.687447 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b58fc-5a8f-41c1-98fa-b186fd86f0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:22.687921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b58fc-5a8f-41c1-98fa-b186fd86f0cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:22.689479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b58fc-5a8f-41c1-98fa-b186fd86f0cc None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=612124f92ce84ec3bd9458445d92ba6e, user.id=98e8a1f20eb34c9999c10642ac51762c) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:58:22.690013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b58fc-5a8f-41c1-98fa-b186fd86f0cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:22.693358 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b58fc-5a8f-41c1-98fa-b186fd86f0cc None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:22.704968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 578/1161] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:58:22 2022] GET /identity/v3/role_assignments?user.id=98e8a1f20eb34c9999c10642ac51762c&scope.project.id=612124f92ce84ec3bd9458445d92ba6e&role.id=17054492864541709fda49dbf677a7a2 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:25.327246 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912fd98-90a8-4a15-b8e8-baedc7ffa332 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:25.327826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912fd98-90a8-4a15-b8e8-baedc7ffa332 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:25.327826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912fd98-90a8-4a15-b8e8-baedc7ffa332 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:25.329377 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 584/1162] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:58:25.335731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94384e3a-5ef8-4b94-b947-2fb5d05e693e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:25.336464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94384e3a-5ef8-4b94-b947-2fb5d05e693e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:25.336464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94384e3a-5ef8-4b94-b947-2fb5d05e693e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:25.363786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-94384e3a-5ef8-4b94-b947-2fb5d05e693e None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:58:25.366427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-94384e3a-5ef8-4b94-b947-2fb5d05e693e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:58:25.485543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 579/1163] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:58:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:58:25.510948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912fd98-90a8-4a15-b8e8-baedc7ffa332 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:25.613436 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:25.638928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912fd98-90a8-4a15-b8e8-baedc7ffa332 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:25.681617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514c3ee-2d65-4d3f-afa9-9a4511555429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:25.682262 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514c3ee-2d65-4d3f-afa9-9a4511555429 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:25.682582 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514c3ee-2d65-4d3f-afa9-9a4511555429 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:25.682859 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514c3ee-2d65-4d3f-afa9-9a4511555429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:25.765192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514c3ee-2d65-4d3f-afa9-9a4511555429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:25.766765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514c3ee-2d65-4d3f-afa9-9a4511555429 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:25.869350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:25.893729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 585/1164] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:58:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:58:25.900884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94384e3a-5ef8-4b94-b947-2fb5d05e693e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:25.941462 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:26.019805 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94384e3a-5ef8-4b94-b947-2fb5d05e693e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:26.063502 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541c9ca-093c-410d-b5c8-8ebb704945cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:26.064176 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541c9ca-093c-410d-b5c8-8ebb704945cd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:26.064454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541c9ca-093c-410d-b5c8-8ebb704945cd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:26.064725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541c9ca-093c-410d-b5c8-8ebb704945cd None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:26.073025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541c9ca-093c-410d-b5c8-8ebb704945cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:26.074923 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541c9ca-093c-410d-b5c8-8ebb704945cd None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-c541c9ca-093c-410d-b5c8-8ebb704945cd None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:58:26.097930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:58:26.099624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:58:26.100841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:58:26.100841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:58:26.100841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:58:26.100841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:58:26.100841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:58:26.100841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:58:26.100841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:58:26.100841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:58:26.100841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:58:26.100841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:58:26.100841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 26 14:58:26.100841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:58:26.100841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 14:58:26.100841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:58:26.100841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 580/1165] 10.222.0.98 () {56 vars in 1117 bytes} [Tue Jul 26 14:58:25 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:58:26.106919 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514c3ee-2d65-4d3f-afa9-9a4511555429 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:26.226192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514c3ee-2d65-4d3f-afa9-9a4511555429 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:26.268870 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f5d96-d98c-43c4-a3e1-c7d18fad8e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:26.269505 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f5d96-d98c-43c4-a3e1-c7d18fad8e8a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:26.269786 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f5d96-d98c-43c4-a3e1-c7d18fad8e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:26.270059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f5d96-d98c-43c4-a3e1-c7d18fad8e8a None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:26.270802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f5d96-d98c-43c4-a3e1-c7d18fad8e8a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:58:26.271108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f5d96-d98c-43c4-a3e1-c7d18fad8e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:26.272653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f5d96-d98c-43c4-a3e1-c7d18fad8e8a None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:26.281254 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 586/1166] 10.222.0.98 () {56 vars in 1115 bytes} [Tue Jul 26 14:58:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:28.517230 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936c80d-d768-4707-b1e2-8a33f94873d7 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:28.517789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936c80d-d768-4707-b1e2-8a33f94873d7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:28.517789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936c80d-d768-4707-b1e2-8a33f94873d7 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:28.519744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 581/1167] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:58:28.526420 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6b7d0-35ae-47f3-b9c5-19da3641363a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:28.526962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6b7d0-35ae-47f3-b9c5-19da3641363a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:28.527153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6b7d0-35ae-47f3-b9c5-19da3641363a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:28.548543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b6e6b7d0-35ae-47f3-b9c5-19da3641363a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:58:28.549823 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b6e6b7d0-35ae-47f3-b9c5-19da3641363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:58:28.602134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:28.637773 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 587/1168] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:58:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:58:28.662024 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936c80d-d768-4707-b1e2-8a33f94873d7 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:28.785984 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:28.794203 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936c80d-d768-4707-b1e2-8a33f94873d7 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:28.839743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfbbd3-71f7-4228-b9f7-3e091300b867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:28.840448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfbbd3-71f7-4228-b9f7-3e091300b867 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:28.840875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfbbd3-71f7-4228-b9f7-3e091300b867 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:28.841204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfbbd3-71f7-4228-b9f7-3e091300b867 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:28.842153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfbbd3-71f7-4228-b9f7-3e091300b867 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:28.843969 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfbbd3-71f7-4228-b9f7-3e091300b867 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:28.939495 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 582/1169] 10.222.0.98 () {60 vars in 1138 bytes} [Tue Jul 26 14:58:28 2022] POST /identity/v3/domains => generated 267 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:58:31.267847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcebd6-7fe1-4d42-9d79-23fb65fba16d None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:31.268405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcebd6-7fe1-4d42-9d79-23fb65fba16d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:31.268405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcebd6-7fe1-4d42-9d79-23fb65fba16d None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:31.269901 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 588/1170] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:58:31.277467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8353018-2eef-470b-a94d-03c8c161cb66 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:31.278028 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8353018-2eef-470b-a94d-03c8c161cb66 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:31.278028 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8353018-2eef-470b-a94d-03c8c161cb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:31.299371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b8353018-2eef-470b-a94d-03c8c161cb66 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:58:31.300657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b8353018-2eef-470b-a94d-03c8c161cb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:58:31.385540 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 583/1171] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:58:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:58:31.410007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcebd6-7fe1-4d42-9d79-23fb65fba16d None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:31.533005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcebd6-7fe1-4d42-9d79-23fb65fba16d None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:31.578160 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388d17d-500a-4c8d-939d-700d8ebda0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:31.578979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388d17d-500a-4c8d-939d-700d8ebda0af None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:31.579317 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388d17d-500a-4c8d-939d-700d8ebda0af None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:31.579648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388d17d-500a-4c8d-939d-700d8ebda0af None admin] PATH_INFO: `/v3/domains/c03efc948dc34943a20c70dcdfc430f9` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:31.593454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388d17d-500a-4c8d-939d-700d8ebda0af None admin] RBAC: Authorizing `identity:get_domain(domain_id=c03efc948dc34943a20c70dcdfc430f9)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:31.595481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388d17d-500a-4c8d-939d-700d8ebda0af None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:31.597359 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 589/1172] 10.222.0.98 () {56 vars in 1183 bytes} [Tue Jul 26 14:58:31 2022] GET /identity/v3/domains/c03efc948dc34943a20c70dcdfc430f9 => generated 267 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:31.603915 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8353018-2eef-470b-a94d-03c8c161cb66 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:31.708084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:31.728382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8353018-2eef-470b-a94d-03c8c161cb66 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:31.773788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0b202-bccf-4ad8-a141-6787ce0d63e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:31.774872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0b202-bccf-4ad8-a141-6787ce0d63e4 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:31.775360 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0b202-bccf-4ad8-a141-6787ce0d63e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:31.775842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0b202-bccf-4ad8-a141-6787ce0d63e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:31.777058 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0b202-bccf-4ad8-a141-6787ce0d63e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:31.779870 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0b202-bccf-4ad8-a141-6787ce0d63e4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:31.915210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 584/1173] 10.222.0.98 () {60 vars in 1141 bytes} [Tue Jul 26 14:58:31 2022] POST /identity/v3/projects => generated 361 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:58:34.248635 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68cb7f-5ddd-4710-8e6f-6ec746cbb780 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:34.249246 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68cb7f-5ddd-4710-8e6f-6ec746cbb780 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:34.249373 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68cb7f-5ddd-4710-8e6f-6ec746cbb780 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:34.250879 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 590/1174] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:58:34.258107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984dd98-1179-4ce5-92de-2a62c0fe3178 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:34.258765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984dd98-1179-4ce5-92de-2a62c0fe3178 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:34.259047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984dd98-1179-4ce5-92de-2a62c0fe3178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:34.280182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2984dd98-1179-4ce5-92de-2a62c0fe3178 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:58:34.281618 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2984dd98-1179-4ce5-92de-2a62c0fe3178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:58:34.366713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 585/1175] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:58:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:58:34.393989 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68cb7f-5ddd-4710-8e6f-6ec746cbb780 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:34.453675 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:34.571254 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68cb7f-5ddd-4710-8e6f-6ec746cbb780 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:34.613414 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729ae45-e852-478a-89a8-4cde3907bc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:34.614248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729ae45-e852-478a-89a8-4cde3907bc5a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:34.614570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729ae45-e852-478a-89a8-4cde3907bc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:34.614853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729ae45-e852-478a-89a8-4cde3907bc5a None admin] PATH_INFO: `/v3/domains/c03efc948dc34943a20c70dcdfc430f9` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:34.616178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729ae45-e852-478a-89a8-4cde3907bc5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=c03efc948dc34943a20c70dcdfc430f9)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:34.618724 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729ae45-e852-478a-89a8-4cde3907bc5a None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:34.620492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 591/1176] 10.222.0.98 () {56 vars in 1183 bytes} [Tue Jul 26 14:58:34 2022] GET /identity/v3/domains/c03efc948dc34943a20c70dcdfc430f9 => generated 267 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:58:34.627100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984dd98-1179-4ce5-92de-2a62c0fe3178 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:34.719030 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:34.768065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984dd98-1179-4ce5-92de-2a62c0fe3178 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:34.842533 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895d8b9-bbd0-410a-9cd0-ec4d9bba63ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:34.843158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895d8b9-bbd0-410a-9cd0-ec4d9bba63ab None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:34.843481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895d8b9-bbd0-410a-9cd0-ec4d9bba63ab None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:34.843805 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895d8b9-bbd0-410a-9cd0-ec4d9bba63ab None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:34.844862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895d8b9-bbd0-410a-9cd0-ec4d9bba63ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:34.846394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895d8b9-bbd0-410a-9cd0-ec4d9bba63ab None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:34.965052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 586/1177] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 14:58:34 2022] POST /identity/v3/users => generated 311 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:58:37.218530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bccf84-6b7e-4908-a61d-8eb093ebc865 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:37.219377 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bccf84-6b7e-4908-a61d-8eb093ebc865 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:37.219377 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bccf84-6b7e-4908-a61d-8eb093ebc865 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:37.220906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 592/1178] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:58:37.227550 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167189d-0a0c-44db-a155-04f1ac265995 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:37.228174 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167189d-0a0c-44db-a155-04f1ac265995 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:37.228306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167189d-0a0c-44db-a155-04f1ac265995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:37.253953 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b167189d-0a0c-44db-a155-04f1ac265995 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:58:37.255246 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b167189d-0a0c-44db-a155-04f1ac265995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:58:37.357931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 587/1179] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:58:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:58:37.403358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bccf84-6b7e-4908-a61d-8eb093ebc865 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:37.622156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bccf84-6b7e-4908-a61d-8eb093ebc865 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:37.625278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:37.691794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deb40c-0208-4165-94e8-dbc95aa31bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:37.692955 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb40c-0208-4165-94e8-dbc95aa31bbf None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:37.693443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb40c-0208-4165-94e8-dbc95aa31bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:37.693921 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb40c-0208-4165-94e8-dbc95aa31bbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:37.713880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87deb40c-0208-4165-94e8-dbc95aa31bbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-87deb40c-0208-4165-94e8-dbc95aa31bbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:58:37.723430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:58:37.724618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:58:37.725682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:58:37.725682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:58:37.725682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:58:37.725682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:58:37.725682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:58:37.725682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:58:37.725682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:58:37.725682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:58:37.725682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:58:37.725682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:58:37.725682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:58:37.725682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:58:37.727313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 593/1180] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:58:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:58:37.733722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167189d-0a0c-44db-a155-04f1ac265995 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:37.803044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:37.857849 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167189d-0a0c-44db-a155-04f1ac265995 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:37.903324 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1995843-1367-4632-af6b-a5dfcffdc5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:37.903980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1995843-1367-4632-af6b-a5dfcffdc5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:37.904310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1995843-1367-4632-af6b-a5dfcffdc5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:37.904590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1995843-1367-4632-af6b-a5dfcffdc5c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:37.905329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1995843-1367-4632-af6b-a5dfcffdc5c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:58:37.905648 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1995843-1367-4632-af6b-a5dfcffdc5c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:37.907089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1995843-1367-4632-af6b-a5dfcffdc5c4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:37.917348 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 588/1181] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:58:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:37.923801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deb40c-0208-4165-94e8-dbc95aa31bbf None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:38.139753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deb40c-0208-4165-94e8-dbc95aa31bbf None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:38.180642 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8cbd6-15ef-4659-997c-a27903b2a80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:38.181452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8cbd6-15ef-4659-997c-a27903b2a80c None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:38.181781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8cbd6-15ef-4659-997c-a27903b2a80c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:38.182102 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8cbd6-15ef-4659-997c-a27903b2a80c None admin] PATH_INFO: `/v3/users/e9e388085f6142128b05c798c6492b8d` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:38.199229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8cbd6-15ef-4659-997c-a27903b2a80c None admin] RBAC: Authorizing `identity:get_user(user_id=e9e388085f6142128b05c798c6492b8d)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:38.200731 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8cbd6-15ef-4659-997c-a27903b2a80c None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:38.202543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 594/1182] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:58:37 2022] GET /identity/v3/users/e9e388085f6142128b05c798c6492b8d => generated 311 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:58:38.208959 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1995843-1367-4632-af6b-a5dfcffdc5c4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:38.347159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1995843-1367-4632-af6b-a5dfcffdc5c4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:38.375951 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:38.412299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de292fd-7370-49b7-a421-a3eed5c5c0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:38.413288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de292fd-7370-49b7-a421-a3eed5c5c0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:38.414825 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de292fd-7370-49b7-a421-a3eed5c5c0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:38.415348 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de292fd-7370-49b7-a421-a3eed5c5c0c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:38.533655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de292fd-7370-49b7-a421-a3eed5c5c0c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:38.535220 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de292fd-7370-49b7-a421-a3eed5c5c0c0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:38.677102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 589/1183] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:58:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:58:38.683867 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8cbd6-15ef-4659-997c-a27903b2a80c None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:38.711760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:38.823866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8cbd6-15ef-4659-997c-a27903b2a80c None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:38.864497 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549ff3e-b86a-407b-a101-4cc66cdf36af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:38.865198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549ff3e-b86a-407b-a101-4cc66cdf36af None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:38.865526 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549ff3e-b86a-407b-a101-4cc66cdf36af None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:38.865804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549ff3e-b86a-407b-a101-4cc66cdf36af None admin] PATH_INFO: `/v3/projects/036ca8828fff4392a32c0b42e58d9c45` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:38.867656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549ff3e-b86a-407b-a101-4cc66cdf36af None admin] RBAC: Authorizing `identity:get_project(project_id=036ca8828fff4392a32c0b42e58d9c45)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:38.870148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549ff3e-b86a-407b-a101-4cc66cdf36af None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:38.872287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 595/1184] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:58:38 2022] GET /identity/v3/projects/036ca8828fff4392a32c0b42e58d9c45 => generated 361 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:58:38.878999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de292fd-7370-49b7-a421-a3eed5c5c0c0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:38.899498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:39.000363 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de292fd-7370-49b7-a421-a3eed5c5c0c0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:39.045862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f6c92-545c-41b7-8311-fcef00d49df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:39.046541 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f6c92-545c-41b7-8311-fcef00d49df1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:39.046826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f6c92-545c-41b7-8311-fcef00d49df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:39.047101 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f6c92-545c-41b7-8311-fcef00d49df1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:39.047915 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f6c92-545c-41b7-8311-fcef00d49df1 None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=036ca8828fff4392a32c0b42e58d9c45, user.id=e9e388085f6142128b05c798c6492b8d) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:58:39.048222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f6c92-545c-41b7-8311-fcef00d49df1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:39.049709 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f6c92-545c-41b7-8311-fcef00d49df1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:39.057232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 590/1185] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:58:38 2022] GET /identity/v3/role_assignments?user.id=e9e388085f6142128b05c798c6492b8d&scope.project.id=036ca8828fff4392a32c0b42e58d9c45&role.id=17054492864541709fda49dbf677a7a2 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:41.163079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fb8da-f791-44ae-99d4-b400800d5a4f None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:41.163998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fb8da-f791-44ae-99d4-b400800d5a4f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:41.163998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fb8da-f791-44ae-99d4-b400800d5a4f None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:41.165736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 596/1186] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:58:41.171973 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8708b-6345-47b6-a65d-4ecfc90f69b7 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:41.172574 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8708b-6345-47b6-a65d-4ecfc90f69b7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:41.172574 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8708b-6345-47b6-a65d-4ecfc90f69b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:41.193727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-07d8708b-6345-47b6-a65d-4ecfc90f69b7 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:58:41.195040 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-07d8708b-6345-47b6-a65d-4ecfc90f69b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:58:41.276459 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 591/1187] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:58:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:58:41.301189 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fb8da-f791-44ae-99d4-b400800d5a4f None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:41.414558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:41.429090 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fb8da-f791-44ae-99d4-b400800d5a4f None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:41.471523 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7fae1-ae75-42ff-8af4-c15ed2a1054d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:41.472265 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7fae1-ae75-42ff-8af4-c15ed2a1054d None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:41.472591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7fae1-ae75-42ff-8af4-c15ed2a1054d None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:41.472986 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7fae1-ae75-42ff-8af4-c15ed2a1054d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:41.486598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7fae1-ae75-42ff-8af4-c15ed2a1054d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-26d7fae1-ae75-42ff-8af4-c15ed2a1054d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:58:41.492108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:58:41.495033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:58:41.497060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:58:41.497060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:58:41.497060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:58:41.497060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:58:41.497060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:58:41.497060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:58:41.497060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:58:41.497060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:58:41.497060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:58:41.497060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:58:41.497060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:58:41.497060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 14:58:41.497060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 597/1188] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:58:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:58:41.501440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8708b-6345-47b6-a65d-4ecfc90f69b7 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:41.522414 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:41.640968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8708b-6345-47b6-a65d-4ecfc90f69b7 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:41.683197 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da8e57-5a4c-489c-8134-2f95f941e3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:41.683872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da8e57-5a4c-489c-8134-2f95f941e3aa None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:41.684197 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da8e57-5a4c-489c-8134-2f95f941e3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:41.684515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da8e57-5a4c-489c-8134-2f95f941e3aa None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:41.685578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da8e57-5a4c-489c-8134-2f95f941e3aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:58:41.685937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da8e57-5a4c-489c-8134-2f95f941e3aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:41.687441 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da8e57-5a4c-489c-8134-2f95f941e3aa None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:41.697607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 592/1189] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:58:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:41.704011 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7fae1-ae75-42ff-8af4-c15ed2a1054d None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:41.841989 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7fae1-ae75-42ff-8af4-c15ed2a1054d None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:41.887250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f37889-1b4d-45c4-b80e-7337e3bedf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:41.887993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f37889-1b4d-45c4-b80e-7337e3bedf08 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:41.888321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f37889-1b4d-45c4-b80e-7337e3bedf08 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:41.888641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f37889-1b4d-45c4-b80e-7337e3bedf08 None admin] PATH_INFO: `/v3/users/e9e388085f6142128b05c798c6492b8d` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:41.890006 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f37889-1b4d-45c4-b80e-7337e3bedf08 None admin] RBAC: Authorizing `identity:get_user(user_id=e9e388085f6142128b05c798c6492b8d)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:41.891723 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f37889-1b4d-45c4-b80e-7337e3bedf08 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:41.893460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 598/1190] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:58:41 2022] GET /identity/v3/users/e9e388085f6142128b05c798c6492b8d => generated 311 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:58:41.900573 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da8e57-5a4c-489c-8134-2f95f941e3aa None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:42.003798 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:42.051808 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da8e57-5a4c-489c-8134-2f95f941e3aa None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:42.117656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3ab12-e108-49d3-8b44-e33c93cea563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:42.118831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3ab12-e108-49d3-8b44-e33c93cea563 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:42.119333 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3ab12-e108-49d3-8b44-e33c93cea563 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:42.119824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3ab12-e108-49d3-8b44-e33c93cea563 None admin] PATH_INFO: `/v3/projects/036ca8828fff4392a32c0b42e58d9c45` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:42.122057 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3ab12-e108-49d3-8b44-e33c93cea563 None admin] RBAC: Authorizing `identity:get_project(project_id=036ca8828fff4392a32c0b42e58d9c45)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:42.124871 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3ab12-e108-49d3-8b44-e33c93cea563 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:42.128404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 593/1191] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:58:41 2022] GET /identity/v3/projects/036ca8828fff4392a32c0b42e58d9c45 => generated 361 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:42.136261 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f37889-1b4d-45c4-b80e-7337e3bedf08 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:42.163174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:42.284245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f37889-1b4d-45c4-b80e-7337e3bedf08 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:42.330696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c695a6-5e5b-46e3-bfd0-083e39231030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:42.331533 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c695a6-5e5b-46e3-bfd0-083e39231030 None admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:42.331910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c695a6-5e5b-46e3-bfd0-083e39231030 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:42.332291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c695a6-5e5b-46e3-bfd0-083e39231030 None admin] PATH_INFO: `/v3/projects/036ca8828fff4392a32c0b42e58d9c45/users/e9e388085f6142128b05c798c6492b8d/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:42.335140 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c695a6-5e5b-46e3-bfd0-083e39231030 None admin] RBAC: Authorizing `identity:create_grant(project_id=036ca8828fff4392a32c0b42e58d9c45, user_id=e9e388085f6142128b05c798c6492b8d, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:42.339045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c695a6-5e5b-46e3-bfd0-083e39231030 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:42.431619 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 599/1192] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 14:58:42 2022] PUT /identity/v3/projects/036ca8828fff4392a32c0b42e58d9c45/users/e9e388085f6142128b05c798c6492b8d/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:58:45.044478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84b96d-6308-49b6-a0bc-f70bc583afb9 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:45.045120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84b96d-6308-49b6-a0bc-f70bc583afb9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:45.045120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84b96d-6308-49b6-a0bc-f70bc583afb9 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:45.046724 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 594/1193] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 14:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:58:45.053296 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a98671-a8e9-4b81-b413-cf3e53a0363a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:45.054039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a98671-a8e9-4b81-b413-cf3e53a0363a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:45.054039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a98671-a8e9-4b81-b413-cf3e53a0363a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:45.075591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-f0a98671-a8e9-4b81-b413-cf3e53a0363a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:58:45.076957 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f0a98671-a8e9-4b81-b413-cf3e53a0363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:58:45.192279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 600/1194] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 14:58:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:58:45.221032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84b96d-6308-49b6-a0bc-f70bc583afb9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:45.377594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84b96d-6308-49b6-a0bc-f70bc583afb9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:45.427053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f22d4e-435a-4469-a3e3-d0a688fba790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:45.427896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f22d4e-435a-4469-a3e3-d0a688fba790 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:45.428278 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f22d4e-435a-4469-a3e3-d0a688fba790 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:45.428648 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f22d4e-435a-4469-a3e3-d0a688fba790 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:45.443799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:45.445216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f22d4e-435a-4469-a3e3-d0a688fba790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-94f22d4e-435a-4469-a3e3-d0a688fba790 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:58:45.450971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:58:45.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:58:45.458657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:58:45.458657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:58:45.458657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:58:45.458657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:58:45.458657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:58:45.458657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:58:45.458657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:58:45.458657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:58:45.458657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:58:45.458657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:58:45.458657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:58:45.458657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 14:58:45.458657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 595/1195] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 14:58:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:58:45.460969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a98671-a8e9-4b81-b413-cf3e53a0363a None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:45.473046 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:45.608020 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a98671-a8e9-4b81-b413-cf3e53a0363a None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:45.654580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd62b87-e108-4a49-b26f-0959cd9c7d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:45.655649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd62b87-e108-4a49-b26f-0959cd9c7d04 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:45.656000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd62b87-e108-4a49-b26f-0959cd9c7d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:45.656282 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd62b87-e108-4a49-b26f-0959cd9c7d04 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:45.657386 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd62b87-e108-4a49-b26f-0959cd9c7d04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:58:45.657938 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd62b87-e108-4a49-b26f-0959cd9c7d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:45.660546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd62b87-e108-4a49-b26f-0959cd9c7d04 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:45.673737 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 601/1196] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 14:58:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:45.681466 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f22d4e-435a-4469-a3e3-d0a688fba790 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:45.854791 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f22d4e-435a-4469-a3e3-d0a688fba790 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:45.916803 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74853e53-7737-4187-8141-c0f9d080974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:45.917875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74853e53-7737-4187-8141-c0f9d080974d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:45.918419 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74853e53-7737-4187-8141-c0f9d080974d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:45.918937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74853e53-7737-4187-8141-c0f9d080974d None admin] PATH_INFO: `/v3/users/e9e388085f6142128b05c798c6492b8d` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:45.921304 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74853e53-7737-4187-8141-c0f9d080974d None admin] RBAC: Authorizing `identity:get_user(user_id=e9e388085f6142128b05c798c6492b8d)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:45.924264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74853e53-7737-4187-8141-c0f9d080974d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:45.934953 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 596/1197] 10.222.0.98 () {56 vars in 1177 bytes} [Tue Jul 26 14:58:45 2022] GET /identity/v3/users/e9e388085f6142128b05c798c6492b8d => generated 311 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:45.944466 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd62b87-e108-4a49-b26f-0959cd9c7d04 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:46.047943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:46.090875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd62b87-e108-4a49-b26f-0959cd9c7d04 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:46.133098 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda10f97-2b2b-48af-9853-9ef3dd616256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:46.134440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda10f97-2b2b-48af-9853-9ef3dd616256 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:46.135196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda10f97-2b2b-48af-9853-9ef3dd616256 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:46.135196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda10f97-2b2b-48af-9853-9ef3dd616256 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:46.237068 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda10f97-2b2b-48af-9853-9ef3dd616256 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:46.238641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda10f97-2b2b-48af-9853-9ef3dd616256 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:46.329863 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:46.383173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 602/1198] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 14:58:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:58:46.395089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74853e53-7737-4187-8141-c0f9d080974d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:46.501722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:46.555272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74853e53-7737-4187-8141-c0f9d080974d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:46.621331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5439d-5ead-49aa-9f53-7714365d4625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:46.621998 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5439d-5ead-49aa-9f53-7714365d4625 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:46.622324 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5439d-5ead-49aa-9f53-7714365d4625 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:46.622700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5439d-5ead-49aa-9f53-7714365d4625 None admin] PATH_INFO: `/v3/projects/036ca8828fff4392a32c0b42e58d9c45` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:46.624418 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5439d-5ead-49aa-9f53-7714365d4625 None admin] RBAC: Authorizing `identity:get_project(project_id=036ca8828fff4392a32c0b42e58d9c45)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:46.628691 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5439d-5ead-49aa-9f53-7714365d4625 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:46.628691 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 597/1199] 10.222.0.98 () {56 vars in 1186 bytes} [Tue Jul 26 14:58:46 2022] GET /identity/v3/projects/036ca8828fff4392a32c0b42e58d9c45 => generated 361 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:58:46.636017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda10f97-2b2b-48af-9853-9ef3dd616256 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:58:46.803565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda10f97-2b2b-48af-9853-9ef3dd616256 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:58:46.873572 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaf248-b638-42b5-a5bb-bad045c21c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:58:46.874703 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaf248-b638-42b5-a5bb-bad045c21c16 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:58:46.875219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaf248-b638-42b5-a5bb-bad045c21c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:58:46.875698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaf248-b638-42b5-a5bb-bad045c21c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:58:46.877259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaf248-b638-42b5-a5bb-bad045c21c16 None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=036ca8828fff4392a32c0b42e58d9c45, user.id=e9e388085f6142128b05c798c6492b8d) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:58:46.877952 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaf248-b638-42b5-a5bb-bad045c21c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:58:46.880627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaf248-b638-42b5-a5bb-bad045c21c16 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:58:46.893533 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 603/1200] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 14:58:46 2022] GET /identity/v3/role_assignments?user.id=e9e388085f6142128b05c798c6492b8d&scope.project.id=036ca8828fff4392a32c0b42e58d9c45&role.id=17054492864541709fda49dbf677a7a2 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:58:56.612681 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=32 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:56.888146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=84 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:18.534943 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fa255-a013-434f-a922-d39067a90729 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:18.535543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fa255-a013-434f-a922-d39067a90729 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:18.535543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fa255-a013-434f-a922-d39067a90729 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:18.537738 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 598/1201] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:00:18.544572 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bdddb-7e8f-4779-b6f0-a86b6705935f None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:18.545328 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bdddb-7e8f-4779-b6f0-a86b6705935f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:18.545328 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bdddb-7e8f-4779-b6f0-a86b6705935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:18.568603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d91bdddb-7e8f-4779-b6f0-a86b6705935f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:18.569845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d91bdddb-7e8f-4779-b6f0-a86b6705935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:18.649046 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 604/1202] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:00:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:00:18.675599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fa255-a013-434f-a922-d39067a90729 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:18.796292 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fa255-a013-434f-a922-d39067a90729 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:18.836037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a209d-1139-4613-b826-c70b13736a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:18.836702 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a209d-1139-4613-b826-c70b13736a1b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:18.836991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a209d-1139-4613-b826-c70b13736a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:18.837297 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a209d-1139-4613-b826-c70b13736a1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:18.849533 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a209d-1139-4613-b826-c70b13736a1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:18.851166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a209d-1139-4613-b826-c70b13736a1b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:18.867735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-f80a209d-1139-4613-b826-c70b13736a1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:18.867735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:18.867735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:18.867735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:18.867735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:18.867735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:18.867735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:18.867735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:18.867735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:18.867735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:18.867735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:18.867735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:18.867735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:00:18.867735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:00:18.867735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:18.869207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:18.870327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:00:18.870327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:00:18.870327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:18.870327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:18.870327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 599/1203] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:18.877545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bdddb-7e8f-4779-b6f0-a86b6705935f None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:19.007583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bdddb-7e8f-4779-b6f0-a86b6705935f None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:19.041186 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:19.047324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e28673-8cf2-4062-9712-efc1e54e4c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:19.047873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e28673-8cf2-4062-9712-efc1e54e4c02 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:19.048156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e28673-8cf2-4062-9712-efc1e54e4c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:19.048429 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e28673-8cf2-4062-9712-efc1e54e4c02 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:19.049126 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e28673-8cf2-4062-9712-efc1e54e4c02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:19.049432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e28673-8cf2-4062-9712-efc1e54e4c02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:19.050851 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e28673-8cf2-4062-9712-efc1e54e4c02 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:19.063693 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 605/1204] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 15:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:19.069766 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a209d-1139-4613-b826-c70b13736a1b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:19.133023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:19.208231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a209d-1139-4613-b826-c70b13736a1b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:19.268822 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba4a0d-519a-4ad3-a721-72d5549ff7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:19.269476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba4a0d-519a-4ad3-a721-72d5549ff7df None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:19.269760 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba4a0d-519a-4ad3-a721-72d5549ff7df None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:19.270031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba4a0d-519a-4ad3-a721-72d5549ff7df None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:19.270780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba4a0d-519a-4ad3-a721-72d5549ff7df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:19.272235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba4a0d-519a-4ad3-a721-72d5549ff7df None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:19.409552 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 600/1205] 10.222.0.98 () {60 vars in 1132 bytes} [Tue Jul 26 15:00:19 2022] POST /identity/v3/users => generated 251 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:21.645009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e016f-a043-4ddb-9839-2ae08fd08e70 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:21.645600 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e016f-a043-4ddb-9839-2ae08fd08e70 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:21.645600 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e016f-a043-4ddb-9839-2ae08fd08e70 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:21.647022 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 606/1206] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:00:21.656107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063c24e-309d-4b48-b4fc-94a6cc41467b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:21.657180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063c24e-309d-4b48-b4fc-94a6cc41467b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:21.657180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063c24e-309d-4b48-b4fc-94a6cc41467b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:21.679275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2063c24e-309d-4b48-b4fc-94a6cc41467b None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:21.680643 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2063c24e-309d-4b48-b4fc-94a6cc41467b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:21.797190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 601/1207] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:00:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:00:21.825404 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e016f-a043-4ddb-9839-2ae08fd08e70 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:22.003498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e016f-a043-4ddb-9839-2ae08fd08e70 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:22.049780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4fd44-b1f9-4f27-92a1-a7478194d71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:22.050550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4fd44-b1f9-4f27-92a1-a7478194d71a None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:22.050933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4fd44-b1f9-4f27-92a1-a7478194d71a None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:22.051332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4fd44-b1f9-4f27-92a1-a7478194d71a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:22.065973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4fd44-b1f9-4f27-92a1-a7478194d71a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-ace4fd44-b1f9-4f27-92a1-a7478194d71a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:00:22.071248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:22.073299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:22.075241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:22.075241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:22.075241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:22.075241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:22.075241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:00:22.075241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:00:22.075241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:00:22.075241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:00:22.075241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:00:22.075241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:00:22.075241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:00:22.075241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:22.075241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 607/1208] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 15:00:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:22.084272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063c24e-309d-4b48-b4fc-94a6cc41467b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:22.144151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:22.239629 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063c24e-309d-4b48-b4fc-94a6cc41467b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:22.286086 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aec44-241a-485c-ada2-8859f6c68b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:22.286773 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aec44-241a-485c-ada2-8859f6c68b78 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:22.287057 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aec44-241a-485c-ada2-8859f6c68b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:22.287326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aec44-241a-485c-ada2-8859f6c68b78 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:22.288063 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aec44-241a-485c-ada2-8859f6c68b78 None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:22.288364 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aec44-241a-485c-ada2-8859f6c68b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:22.289754 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aec44-241a-485c-ada2-8859f6c68b78 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:22.301805 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 602/1209] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 15:00:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:22.307523 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4fd44-b1f9-4f27-92a1-a7478194d71a None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:22.375542 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:22.442613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4fd44-b1f9-4f27-92a1-a7478194d71a None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:22.485581 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228fb62-20fe-4ac9-bf52-7bc7212cfb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:22.486525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228fb62-20fe-4ac9-bf52-7bc7212cfb91 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:22.486847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228fb62-20fe-4ac9-bf52-7bc7212cfb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:22.487244 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228fb62-20fe-4ac9-bf52-7bc7212cfb91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:22.501548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228fb62-20fe-4ac9-bf52-7bc7212cfb91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:22.503217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228fb62-20fe-4ac9-bf52-7bc7212cfb91 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:22.519576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-5228fb62-20fe-4ac9-bf52-7bc7212cfb91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:22.519576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:22.519576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:22.519576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:22.519576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:22.519576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:22.519576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:22.519576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:22.519576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:22.519576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:22.519576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:22.519576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:22.519576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:00:22.519576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:00:22.519576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:22.521550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:22.527713 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:00:22.527713 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:00:22.527713 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:22.527713 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:22.527713 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 608/1210] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:22.528244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aec44-241a-485c-ada2-8859f6c68b78 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:22.667633 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:22.672685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aec44-241a-485c-ada2-8859f6c68b78 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:22.721037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f4f9f-8cbd-455e-acac-cfc9039b5e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:22.721671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f4f9f-8cbd-455e-acac-cfc9039b5e0a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:22.721948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f4f9f-8cbd-455e-acac-cfc9039b5e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:22.722220 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f4f9f-8cbd-455e-acac-cfc9039b5e0a None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:22.723006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f4f9f-8cbd-455e-acac-cfc9039b5e0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:22.723310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f4f9f-8cbd-455e-acac-cfc9039b5e0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:22.724709 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f4f9f-8cbd-455e-acac-cfc9039b5e0a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:22.739860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 603/1211] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 15:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:22.748928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228fb62-20fe-4ac9-bf52-7bc7212cfb91 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:22.899514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228fb62-20fe-4ac9-bf52-7bc7212cfb91 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:22.902354 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:22.961955 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114abd18-4557-4c16-ab48-3e0a86b90e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:22.962652 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114abd18-4557-4c16-ab48-3e0a86b90e64 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:22.962937 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114abd18-4557-4c16-ab48-3e0a86b90e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:22.963214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114abd18-4557-4c16-ab48-3e0a86b90e64 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:22.974163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114abd18-4557-4c16-ab48-3e0a86b90e64 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:22.979320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114abd18-4557-4c16-ab48-3e0a86b90e64 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-114abd18-4557-4c16-ab48-3e0a86b90e64 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:00:22.997604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:23.000082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:23.002346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:23.002346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:23.002346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:00:23.002346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:00:23.002346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:00:23.002346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:00:23.002346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:00:23.002346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:00:23.002346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:00:23.002346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:23.002346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 609/1212] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:23.007896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f4f9f-8cbd-455e-acac-cfc9039b5e0a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:23.154131 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f4f9f-8cbd-455e-acac-cfc9039b5e0a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:23.202032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbabf01-28ff-40a1-b7b5-8af4bb6bdb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:23.203540 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbabf01-28ff-40a1-b7b5-8af4bb6bdb94 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:23.203826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbabf01-28ff-40a1-b7b5-8af4bb6bdb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:23.204101 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbabf01-28ff-40a1-b7b5-8af4bb6bdb94 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:23.205077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbabf01-28ff-40a1-b7b5-8af4bb6bdb94 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:23.205388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbabf01-28ff-40a1-b7b5-8af4bb6bdb94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:23.206944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbabf01-28ff-40a1-b7b5-8af4bb6bdb94 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:23.237415 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 604/1213] 10.222.0.98 () {56 vars in 1143 bytes} [Tue Jul 26 15:00:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:23.241358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114abd18-4557-4c16-ab48-3e0a86b90e64 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:23.406781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114abd18-4557-4c16-ab48-3e0a86b90e64 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:23.463830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79e38d-57f9-4f8f-bed1-bbfd02b4b853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:23.464608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79e38d-57f9-4f8f-bed1-bbfd02b4b853 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:23.464608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79e38d-57f9-4f8f-bed1-bbfd02b4b853 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:23.465134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79e38d-57f9-4f8f-bed1-bbfd02b4b853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:23.507725 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:23.553033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79e38d-57f9-4f8f-bed1-bbfd02b4b853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:23.554928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79e38d-57f9-4f8f-bed1-bbfd02b4b853 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:23.699362 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 610/1214] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 15:00:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 15:00:23.709510 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbabf01-28ff-40a1-b7b5-8af4bb6bdb94 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:23.736538 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:23.880917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbabf01-28ff-40a1-b7b5-8af4bb6bdb94 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:23.944012 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001d88d-6287-4015-9cca-21332fd30f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:23.945186 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001d88d-6287-4015-9cca-21332fd30f8c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:23.945687 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001d88d-6287-4015-9cca-21332fd30f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:23.946175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001d88d-6287-4015-9cca-21332fd30f8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:23.966917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001d88d-6287-4015-9cca-21332fd30f8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:23.970988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001d88d-6287-4015-9cca-21332fd30f8c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:24.005041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-3001d88d-6287-4015-9cca-21332fd30f8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:24.005041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:24.005041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:24.005041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:24.005041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:24.005041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:24.005041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:24.005041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:24.005041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:24.005041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:24.005041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:24.005041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:24.005041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:00:24.005041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:00:24.005041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:24.007178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:24.009378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:00:24.009378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:00:24.009378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:24.009378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:24.009378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 605/1215] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:24.017723 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79e38d-57f9-4f8f-bed1-bbfd02b4b853 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:24.102135 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:24.161169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79e38d-57f9-4f8f-bed1-bbfd02b4b853 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:24.210313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d78dd-9ddf-4988-9e21-d50a02d4464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:24.210996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d78dd-9ddf-4988-9e21-d50a02d4464b None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:24.211283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d78dd-9ddf-4988-9e21-d50a02d4464b None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:24.211641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d78dd-9ddf-4988-9e21-d50a02d4464b None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:24.212267 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d78dd-9ddf-4988-9e21-d50a02d4464b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:24.212568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d78dd-9ddf-4988-9e21-d50a02d4464b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:24.213979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d78dd-9ddf-4988-9e21-d50a02d4464b None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:24.227192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 611/1216] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 15:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:24.235251 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001d88d-6287-4015-9cca-21332fd30f8c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:24.342348 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:24.387237 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001d88d-6287-4015-9cca-21332fd30f8c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:24.434445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6da3da-e288-4f1d-822d-4a825ec524bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:24.435103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6da3da-e288-4f1d-822d-4a825ec524bf None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:24.435380 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6da3da-e288-4f1d-822d-4a825ec524bf None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:24.435649 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6da3da-e288-4f1d-822d-4a825ec524bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:24.444366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6da3da-e288-4f1d-822d-4a825ec524bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:24.446342 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6da3da-e288-4f1d-822d-4a825ec524bf None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:24.460291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-ac6da3da-e288-4f1d-822d-4a825ec524bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:00:24.460291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:24.460291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:24.460291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:24.460291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:24.460291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:24.460291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:24.460291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:24.460291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:24.460291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:24.460291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:24.460291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:24.460291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:00:24.460291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:00:24.460291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:24.461722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:24.463314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:00:24.463314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:00:24.463314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:00:24.463314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:00:24.463314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:00:24.463314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:00:24.463314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:00:24.463314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:24.463314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 606/1217] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 15:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:00:24.468758 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d78dd-9ddf-4988-9e21-d50a02d4464b None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:24.619669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d78dd-9ddf-4988-9e21-d50a02d4464b None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:24.658449 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:24.681247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4587572-0218-4b4d-8e0e-2918df85132d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:24.682200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4587572-0218-4b4d-8e0e-2918df85132d None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:24.682744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4587572-0218-4b4d-8e0e-2918df85132d None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:24.689193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4587572-0218-4b4d-8e0e-2918df85132d None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:24.689193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4587572-0218-4b4d-8e0e-2918df85132d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:24.689193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4587572-0218-4b4d-8e0e-2918df85132d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:24.689193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4587572-0218-4b4d-8e0e-2918df85132d None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:24.712091 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 612/1218] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 15:00:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:24.719535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6da3da-e288-4f1d-822d-4a825ec524bf None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:24.887291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6da3da-e288-4f1d-822d-4a825ec524bf None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:24.920875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:24.927905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5931981-ea57-4057-9d81-84aa6fef24e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:24.928538 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5931981-ea57-4057-9d81-84aa6fef24e6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:24.928824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5931981-ea57-4057-9d81-84aa6fef24e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:24.929106 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5931981-ea57-4057-9d81-84aa6fef24e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:24.929948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5931981-ea57-4057-9d81-84aa6fef24e6 None admin] RBAC: Adding query filter params (role.id=ce31429587b44a7aafb4f600c011be4a, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=448161cd39dc4a6786c8813faa79376a) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:24.930253 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5931981-ea57-4057-9d81-84aa6fef24e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:24.931743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5931981-ea57-4057-9d81-84aa6fef24e6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:24.938950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 607/1219] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 15:00:24 2022] GET /identity/v3/role_assignments?user.id=448161cd39dc4a6786c8813faa79376a&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=ce31429587b44a7aafb4f600c011be4a => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:27.401603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72d512-8569-42db-9284-dd754c917329 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:27.402490 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72d512-8569-42db-9284-dd754c917329 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:27.402490 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72d512-8569-42db-9284-dd754c917329 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:27.403922 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 613/1220] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:00:27.410555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d47c5-268c-4d56-ba19-8dcc7c6336c9 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:27.411130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d47c5-268c-4d56-ba19-8dcc7c6336c9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:27.411415 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d47c5-268c-4d56-ba19-8dcc7c6336c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:27.433020 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-128d47c5-268c-4d56-ba19-8dcc7c6336c9 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:27.434787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-128d47c5-268c-4d56-ba19-8dcc7c6336c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:27.538032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 608/1221] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:00:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:00:27.570060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72d512-8569-42db-9284-dd754c917329 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:27.729106 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72d512-8569-42db-9284-dd754c917329 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:27.774857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff379697-9af1-41e9-8699-d7f45a46baaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:27.775519 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff379697-9af1-41e9-8699-d7f45a46baaa None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:27.775799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff379697-9af1-41e9-8699-d7f45a46baaa None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:27.776070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff379697-9af1-41e9-8699-d7f45a46baaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:27.791286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff379697-9af1-41e9-8699-d7f45a46baaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-ff379697-9af1-41e9-8699-d7f45a46baaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:00:27.797240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:27.802990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:27.804568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:27.804568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:27.804568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:27.804568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:27.804568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:00:27.804568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:00:27.804568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:00:27.804568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:00:27.804568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:00:27.804568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:00:27.804568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:00:27.804568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:27.804568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 614/1222] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 15:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:27.809505 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d47c5-268c-4d56-ba19-8dcc7c6336c9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:27.970620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d47c5-268c-4d56-ba19-8dcc7c6336c9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:28.013672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:28.028000 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef187e2-bbaf-4356-b76f-6a9b22d14a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:28.028780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef187e2-bbaf-4356-b76f-6a9b22d14a61 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:28.029155 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef187e2-bbaf-4356-b76f-6a9b22d14a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:28.029523 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef187e2-bbaf-4356-b76f-6a9b22d14a61 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:28.030403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef187e2-bbaf-4356-b76f-6a9b22d14a61 None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:28.030811 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef187e2-bbaf-4356-b76f-6a9b22d14a61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:28.032463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef187e2-bbaf-4356-b76f-6a9b22d14a61 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:28.043060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 609/1223] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 15:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:28.050599 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff379697-9af1-41e9-8699-d7f45a46baaa None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:28.104861 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:28.182198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff379697-9af1-41e9-8699-d7f45a46baaa None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:28.225343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c0fcf-ba06-4548-839b-ada342906065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:28.226009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c0fcf-ba06-4548-839b-ada342906065 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:28.226301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c0fcf-ba06-4548-839b-ada342906065 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:28.226614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c0fcf-ba06-4548-839b-ada342906065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:28.240858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c0fcf-ba06-4548-839b-ada342906065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:28.244527 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c0fcf-ba06-4548-839b-ada342906065 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:28.263529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-e37c0fcf-ba06-4548-839b-ada342906065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:28.263529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:28.263529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:28.263529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:28.263529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:28.263529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:28.263529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:28.263529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:28.263529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:28.263529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:28.263529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:28.263529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:28.263529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:00:28.263529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:00:28.263529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:28.270640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:28.271658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:00:28.271658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:00:28.271658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:28.271658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:28.271658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 615/1224] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:00:28.272626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef187e2-bbaf-4356-b76f-6a9b22d14a61 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:28.416189 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef187e2-bbaf-4356-b76f-6a9b22d14a61 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:28.457244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579198cc-47d6-4034-910d-13f9cde6478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:28.457956 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579198cc-47d6-4034-910d-13f9cde6478f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:28.458232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579198cc-47d6-4034-910d-13f9cde6478f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:28.458542 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579198cc-47d6-4034-910d-13f9cde6478f None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:28.459258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579198cc-47d6-4034-910d-13f9cde6478f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:28.459566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579198cc-47d6-4034-910d-13f9cde6478f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:28.460982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579198cc-47d6-4034-910d-13f9cde6478f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:28.476733 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 610/1225] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 15:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:28.484705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c0fcf-ba06-4548-839b-ada342906065 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:28.609698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:28.617063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c0fcf-ba06-4548-839b-ada342906065 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:28.660113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d8b0e-01a1-4d7b-8706-300b2227ee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:28.661037 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d8b0e-01a1-4d7b-8706-300b2227ee69 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:28.661422 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d8b0e-01a1-4d7b-8706-300b2227ee69 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:28.661724 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d8b0e-01a1-4d7b-8706-300b2227ee69 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:28.674323 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d8b0e-01a1-4d7b-8706-300b2227ee69 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:28.676753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d8b0e-01a1-4d7b-8706-300b2227ee69 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-624d8b0e-01a1-4d7b-8706-300b2227ee69 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:00:28.691142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:28.692710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:28.693781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:28.693781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:28.693781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:00:28.693781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:00:28.693781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:00:28.693781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:00:28.693781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:00:28.693781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:00:28.693781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:00:28.693781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:28.693781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 616/1226] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:28.701224 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579198cc-47d6-4034-910d-13f9cde6478f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:28.760068 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:28.840021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579198cc-47d6-4034-910d-13f9cde6478f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:28.896955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cd4d6-392c-45c7-9038-8bd5ecc6d536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:28.897507 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cd4d6-392c-45c7-9038-8bd5ecc6d536 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:28.897789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cd4d6-392c-45c7-9038-8bd5ecc6d536 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:28.898044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cd4d6-392c-45c7-9038-8bd5ecc6d536 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:28.898895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cd4d6-392c-45c7-9038-8bd5ecc6d536 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:28.904272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cd4d6-392c-45c7-9038-8bd5ecc6d536 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:28.904272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cd4d6-392c-45c7-9038-8bd5ecc6d536 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:28.930422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 611/1227] 10.222.0.98 () {56 vars in 1143 bytes} [Tue Jul 26 15:00:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:28.934048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d8b0e-01a1-4d7b-8706-300b2227ee69 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:29.102880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d8b0e-01a1-4d7b-8706-300b2227ee69 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:29.175987 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871593fa-f11e-42c2-b38c-4146dd56aab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:29.177052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871593fa-f11e-42c2-b38c-4146dd56aab7 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:29.177585 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871593fa-f11e-42c2-b38c-4146dd56aab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:29.178074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871593fa-f11e-42c2-b38c-4146dd56aab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:29.204462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871593fa-f11e-42c2-b38c-4146dd56aab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:29.207844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871593fa-f11e-42c2-b38c-4146dd56aab7 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:29.241848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-871593fa-f11e-42c2-b38c-4146dd56aab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:29.241848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:29.241848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:29.241848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:29.241848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:29.241848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:29.241848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:29.241848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:29.241848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:29.241848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:29.241848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:29.241848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:29.241848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:00:29.241848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:00:29.241848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:29.243697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:29.245192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:00:29.245192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:00:29.245192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:29.245192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:29.245192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 617/1228] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:29.251504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cd4d6-392c-45c7-9038-8bd5ecc6d536 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:29.387017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cd4d6-392c-45c7-9038-8bd5ecc6d536 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:29.390522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:29.432890 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a12bd-18d4-4df4-a767-cf001ebd6e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:29.433613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a12bd-18d4-4df4-a767-cf001ebd6e52 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:29.433755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a12bd-18d4-4df4-a767-cf001ebd6e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:29.434038 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a12bd-18d4-4df4-a767-cf001ebd6e52 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:29.434784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a12bd-18d4-4df4-a767-cf001ebd6e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:29.435091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a12bd-18d4-4df4-a767-cf001ebd6e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:29.436509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a12bd-18d4-4df4-a767-cf001ebd6e52 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:29.451568 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 612/1229] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 15:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:29.458234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871593fa-f11e-42c2-b38c-4146dd56aab7 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:29.470064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:29.582579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871593fa-f11e-42c2-b38c-4146dd56aab7 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:29.622008 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071cc91-c793-4ede-95e5-21fc6cf618af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:29.622692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071cc91-c793-4ede-95e5-21fc6cf618af None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:29.622981 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071cc91-c793-4ede-95e5-21fc6cf618af None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:29.623258 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071cc91-c793-4ede-95e5-21fc6cf618af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:29.632169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071cc91-c793-4ede-95e5-21fc6cf618af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:29.633653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071cc91-c793-4ede-95e5-21fc6cf618af None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:29.647760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-5071cc91-c793-4ede-95e5-21fc6cf618af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:00:29.647760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:29.647760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:29.647760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:29.647760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:29.647760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:29.647760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:29.647760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:29.647760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:29.647760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:29.647760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:29.647760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:29.647760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:00:29.647760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:00:29.647760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:29.648947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:29.650078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:00:29.650078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:00:29.650078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:00:29.650078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:00:29.650078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:00:29.650078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:00:29.650078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:00:29.650078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:29.650078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 618/1230] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 15:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:29.656511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a12bd-18d4-4df4-a767-cf001ebd6e52 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:29.781515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a12bd-18d4-4df4-a767-cf001ebd6e52 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:29.839107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7f7ca-b3b1-40a3-a668-a70ca708ec0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:29.840146 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7f7ca-b3b1-40a3-a668-a70ca708ec0c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:29.840769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7f7ca-b3b1-40a3-a668-a70ca708ec0c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:29.841262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7f7ca-b3b1-40a3-a668-a70ca708ec0c None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:29.842753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7f7ca-b3b1-40a3-a668-a70ca708ec0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:29.844742 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7f7ca-b3b1-40a3-a668-a70ca708ec0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:29.847573 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7f7ca-b3b1-40a3-a668-a70ca708ec0c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:29.866136 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 613/1231] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 15:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:29.875051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071cc91-c793-4ede-95e5-21fc6cf618af None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:29.966020 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:30.011340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071cc91-c793-4ede-95e5-21fc6cf618af None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:30.054695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bc3ae-12c1-4667-af97-5af349eaca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:30.055361 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bc3ae-12c1-4667-af97-5af349eaca08 None admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:30.055707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bc3ae-12c1-4667-af97-5af349eaca08 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:30.056036 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bc3ae-12c1-4667-af97-5af349eaca08 None admin] PATH_INFO: `/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/448161cd39dc4a6786c8813faa79376a/roles/ce31429587b44a7aafb4f600c011be4a` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:30.082765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bc3ae-12c1-4667-af97-5af349eaca08 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f750777b75f49a19a5019c4fc2c00f5, user_id=448161cd39dc4a6786c8813faa79376a, role_id=ce31429587b44a7aafb4f600c011be4a)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:30.084299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bc3ae-12c1-4667-af97-5af349eaca08 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:30.492946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 619/1232] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 15:00:29 2022] PUT /identity/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/448161cd39dc4a6786c8813faa79376a/roles/ce31429587b44a7aafb4f600c011be4a => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:32.640841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fa944-7baa-4dd0-a7d7-317b4d86c8fa None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:32.642049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fa944-7baa-4dd0-a7d7-317b4d86c8fa None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:32.642049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fa944-7baa-4dd0-a7d7-317b4d86c8fa None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:32.643156 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 614/1233] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:00:32.649459 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25a5a8-1604-4c25-b578-a4f008f7b287 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:32.650026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25a5a8-1604-4c25-b578-a4f008f7b287 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:32.650026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25a5a8-1604-4c25-b578-a4f008f7b287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:32.671986 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-2b25a5a8-1604-4c25-b578-a4f008f7b287 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:32.673678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2b25a5a8-1604-4c25-b578-a4f008f7b287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:32.763197 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 620/1234] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:00:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:00:32.787304 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fa944-7baa-4dd0-a7d7-317b4d86c8fa None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:32.819662 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:32.951347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fa944-7baa-4dd0-a7d7-317b4d86c8fa None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:32.993754 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc5d6d-890f-4bda-82b2-47e91d703c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:32.994455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc5d6d-890f-4bda-82b2-47e91d703c48 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:32.994742 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc5d6d-890f-4bda-82b2-47e91d703c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:32.995102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc5d6d-890f-4bda-82b2-47e91d703c48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:33.008674 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc5d6d-890f-4bda-82b2-47e91d703c48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-3ebc5d6d-890f-4bda-82b2-47e91d703c48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:00:33.013789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:33.015638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:33.017331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:33.017331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:33.017331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:33.017331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:33.017331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:00:33.017331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:00:33.017331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:00:33.017331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:00:33.017331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:00:33.017331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:00:33.017331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:00:33.017331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:33.017331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 615/1235] 10.222.0.98 () {56 vars in 1102 bytes} [Tue Jul 26 15:00:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:00:33.025451 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25a5a8-1604-4c25-b578-a4f008f7b287 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:33.112382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:33.210681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25a5a8-1604-4c25-b578-a4f008f7b287 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:33.276487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42a890-07f7-4cbe-90b3-dd81d0b178ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:33.277612 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42a890-07f7-4cbe-90b3-dd81d0b178ad None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:33.278152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42a890-07f7-4cbe-90b3-dd81d0b178ad None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:33.278467 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42a890-07f7-4cbe-90b3-dd81d0b178ad None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:33.279811 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42a890-07f7-4cbe-90b3-dd81d0b178ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:33.280357 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42a890-07f7-4cbe-90b3-dd81d0b178ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:33.282974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42a890-07f7-4cbe-90b3-dd81d0b178ad None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:33.295317 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 621/1236] 10.222.0.98 () {56 vars in 1103 bytes} [Tue Jul 26 15:00:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:33.302494 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc5d6d-890f-4bda-82b2-47e91d703c48 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:33.424635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:33.445071 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc5d6d-890f-4bda-82b2-47e91d703c48 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:33.500776 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a08b9-9c24-4c60-9481-d60b34a1cb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:33.501490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a08b9-9c24-4c60-9481-d60b34a1cb87 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:33.501815 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a08b9-9c24-4c60-9481-d60b34a1cb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:33.502134 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a08b9-9c24-4c60-9481-d60b34a1cb87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:33.514303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a08b9-9c24-4c60-9481-d60b34a1cb87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:33.516523 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a08b9-9c24-4c60-9481-d60b34a1cb87 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:33.538672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-5c5a08b9-9c24-4c60-9481-d60b34a1cb87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:33.538672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:33.538672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:33.538672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:33.538672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:33.538672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:33.538672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:33.538672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:33.538672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:33.538672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:33.538672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:33.538672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:33.538672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:00:33.538672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:00:33.538672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:33.540409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:33.542008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:00:33.542008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:00:33.542008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:33.542008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:33.542008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 616/1237] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:00:33.543522 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42a890-07f7-4cbe-90b3-dd81d0b178ad None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:33.717786 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42a890-07f7-4cbe-90b3-dd81d0b178ad None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:33.729487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:33.760909 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daa2e6-edd0-48f0-acc1-bd842b7d962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:33.761571 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daa2e6-edd0-48f0-acc1-bd842b7d962c None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:33.761837 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daa2e6-edd0-48f0-acc1-bd842b7d962c None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:33.762151 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daa2e6-edd0-48f0-acc1-bd842b7d962c None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:33.762901 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19daa2e6-edd0-48f0-acc1-bd842b7d962c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:33.763209 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19daa2e6-edd0-48f0-acc1-bd842b7d962c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:33.764606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19daa2e6-edd0-48f0-acc1-bd842b7d962c None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:33.781133 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 622/1238] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 15:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:33.788409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a08b9-9c24-4c60-9481-d60b34a1cb87 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:33.924034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a08b9-9c24-4c60-9481-d60b34a1cb87 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:33.967613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723c682-fe8e-49d2-b97f-bcb8da92c9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:33.968102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723c682-fe8e-49d2-b97f-bcb8da92c9cc None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:33.969111 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723c682-fe8e-49d2-b97f-bcb8da92c9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:33.969664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723c682-fe8e-49d2-b97f-bcb8da92c9cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:33.973203 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:33.979461 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723c682-fe8e-49d2-b97f-bcb8da92c9cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:33.980984 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723c682-fe8e-49d2-b97f-bcb8da92c9cc None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-b723c682-fe8e-49d2-b97f-bcb8da92c9cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:00:33.998190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:33.999566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:34.000924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:34.000924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:34.000924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:00:34.000924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:00:34.000924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:00:34.000924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:00:34.000924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:00:34.000924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:00:34.000924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:00:34.000924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:34.000924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 617/1239] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:34.006231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daa2e6-edd0-48f0-acc1-bd842b7d962c None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:34.143356 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daa2e6-edd0-48f0-acc1-bd842b7d962c None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:34.187189 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfcf50-f6e5-4660-890a-f2d6c6b2ab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:34.187750 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcf50-f6e5-4660-890a-f2d6c6b2ab04 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:34.188116 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcf50-f6e5-4660-890a-f2d6c6b2ab04 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:34.188398 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcf50-f6e5-4660-890a-f2d6c6b2ab04 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:34.189232 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfcf50-f6e5-4660-890a-f2d6c6b2ab04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:34.189546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfcf50-f6e5-4660-890a-f2d6c6b2ab04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:34.191057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfcf50-f6e5-4660-890a-f2d6c6b2ab04 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:34.223050 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 623/1240] 10.222.0.98 () {56 vars in 1143 bytes} [Tue Jul 26 15:00:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:34.229453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723c682-fe8e-49d2-b97f-bcb8da92c9cc None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:34.354616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723c682-fe8e-49d2-b97f-bcb8da92c9cc None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:34.396410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e3e7d-9094-42da-bda1-56614db68a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:34.397050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e3e7d-9094-42da-bda1-56614db68a6a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:34.397334 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e3e7d-9094-42da-bda1-56614db68a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:34.397612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e3e7d-9094-42da-bda1-56614db68a6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:34.507172 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:34.520525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e3e7d-9094-42da-bda1-56614db68a6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:34.523522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e3e7d-9094-42da-bda1-56614db68a6a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:34.653161 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 618/1241] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 15:00:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 15:00:34.661206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfcf50-f6e5-4660-890a-f2d6c6b2ab04 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:34.696446 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:34.787601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfcf50-f6e5-4660-890a-f2d6c6b2ab04 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:34.827104 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cba9c6-56a2-48e9-a74d-5cbd48a9b47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:34.828790 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cba9c6-56a2-48e9-a74d-5cbd48a9b47e None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:34.829285 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cba9c6-56a2-48e9-a74d-5cbd48a9b47e None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:34.829717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cba9c6-56a2-48e9-a74d-5cbd48a9b47e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:34.842284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cba9c6-56a2-48e9-a74d-5cbd48a9b47e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:34.844812 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cba9c6-56a2-48e9-a74d-5cbd48a9b47e None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:34.863983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-61cba9c6-56a2-48e9-a74d-5cbd48a9b47e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:34.863983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:34.863983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:34.863983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:34.863983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:34.863983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:34.863983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:34.863983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:34.863983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:34.863983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:34.863983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:34.863983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:34.863983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:00:34.863983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:00:34.863983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:34.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:34.867706 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:00:34.867706 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:00:34.867706 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:34.867706 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:34.867706 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 624/1242] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:34.874185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e3e7d-9094-42da-bda1-56614db68a6a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:35.020794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:35.028350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e3e7d-9094-42da-bda1-56614db68a6a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:35.088317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0b5ba-20b5-453c-a400-a0ce72fc7858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:35.088317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0b5ba-20b5-453c-a400-a0ce72fc7858 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:35.088317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0b5ba-20b5-453c-a400-a0ce72fc7858 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:35.088317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0b5ba-20b5-453c-a400-a0ce72fc7858 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:35.088744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0b5ba-20b5-453c-a400-a0ce72fc7858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:35.088744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0b5ba-20b5-453c-a400-a0ce72fc7858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:35.088744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0b5ba-20b5-453c-a400-a0ce72fc7858 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:35.104326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 619/1243] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 15:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:35.112022 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cba9c6-56a2-48e9-a74d-5cbd48a9b47e None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:35.221390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:35.255817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cba9c6-56a2-48e9-a74d-5cbd48a9b47e None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:35.305596 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9db8a5-483c-4aeb-b6c8-a16856a7d366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:35.306309 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9db8a5-483c-4aeb-b6c8-a16856a7d366 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:35.306676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9db8a5-483c-4aeb-b6c8-a16856a7d366 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:35.306998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9db8a5-483c-4aeb-b6c8-a16856a7d366 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:35.316382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9db8a5-483c-4aeb-b6c8-a16856a7d366 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:35.317960 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9db8a5-483c-4aeb-b6c8-a16856a7d366 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:35.332482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-7a9db8a5-483c-4aeb-b6c8-a16856a7d366 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:00:35.332482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:35.332482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:35.332482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:35.332482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:35.332482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:35.332482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:35.332482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:35.332482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:35.332482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:35.332482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:35.332482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:35.332482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:00:35.332482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:00:35.332482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:35.334473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:35.335487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:00:35.335487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:00:35.335487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:00:35.335487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:00:35.335487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:00:35.335487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:00:35.335487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:00:35.335487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:35.335487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 625/1244] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 15:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:35.351265 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0b5ba-20b5-453c-a400-a0ce72fc7858 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:35.527598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0b5ba-20b5-453c-a400-a0ce72fc7858 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:35.585128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8e702-1ab6-4e17-a18d-00bf339c9923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:35.586190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8e702-1ab6-4e17-a18d-00bf339c9923 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:35.586398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8e702-1ab6-4e17-a18d-00bf339c9923 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:35.586662 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8e702-1ab6-4e17-a18d-00bf339c9923 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:35.587588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8e702-1ab6-4e17-a18d-00bf339c9923 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:35.587916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8e702-1ab6-4e17-a18d-00bf339c9923 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:35.590194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8e702-1ab6-4e17-a18d-00bf339c9923 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:35.611257 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 620/1245] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 15:00:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:35.620401 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9db8a5-483c-4aeb-b6c8-a16856a7d366 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:35.765586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9db8a5-483c-4aeb-b6c8-a16856a7d366 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:35.805083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c7209-35c1-4728-b0b6-d55b036df436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:35.806070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c7209-35c1-4728-b0b6-d55b036df436 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:35.806070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c7209-35c1-4728-b0b6-d55b036df436 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:35.806305 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c7209-35c1-4728-b0b6-d55b036df436 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:35.807182 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c7209-35c1-4728-b0b6-d55b036df436 None admin] RBAC: Adding query filter params (role.id=ce31429587b44a7aafb4f600c011be4a, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=448161cd39dc4a6786c8813faa79376a) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:35.807504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c7209-35c1-4728-b0b6-d55b036df436 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:35.808971 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c7209-35c1-4728-b0b6-d55b036df436 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:35.816133 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 626/1246] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 15:00:35 2022] GET /identity/v3/role_assignments?user.id=448161cd39dc4a6786c8813faa79376a&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=ce31429587b44a7aafb4f600c011be4a => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:38.043949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b63606-7598-4e94-aee5-c4d32a84489f None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.044590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b63606-7598-4e94-aee5-c4d32a84489f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.044590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b63606-7598-4e94-aee5-c4d32a84489f None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.046006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 621/1247] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:00:38.056276 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242b3e9-996d-4cfe-92ca-8e879b7a777d None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.057192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242b3e9-996d-4cfe-92ca-8e879b7a777d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.057192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242b3e9-996d-4cfe-92ca-8e879b7a777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.064833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:38.082514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a242b3e9-996d-4cfe-92ca-8e879b7a777d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:38.084828 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a242b3e9-996d-4cfe-92ca-8e879b7a777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:38.211385 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 627/1248] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:00:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:00:38.236657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b63606-7598-4e94-aee5-c4d32a84489f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:38.276021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:38.397734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b63606-7598-4e94-aee5-c4d32a84489f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:38.450138 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8527b0-66d9-48e1-b4cc-b3a8cbac874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:38.450875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8527b0-66d9-48e1-b4cc-b3a8cbac874e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.451207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8527b0-66d9-48e1-b4cc-b3a8cbac874e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.451575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8527b0-66d9-48e1-b4cc-b3a8cbac874e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.465858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8527b0-66d9-48e1-b4cc-b3a8cbac874e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-eb8527b0-66d9-48e1-b4cc-b3a8cbac874e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:00:38.471235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:38.475851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:38.477302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:38.477302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:38.477302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:38.477302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:38.477302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:00:38.477302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:00:38.477302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:00:38.477302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:00:38.477302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:00:38.477302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:00:38.477302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:00:38.477302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:38.477302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 622/1249] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 15:00:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:00:38.479622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242b3e9-996d-4cfe-92ca-8e879b7a777d None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:38.615861 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242b3e9-996d-4cfe-92ca-8e879b7a777d None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:38.661999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:38.667537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdc8b2-e28b-43dc-a9dd-62702bfc0382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:38.668237 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdc8b2-e28b-43dc-a9dd-62702bfc0382 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.668573 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdc8b2-e28b-43dc-a9dd-62702bfc0382 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.669047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdc8b2-e28b-43dc-a9dd-62702bfc0382 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.670055 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdc8b2-e28b-43dc-a9dd-62702bfc0382 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:38.670694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdc8b2-e28b-43dc-a9dd-62702bfc0382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:38.673685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdc8b2-e28b-43dc-a9dd-62702bfc0382 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:38.690848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 628/1250] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 15:00:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:38.699911 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8527b0-66d9-48e1-b4cc-b3a8cbac874e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:38.825272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:38.859685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8527b0-66d9-48e1-b4cc-b3a8cbac874e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:38.920796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510b9b9-90df-4e81-a0a6-2214dc6912c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:38.923464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510b9b9-90df-4e81-a0a6-2214dc6912c8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.923960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510b9b9-90df-4e81-a0a6-2214dc6912c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.924451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510b9b9-90df-4e81-a0a6-2214dc6912c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.947473 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510b9b9-90df-4e81-a0a6-2214dc6912c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:38.950428 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510b9b9-90df-4e81-a0a6-2214dc6912c8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:38.984650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-b510b9b9-90df-4e81-a0a6-2214dc6912c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:38.984650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:38.984650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:38.984650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:38.984650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:38.984650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:38.984650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:38.984650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:38.984650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:38.984650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:38.984650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:38.984650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:38.984650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:00:38.984650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:00:38.984650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:38.986167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:38.987640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:00:38.987640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:00:38.987640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:38.987640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:38.987640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 623/1251] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:38.995465 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdc8b2-e28b-43dc-a9dd-62702bfc0382 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:39.142743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdc8b2-e28b-43dc-a9dd-62702bfc0382 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:39.184665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb3bd5-b7ac-4471-be50-68f731a19ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:39.185267 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb3bd5-b7ac-4471-be50-68f731a19ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.185593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb3bd5-b7ac-4471-be50-68f731a19ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.185946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb3bd5-b7ac-4471-be50-68f731a19ef0 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:39.186754 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb3bd5-b7ac-4471-be50-68f731a19ef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:39.187423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb3bd5-b7ac-4471-be50-68f731a19ef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:39.189119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb3bd5-b7ac-4471-be50-68f731a19ef0 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:39.203614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 629/1252] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 15:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:39.211499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510b9b9-90df-4e81-a0a6-2214dc6912c8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:39.404490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510b9b9-90df-4e81-a0a6-2214dc6912c8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:39.446323 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:39.457623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a61e43-d8ba-47b5-908e-1d0102a01bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:39.458336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a61e43-d8ba-47b5-908e-1d0102a01bdb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.458719 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a61e43-d8ba-47b5-908e-1d0102a01bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.459039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a61e43-d8ba-47b5-908e-1d0102a01bdb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:39.468036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a61e43-d8ba-47b5-908e-1d0102a01bdb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:39.470563 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a61e43-d8ba-47b5-908e-1d0102a01bdb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-26a61e43-d8ba-47b5-908e-1d0102a01bdb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:00:39.484084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:39.486897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:39.488347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:39.488347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:39.488347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:00:39.488347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:00:39.488347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:00:39.488347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:00:39.488347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:00:39.488347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:00:39.488347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:00:39.488347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:39.488347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 624/1253] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:00:39.493721 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb3bd5-b7ac-4471-be50-68f731a19ef0 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:39.576440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:39.642911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb3bd5-b7ac-4471-be50-68f731a19ef0 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:39.691328 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e4028-8c52-486f-8e6b-6a81ab629786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:39.692095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e4028-8c52-486f-8e6b-6a81ab629786 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.692511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e4028-8c52-486f-8e6b-6a81ab629786 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.692889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e4028-8c52-486f-8e6b-6a81ab629786 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:39.693811 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e4028-8c52-486f-8e6b-6a81ab629786 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:39.694224 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e4028-8c52-486f-8e6b-6a81ab629786 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:39.695979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e4028-8c52-486f-8e6b-6a81ab629786 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:39.730162 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 630/1254] 10.222.0.98 () {56 vars in 1143 bytes} [Tue Jul 26 15:00:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:39.737291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a61e43-d8ba-47b5-908e-1d0102a01bdb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:39.887900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a61e43-d8ba-47b5-908e-1d0102a01bdb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:39.936249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef36b21-b1a6-4850-bc8d-316f1c8cea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:39.936919 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef36b21-b1a6-4850-bc8d-316f1c8cea4a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.937206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef36b21-b1a6-4850-bc8d-316f1c8cea4a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.937486 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef36b21-b1a6-4850-bc8d-316f1c8cea4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:40.012397 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:40.029216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef36b21-b1a6-4850-bc8d-316f1c8cea4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:40.031837 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef36b21-b1a6-4850-bc8d-316f1c8cea4a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:40.179139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 625/1255] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 15:00:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 15:00:40.189721 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e4028-8c52-486f-8e6b-6a81ab629786 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:40.330234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e4028-8c52-486f-8e6b-6a81ab629786 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:40.348584 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:40.376684 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2990eb-8dbe-42ab-be0c-fe7acdda0ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:40.377813 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2990eb-8dbe-42ab-be0c-fe7acdda0ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:40.378330 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2990eb-8dbe-42ab-be0c-fe7acdda0ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:40.384493 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2990eb-8dbe-42ab-be0c-fe7acdda0ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:40.402676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2990eb-8dbe-42ab-be0c-fe7acdda0ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:40.404235 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2990eb-8dbe-42ab-be0c-fe7acdda0ee2 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:40.422892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-6f2990eb-8dbe-42ab-be0c-fe7acdda0ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:40.422892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:40.422892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:40.422892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:40.422892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:40.422892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:40.422892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:40.422892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:40.422892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:40.422892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:40.422892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:40.422892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:40.422892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:00:40.422892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:00:40.422892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:40.424071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:40.425087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:00:40.425087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:00:40.425087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:40.425087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:40.425087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 631/1256] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:40.433493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef36b21-b1a6-4850-bc8d-316f1c8cea4a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:40.565686 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:40.579381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef36b21-b1a6-4850-bc8d-316f1c8cea4a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:40.618809 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1707f60-80da-4db2-b254-207de72e370e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:40.619451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1707f60-80da-4db2-b254-207de72e370e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:40.619725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1707f60-80da-4db2-b254-207de72e370e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:40.619991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1707f60-80da-4db2-b254-207de72e370e None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:40.620728 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1707f60-80da-4db2-b254-207de72e370e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:40.621024 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1707f60-80da-4db2-b254-207de72e370e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:40.622434 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1707f60-80da-4db2-b254-207de72e370e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:40.635797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 626/1257] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 15:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:40.642045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2990eb-8dbe-42ab-be0c-fe7acdda0ee2 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:40.761556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2990eb-8dbe-42ab-be0c-fe7acdda0ee2 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:40.801581 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5f802-97f2-46d1-9a41-df4ee7d473a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:40.802250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f802-97f2-46d1-9a41-df4ee7d473a3 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:40.802565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f802-97f2-46d1-9a41-df4ee7d473a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:40.802846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f802-97f2-46d1-9a41-df4ee7d473a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:40.810721 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5f802-97f2-46d1-9a41-df4ee7d473a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:40.813277 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5f802-97f2-46d1-9a41-df4ee7d473a3 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:40.827072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-89a5f802-97f2-46d1-9a41-df4ee7d473a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:00:40.827072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:40.827072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:40.827072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:40.827072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:40.827072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:40.827072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:40.827072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:40.827072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:40.827072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:40.827072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:40.827072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:40.827072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:00:40.827072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:00:40.827072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:40.828743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:40.829784 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:00:40.829784 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:00:40.829784 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:00:40.829784 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:00:40.829784 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:00:40.829784 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:00:40.829784 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:00:40.829784 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:40.830283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 632/1258] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 15:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:40.836196 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1707f60-80da-4db2-b254-207de72e370e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:40.961904 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1707f60-80da-4db2-b254-207de72e370e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:41.007397 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12139c58-0caf-4040-86d3-44e81eae709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:41.008084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12139c58-0caf-4040-86d3-44e81eae709b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:41.008482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12139c58-0caf-4040-86d3-44e81eae709b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:41.008857 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12139c58-0caf-4040-86d3-44e81eae709b None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:41.009675 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12139c58-0caf-4040-86d3-44e81eae709b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:41.010045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12139c58-0caf-4040-86d3-44e81eae709b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:41.011886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12139c58-0caf-4040-86d3-44e81eae709b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:41.031516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 627/1259] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 15:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:41.039183 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5f802-97f2-46d1-9a41-df4ee7d473a3 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:41.073578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:41.169315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5f802-97f2-46d1-9a41-df4ee7d473a3 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:41.212369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5ed32-7a10-416a-97ab-148f2a29d40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:41.213024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5ed32-7a10-416a-97ab-148f2a29d40f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:41.213291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5ed32-7a10-416a-97ab-148f2a29d40f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:41.213612 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5ed32-7a10-416a-97ab-148f2a29d40f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:41.214518 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5ed32-7a10-416a-97ab-148f2a29d40f None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=448161cd39dc4a6786c8813faa79376a) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:41.214877 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5ed32-7a10-416a-97ab-148f2a29d40f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:41.216420 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5ed32-7a10-416a-97ab-148f2a29d40f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:41.222788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 633/1260] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 15:00:41 2022] GET /identity/v3/role_assignments?user.id=448161cd39dc4a6786c8813faa79376a&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=17054492864541709fda49dbf677a7a2 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:43.333614 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950e57f-c005-4c22-917a-df99f2c375a6 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:43.334438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950e57f-c005-4c22-917a-df99f2c375a6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:43.334438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950e57f-c005-4c22-917a-df99f2c375a6 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:43.335646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 628/1261] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:00:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:00:43.342708 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e61ae-f902-4728-8eae-982c78a707dd None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:43.344405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e61ae-f902-4728-8eae-982c78a707dd None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:43.344405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e61ae-f902-4728-8eae-982c78a707dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:43.364027 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d60e61ae-f902-4728-8eae-982c78a707dd None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:43.365247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d60e61ae-f902-4728-8eae-982c78a707dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:43.457862 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 634/1262] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:00:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:00:43.482831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950e57f-c005-4c22-917a-df99f2c375a6 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:43.502402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:43.636671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950e57f-c005-4c22-917a-df99f2c375a6 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:43.699705 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74750a19-4a37-4d56-9c9e-6c54d7e7a86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:43.700696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750a19-4a37-4d56-9c9e-6c54d7e7a86a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:43.701276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750a19-4a37-4d56-9c9e-6c54d7e7a86a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:43.701613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750a19-4a37-4d56-9c9e-6c54d7e7a86a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:43.720241 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74750a19-4a37-4d56-9c9e-6c54d7e7a86a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-74750a19-4a37-4d56-9c9e-6c54d7e7a86a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:00:43.727302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:43.729177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:43.731624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:43.731624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:43.731624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:43.731624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:43.731624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:00:43.731624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:00:43.731624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:00:43.731624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:00:43.731624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:00:43.731624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:00:43.731624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:00:43.731624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:43.731624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 629/1263] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 15:00:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:43.739249 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e61ae-f902-4728-8eae-982c78a707dd None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:43.769764 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:43.886473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e61ae-f902-4728-8eae-982c78a707dd None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:43.938246 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb4ed8-072e-4bb2-962e-dc798b799ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:43.938551 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb4ed8-072e-4bb2-962e-dc798b799ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:43.938979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb4ed8-072e-4bb2-962e-dc798b799ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:43.939274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb4ed8-072e-4bb2-962e-dc798b799ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:43.940073 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb4ed8-072e-4bb2-962e-dc798b799ef6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:43.940515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb4ed8-072e-4bb2-962e-dc798b799ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:43.942095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb4ed8-072e-4bb2-962e-dc798b799ef6 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:43.952062 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 635/1264] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 15:00:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:43.958721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74750a19-4a37-4d56-9c9e-6c54d7e7a86a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:44.043934 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:44.083187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74750a19-4a37-4d56-9c9e-6c54d7e7a86a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:44.121435 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a461d41-a6f0-404e-8498-93ef9fb6dd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:44.122093 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a461d41-a6f0-404e-8498-93ef9fb6dd87 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:44.122404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a461d41-a6f0-404e-8498-93ef9fb6dd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:44.122674 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a461d41-a6f0-404e-8498-93ef9fb6dd87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:44.136738 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a461d41-a6f0-404e-8498-93ef9fb6dd87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:44.138983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a461d41-a6f0-404e-8498-93ef9fb6dd87 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:44.166503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-9a461d41-a6f0-404e-8498-93ef9fb6dd87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:44.166503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:44.166503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:44.166503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:44.166503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:44.166503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:44.166503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:44.166503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:44.166503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:44.166503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:44.166503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:44.166503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:44.166503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:00:44.166503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:00:44.166503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:44.168741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:44.170877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:00:44.170877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:00:44.170877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:44.170877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:44.170877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 630/1265] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:44.178200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb4ed8-072e-4bb2-962e-dc798b799ef6 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:44.285383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:44.309023 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb4ed8-072e-4bb2-962e-dc798b799ef6 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:44.351041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9fc40-fcb3-4aa6-9ba3-fbdafa920682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:44.351899 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9fc40-fcb3-4aa6-9ba3-fbdafa920682 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:44.352174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9fc40-fcb3-4aa6-9ba3-fbdafa920682 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:44.352554 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9fc40-fcb3-4aa6-9ba3-fbdafa920682 None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:44.353613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9fc40-fcb3-4aa6-9ba3-fbdafa920682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:44.354057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9fc40-fcb3-4aa6-9ba3-fbdafa920682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:44.356617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9fc40-fcb3-4aa6-9ba3-fbdafa920682 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:44.373290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 636/1266] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 15:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:44.379611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a461d41-a6f0-404e-8498-93ef9fb6dd87 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:44.514040 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a461d41-a6f0-404e-8498-93ef9fb6dd87 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:44.538023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:44.555412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c93cce-ad98-4320-a8e6-6d0cb1a7996f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:44.556125 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c93cce-ad98-4320-a8e6-6d0cb1a7996f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:44.556448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c93cce-ad98-4320-a8e6-6d0cb1a7996f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:44.556720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c93cce-ad98-4320-a8e6-6d0cb1a7996f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:44.566642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c93cce-ad98-4320-a8e6-6d0cb1a7996f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:44.568233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c93cce-ad98-4320-a8e6-6d0cb1a7996f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-45c93cce-ad98-4320-a8e6-6d0cb1a7996f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:00:44.582198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:44.584402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:44.586893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:44.586893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:44.586893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:00:44.586893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:00:44.586893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:00:44.586893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:00:44.586893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:00:44.586893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:00:44.586893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:00:44.586893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:44.586893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 631/1267] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:00:44.592059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9fc40-fcb3-4aa6-9ba3-fbdafa920682 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:44.731172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9fc40-fcb3-4aa6-9ba3-fbdafa920682 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:44.783170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd0086-2f78-4a96-98c9-db23aee1ae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:44.784148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd0086-2f78-4a96-98c9-db23aee1ae60 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:44.784444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd0086-2f78-4a96-98c9-db23aee1ae60 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:44.784743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd0086-2f78-4a96-98c9-db23aee1ae60 None admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:44.785644 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd0086-2f78-4a96-98c9-db23aee1ae60 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:44.785959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd0086-2f78-4a96-98c9-db23aee1ae60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:44.788183 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd0086-2f78-4a96-98c9-db23aee1ae60 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:44.799253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:44.813002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 637/1268] 10.222.0.98 () {56 vars in 1143 bytes} [Tue Jul 26 15:00:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:44.819556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c93cce-ad98-4320-a8e6-6d0cb1a7996f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:44.976527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c93cce-ad98-4320-a8e6-6d0cb1a7996f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:45.020007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3838d-254e-4f18-b5ea-44908b623089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:45.020788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3838d-254e-4f18-b5ea-44908b623089 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:45.021071 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3838d-254e-4f18-b5ea-44908b623089 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:45.021345 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3838d-254e-4f18-b5ea-44908b623089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:45.035080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3838d-254e-4f18-b5ea-44908b623089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:45.037872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3838d-254e-4f18-b5ea-44908b623089 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:45.053887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-42b3838d-254e-4f18-b5ea-44908b623089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:45.053887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:45.053887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:45.053887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:45.053887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:45.053887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:45.053887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:45.053887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:45.053887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:45.053887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:45.053887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:45.053887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:45.053887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:00:45.053887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:00:45.053887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:45.055642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:45.057394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:00:45.057394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:00:45.057394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:45.057394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:45.057394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 632/1269] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:45.062598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd0086-2f78-4a96-98c9-db23aee1ae60 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:45.216524 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd0086-2f78-4a96-98c9-db23aee1ae60 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:45.273738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb98ffb-3ebb-46af-8c4b-c68983db56ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:45.274812 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb98ffb-3ebb-46af-8c4b-c68983db56ca None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:45.286346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb98ffb-3ebb-46af-8c4b-c68983db56ca None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:45.286346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb98ffb-3ebb-46af-8c4b-c68983db56ca None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:45.286346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb98ffb-3ebb-46af-8c4b-c68983db56ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:45.286346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb98ffb-3ebb-46af-8c4b-c68983db56ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:45.286346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb98ffb-3ebb-46af-8c4b-c68983db56ca None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:45.302485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 638/1270] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 15:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:45.309559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3838d-254e-4f18-b5ea-44908b623089 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:45.355814 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:45.443602 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3838d-254e-4f18-b5ea-44908b623089 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:45.486867 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822fb31-1094-4cba-a599-42bd7f633bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:45.487731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822fb31-1094-4cba-a599-42bd7f633bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:45.488085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822fb31-1094-4cba-a599-42bd7f633bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:45.488408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822fb31-1094-4cba-a599-42bd7f633bd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:45.496966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822fb31-1094-4cba-a599-42bd7f633bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:45.498907 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822fb31-1094-4cba-a599-42bd7f633bd8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:45.512600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-5822fb31-1094-4cba-a599-42bd7f633bd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:00:45.512600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:45.512600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:45.512600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:45.512600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:45.512600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:45.512600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:45.512600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:45.512600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:45.512600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:45.512600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:45.512600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:45.512600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:00:45.512600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:00:45.512600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:45.514353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:45.517267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:00:45.517267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:00:45.517267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:00:45.517267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:00:45.517267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:00:45.517267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:00:45.517267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:00:45.517267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:45.517267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 633/1271] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 15:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:45.522273 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb98ffb-3ebb-46af-8c4b-c68983db56ca None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:45.594222 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:45.648229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb98ffb-3ebb-46af-8c4b-c68983db56ca None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:45.696653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662e76a-7ac3-4be4-b016-846071b91f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:45.697395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662e76a-7ac3-4be4-b016-846071b91f2f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:45.697761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662e76a-7ac3-4be4-b016-846071b91f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:45.698098 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662e76a-7ac3-4be4-b016-846071b91f2f None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:45.698965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662e76a-7ac3-4be4-b016-846071b91f2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:45.699315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662e76a-7ac3-4be4-b016-846071b91f2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:45.700889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662e76a-7ac3-4be4-b016-846071b91f2f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:45.721116 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 639/1272] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 15:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:45.728082 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822fb31-1094-4cba-a599-42bd7f633bd8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:45.872495 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:45.887049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822fb31-1094-4cba-a599-42bd7f633bd8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:45.940642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34b735-7203-41e7-aeba-881372e7cd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:45.941704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34b735-7203-41e7-aeba-881372e7cd8b None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:45.942151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34b735-7203-41e7-aeba-881372e7cd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:45.942638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34b735-7203-41e7-aeba-881372e7cd8b None admin] PATH_INFO: `/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/448161cd39dc4a6786c8813faa79376a/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:45.946202 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34b735-7203-41e7-aeba-881372e7cd8b None admin] RBAC: Authorizing `identity:create_grant(project_id=7f750777b75f49a19a5019c4fc2c00f5, user_id=448161cd39dc4a6786c8813faa79376a, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:45.948974 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34b735-7203-41e7-aeba-881372e7cd8b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:46.101721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 634/1273] 10.222.0.98 () {58 vars in 1439 bytes} [Tue Jul 26 15:00:45 2022] PUT /identity/v3/projects/7f750777b75f49a19a5019c4fc2c00f5/users/448161cd39dc4a6786c8813faa79376a/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:48.370447 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93412551-fe4c-46c6-8e6a-58d9f537dece None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:48.371064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93412551-fe4c-46c6-8e6a-58d9f537dece None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:48.371064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93412551-fe4c-46c6-8e6a-58d9f537dece None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:48.372630 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 640/1274] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:00:48.380225 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97895df-af01-42cc-a1c9-d34019b56209 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:48.380828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97895df-af01-42cc-a1c9-d34019b56209 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:48.380828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97895df-af01-42cc-a1c9-d34019b56209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:48.401593 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c97895df-af01-42cc-a1c9-d34019b56209 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:48.405964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c97895df-af01-42cc-a1c9-d34019b56209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:48.515767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 635/1275] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:00:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:00:48.539528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93412551-fe4c-46c6-8e6a-58d9f537dece None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:48.677917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93412551-fe4c-46c6-8e6a-58d9f537dece None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:48.699572 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:48.719265 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511ffce-f864-456a-9a57-b72f145ad884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:48.720047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511ffce-f864-456a-9a57-b72f145ad884 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:48.720335 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511ffce-f864-456a-9a57-b72f145ad884 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:48.720616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511ffce-f864-456a-9a57-b72f145ad884 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:48.732352 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511ffce-f864-456a-9a57-b72f145ad884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-0511ffce-f864-456a-9a57-b72f145ad884 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:00:48.738264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:48.739344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:48.740214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:48.740214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:48.740214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:48.740214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:48.740214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:00:48.740214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:00:48.740214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:00:48.740214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:00:48.740214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:00:48.740214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:00:48.740214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:00:48.740214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:48.740214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 641/1276] 10.222.0.98 () {56 vars in 1096 bytes} [Tue Jul 26 15:00:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:48.747588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97895df-af01-42cc-a1c9-d34019b56209 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:48.851228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:48.880348 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97895df-af01-42cc-a1c9-d34019b56209 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:48.933311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd159e47-59d6-45c0-b99a-6e32624ca317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:48.934313 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd159e47-59d6-45c0-b99a-6e32624ca317 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:48.934830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd159e47-59d6-45c0-b99a-6e32624ca317 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:48.935326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd159e47-59d6-45c0-b99a-6e32624ca317 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:48.936693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd159e47-59d6-45c0-b99a-6e32624ca317 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:48.938657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd159e47-59d6-45c0-b99a-6e32624ca317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:48.941524 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd159e47-59d6-45c0-b99a-6e32624ca317 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:48.959844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 636/1277] 10.222.0.98 () {56 vars in 1099 bytes} [Tue Jul 26 15:00:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:48.969467 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511ffce-f864-456a-9a57-b72f145ad884 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:49.095576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511ffce-f864-456a-9a57-b72f145ad884 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:49.136896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc7e5f-24b2-4010-9a6c-3bdc51a07e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:49.137564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc7e5f-24b2-4010-9a6c-3bdc51a07e5f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:49.137845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc7e5f-24b2-4010-9a6c-3bdc51a07e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:49.138121 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc7e5f-24b2-4010-9a6c-3bdc51a07e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:49.150651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc7e5f-24b2-4010-9a6c-3bdc51a07e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:49.152191 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc7e5f-24b2-4010-9a6c-3bdc51a07e5f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:49.172108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-5adc7e5f-24b2-4010-9a6c-3bdc51a07e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:49.172108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:49.172108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:49.172108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:49.172108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:49.172108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:49.172108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:49.172108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:49.172108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:49.172108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:49.172108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:49.172108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:49.172108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:00:49.172108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:00:49.172108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:49.174010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:49.175376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:00:49.175376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:00:49.175376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:49.175376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:49.175376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 642/1278] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:49.180642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd159e47-59d6-45c0-b99a-6e32624ca317 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:49.307833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd159e47-59d6-45c0-b99a-6e32624ca317 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:49.349046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0ab0d-48c2-4df2-8470-49fc0a85533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:49.349688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0ab0d-48c2-4df2-8470-49fc0a85533b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:49.349970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0ab0d-48c2-4df2-8470-49fc0a85533b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:49.350244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0ab0d-48c2-4df2-8470-49fc0a85533b None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:49.350992 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0ab0d-48c2-4df2-8470-49fc0a85533b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:49.351298 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0ab0d-48c2-4df2-8470-49fc0a85533b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:49.352689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0ab0d-48c2-4df2-8470-49fc0a85533b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:49.367828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 637/1279] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 15:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:49.374332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc7e5f-24b2-4010-9a6c-3bdc51a07e5f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:49.426489 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:49.525556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc7e5f-24b2-4010-9a6c-3bdc51a07e5f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:49.588189 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63240d6a-903b-45c1-b9b7-1c53d4ce755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:49.589032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63240d6a-903b-45c1-b9b7-1c53d4ce755f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:49.589664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63240d6a-903b-45c1-b9b7-1c53d4ce755f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:49.590132 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63240d6a-903b-45c1-b9b7-1c53d4ce755f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:49.600778 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63240d6a-903b-45c1-b9b7-1c53d4ce755f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:49.602338 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63240d6a-903b-45c1-b9b7-1c53d4ce755f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-63240d6a-903b-45c1-b9b7-1c53d4ce755f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:00:49.616583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:49.618474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:49.620369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:49.620369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:49.620369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:00:49.620369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:00:49.620369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:00:49.620369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:00:49.620369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:00:49.620369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:00:49.620369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:00:49.620369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:49.620369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 643/1280] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:49.626882 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0ab0d-48c2-4df2-8470-49fc0a85533b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:49.630895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:49.768268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0ab0d-48c2-4df2-8470-49fc0a85533b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:49.823613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998d0f5-8edd-411e-b4cc-77c6fbb18743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:49.824699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998d0f5-8edd-411e-b4cc-77c6fbb18743 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:49.825029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998d0f5-8edd-411e-b4cc-77c6fbb18743 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:49.825309 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998d0f5-8edd-411e-b4cc-77c6fbb18743 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:49.826165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998d0f5-8edd-411e-b4cc-77c6fbb18743 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:49.826509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998d0f5-8edd-411e-b4cc-77c6fbb18743 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:49.828273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998d0f5-8edd-411e-b4cc-77c6fbb18743 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:49.853114 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 638/1281] 10.222.0.98 () {56 vars in 1143 bytes} [Tue Jul 26 15:00:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:49.860962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63240d6a-903b-45c1-b9b7-1c53d4ce755f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:50.002291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:50.013653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63240d6a-903b-45c1-b9b7-1c53d4ce755f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:50.056477 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61754b1f-1820-44d8-898c-ea46e5607ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:50.057152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61754b1f-1820-44d8-898c-ea46e5607ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:50.057443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61754b1f-1820-44d8-898c-ea46e5607ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:50.057722 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61754b1f-1820-44d8-898c-ea46e5607ab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:50.187423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61754b1f-1820-44d8-898c-ea46e5607ab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:50.190412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61754b1f-1820-44d8-898c-ea46e5607ab9 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:50.370546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:50.384958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 644/1282] 10.222.0.98 () {58 vars in 1282 bytes} [Tue Jul 26 15:00:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 15:00:50.392846 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998d0f5-8edd-411e-b4cc-77c6fbb18743 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:50.475433 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:50.526239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998d0f5-8edd-411e-b4cc-77c6fbb18743 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:50.571764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e823742-8ca3-430f-bdf8-f89da94bbce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:50.572504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e823742-8ca3-430f-bdf8-f89da94bbce5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:50.573004 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e823742-8ca3-430f-bdf8-f89da94bbce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:50.573433 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e823742-8ca3-430f-bdf8-f89da94bbce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:50.589483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e823742-8ca3-430f-bdf8-f89da94bbce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:50.591329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e823742-8ca3-430f-bdf8-f89da94bbce5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:50.611373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-7e823742-8ca3-430f-bdf8-f89da94bbce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:50.611373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:50.611373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:50.611373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:50.611373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:50.611373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:50.611373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:50.611373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:50.611373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:50.611373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:50.611373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:50.611373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:50.611373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:00:50.611373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:00:50.611373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:50.613178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:50.615262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:00:50.615262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:00:50.615262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:00:50.615262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:50.615262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 639/1283] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:50.620884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61754b1f-1820-44d8-898c-ea46e5607ab9 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:50.797074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61754b1f-1820-44d8-898c-ea46e5607ab9 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:50.868206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aa242-d90f-4cc3-bbcf-c37e73d11a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:50.869179 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aa242-d90f-4cc3-bbcf-c37e73d11a4b None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:50.869673 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aa242-d90f-4cc3-bbcf-c37e73d11a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:50.870117 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aa242-d90f-4cc3-bbcf-c37e73d11a4b None admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:50.871294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391aa242-d90f-4cc3-bbcf-c37e73d11a4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:50.871760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391aa242-d90f-4cc3-bbcf-c37e73d11a4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:50.874273 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391aa242-d90f-4cc3-bbcf-c37e73d11a4b None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:50.897628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 645/1284] 10.222.0.98 () {56 vars in 1109 bytes} [Tue Jul 26 15:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:50.904101 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e823742-8ca3-430f-bdf8-f89da94bbce5 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:51.051990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e823742-8ca3-430f-bdf8-f89da94bbce5 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:51.071360 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:51.096861 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f016fb-64f5-4323-925f-52d858386a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:51.105620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f016fb-64f5-4323-925f-52d858386a2b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:51.105620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f016fb-64f5-4323-925f-52d858386a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:51.105620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f016fb-64f5-4323-925f-52d858386a2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:51.106592 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f016fb-64f5-4323-925f-52d858386a2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:51.108192 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f016fb-64f5-4323-925f-52d858386a2b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:51.121819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-a4f016fb-64f5-4323-925f-52d858386a2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:00:51.121819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:51.121819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:51.121819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:51.121819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:51.121819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:51.121819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:51.121819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:51.121819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:51.121819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:51.121819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:51.121819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:51.121819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:00:51.121819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:00:51.121819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:51.123622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:51.124850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:00:51.124850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:00:51.124850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:00:51.124850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:00:51.124850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:00:51.124850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:00:51.124850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:00:51.124850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 26 15:00:51.124850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 640/1285] 10.222.0.98 () {56 vars in 1111 bytes} [Tue Jul 26 15:00:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:00:51.129741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aa242-d90f-4cc3-bbcf-c37e73d11a4b None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:51.189422 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:51.270339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aa242-d90f-4cc3-bbcf-c37e73d11a4b None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:51.309389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fbec4-7f77-42b7-a683-0fae569f5672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:51.310297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fbec4-7f77-42b7-a683-0fae569f5672 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:51.310623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fbec4-7f77-42b7-a683-0fae569f5672 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:51.310910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fbec4-7f77-42b7-a683-0fae569f5672 None admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:51.311707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fbec4-7f77-42b7-a683-0fae569f5672 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:51.312166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fbec4-7f77-42b7-a683-0fae569f5672 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:51.314648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fbec4-7f77-42b7-a683-0fae569f5672 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:51.330014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 646/1286] 10.222.0.98 () {56 vars in 1148 bytes} [Tue Jul 26 15:00:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:51.336732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f016fb-64f5-4323-925f-52d858386a2b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:51.475733 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f016fb-64f5-4323-925f-52d858386a2b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:51.521514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e0be4-db89-4cad-b670-b757ab2d2919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:51.522458 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e0be4-db89-4cad-b670-b757ab2d2919 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:51.522955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e0be4-db89-4cad-b670-b757ab2d2919 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:51.523381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e0be4-db89-4cad-b670-b757ab2d2919 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:51.524502 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e0be4-db89-4cad-b670-b757ab2d2919 None admin] RBAC: Adding query filter params (role.id=17054492864541709fda49dbf677a7a2, scope.project.id=7f750777b75f49a19a5019c4fc2c00f5, user.id=448161cd39dc4a6786c8813faa79376a) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:51.527641 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e0be4-db89-4cad-b670-b757ab2d2919 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:51.527641 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e0be4-db89-4cad-b670-b757ab2d2919 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:51.539011 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 641/1287] 10.222.0.98 () {56 vars in 1374 bytes} [Tue Jul 26 15:00:51 2022] GET /identity/v3/role_assignments?user.id=448161cd39dc4a6786c8813faa79376a&scope.project.id=7f750777b75f49a19a5019c4fc2c00f5&role.id=17054492864541709fda49dbf677a7a2 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:53.958823 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c21acb-7b51-4ef1-b103-2393dcb19858 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:53.959440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c21acb-7b51-4ef1-b103-2393dcb19858 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:53.959728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c21acb-7b51-4ef1-b103-2393dcb19858 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:53.962258 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 647/1288] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:00:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:00:53.970338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162dafa-ceb8-432f-b7e6-a94d694a1ef8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:53.970879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162dafa-ceb8-432f-b7e6-a94d694a1ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:53.971331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162dafa-ceb8-432f-b7e6-a94d694a1ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:54.002739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7162dafa-ceb8-432f-b7e6-a94d694a1ef8 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:54.004021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7162dafa-ceb8-432f-b7e6-a94d694a1ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:54.058829 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:54.124729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 642/1289] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:00:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:00:54.150861 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c21acb-7b51-4ef1-b103-2393dcb19858 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:54.354518 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c21acb-7b51-4ef1-b103-2393dcb19858 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:54.376371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:54.428989 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60ca86-8979-4e33-a59e-1dc8e8d5fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:54.430100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ca86-8979-4e33-a59e-1dc8e8d5fb1f None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:54.430690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ca86-8979-4e33-a59e-1dc8e8d5fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:54.431226 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ca86-8979-4e33-a59e-1dc8e8d5fb1f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:54.432517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60ca86-8979-4e33-a59e-1dc8e8d5fb1f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:54.435509 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60ca86-8979-4e33-a59e-1dc8e8d5fb1f None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-4d60ca86-8979-4e33-a59e-1dc8e8d5fb1f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:00:54.456082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:00:54.457528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:00:54.459409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:00:54.459409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:00:54.459409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:00:54.459409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:00:54.459409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:00:54.459409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:00:54.459409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:00:54.459409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:00:54.459409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:00:54.459409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:00:54.459409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:00:54.459409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:00:54.459409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:00:54.459409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:00:54.459409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 648/1290] 10.222.0.98 () {56 vars in 1117 bytes} [Tue Jul 26 15:00:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:00:54.467831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162dafa-ceb8-432f-b7e6-a94d694a1ef8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:54.614763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162dafa-ceb8-432f-b7e6-a94d694a1ef8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:54.658515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391c201-0410-4ed6-8c76-178016c4a810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:54.659450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391c201-0410-4ed6-8c76-178016c4a810 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:54.659895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391c201-0410-4ed6-8c76-178016c4a810 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:54.660351 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391c201-0410-4ed6-8c76-178016c4a810 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:54.661330 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391c201-0410-4ed6-8c76-178016c4a810 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:54.661824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391c201-0410-4ed6-8c76-178016c4a810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:54.664266 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391c201-0410-4ed6-8c76-178016c4a810 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:54.675204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 643/1291] 10.222.0.98 () {56 vars in 1116 bytes} [Tue Jul 26 15:00:54 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:54.682542 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60ca86-8979-4e33-a59e-1dc8e8d5fb1f None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:54.803744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60ca86-8979-4e33-a59e-1dc8e8d5fb1f None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:54.844015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bad37b-e22c-4bd3-a49c-13733e772134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:54.844656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bad37b-e22c-4bd3-a49c-13733e772134 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:54.844944 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bad37b-e22c-4bd3-a49c-13733e772134 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:54.845293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bad37b-e22c-4bd3-a49c-13733e772134 None admin] PATH_INFO: `/v3/services` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:54.846017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bad37b-e22c-4bd3-a49c-13733e772134 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:54.846324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bad37b-e22c-4bd3-a49c-13733e772134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:54.847933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bad37b-e22c-4bd3-a49c-13733e772134 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:54.853844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 649/1292] 10.222.0.98 () {56 vars in 1116 bytes} [Tue Jul 26 15:00:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:57.206047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947d289-6c20-4768-be3e-d7462c2de4d0 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:57.206677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947d289-6c20-4768-be3e-d7462c2de4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:57.207064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947d289-6c20-4768-be3e-d7462c2de4d0 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:57.209597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 644/1293] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:00:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:00:57.215567 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbb376-9407-4a9f-b401-960742db947f None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:57.216191 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbb376-9407-4a9f-b401-960742db947f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:57.216719 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbb376-9407-4a9f-b401-960742db947f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:57.241802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-ebfbb376-9407-4a9f-b401-960742db947f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:57.243161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ebfbb376-9407-4a9f-b401-960742db947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:57.279747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:57.345765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 650/1294] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:00:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:00:57.380645 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947d289-6c20-4768-be3e-d7462c2de4d0 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:57.433643 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:57.527858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947d289-6c20-4768-be3e-d7462c2de4d0 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:57.569425 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f591b1-9374-4971-a911-e5fd13fb003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:57.570062 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f591b1-9374-4971-a911-e5fd13fb003d None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:57.570340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f591b1-9374-4971-a911-e5fd13fb003d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:57.570646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f591b1-9374-4971-a911-e5fd13fb003d None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:57.571368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f591b1-9374-4971-a911-e5fd13fb003d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:57.572767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f591b1-9374-4971-a911-e5fd13fb003d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:57.684702 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 645/1295] 10.222.0.98 () {60 vars in 1141 bytes} [Tue Jul 26 15:00:57 2022] POST /identity/v3/services => generated 246 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:59.893222 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12833365-e4b8-4afb-9a77-a0fbb2566dfd None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:59.893829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12833365-e4b8-4afb-9a77-a0fbb2566dfd None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:59.893829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12833365-e4b8-4afb-9a77-a0fbb2566dfd None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:59.895178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 651/1296] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:00:59.901962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec51ac-974d-4efe-bd98-cf2cbd71c69a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:59.902771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec51ac-974d-4efe-bd98-cf2cbd71c69a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:59.902771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec51ac-974d-4efe-bd98-cf2cbd71c69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:59.924819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9cec51ac-974d-4efe-bd98-cf2cbd71c69a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:59.926036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9cec51ac-974d-4efe-bd98-cf2cbd71c69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:00.021396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 646/1297] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:00:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:01:00.048631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12833365-e4b8-4afb-9a77-a0fbb2566dfd None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:00.171072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12833365-e4b8-4afb-9a77-a0fbb2566dfd None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:00.209557 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a7c4c-0bd5-4372-9972-51ad0169a532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:00.210264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a7c4c-0bd5-4372-9972-51ad0169a532 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:00.210621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a7c4c-0bd5-4372-9972-51ad0169a532 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:00.210987 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a7c4c-0bd5-4372-9972-51ad0169a532 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:00.211709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a7c4c-0bd5-4372-9972-51ad0169a532 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:00.213756 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a7c4c-0bd5-4372-9972-51ad0169a532 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-621a7c4c-0bd5-4372-9972-51ad0169a532 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:01:00.224269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:01:00.226061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:01:00.228074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:01:00.228074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:01:00.228074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:01:00.228074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:01:00.228074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:01:00.228074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:01:00.228074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:01:00.228074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:01:00.228074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:01:00.228074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:01:00.228074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:01:00.228074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:01:00.228074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:01:00.228074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:01:00.228074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 652/1298] 10.222.0.98 () {56 vars in 1117 bytes} [Tue Jul 26 15:01:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:01:00.234382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec51ac-974d-4efe-bd98-cf2cbd71c69a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:00.264012 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:00.363315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec51ac-974d-4efe-bd98-cf2cbd71c69a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:00.409006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb8069-1f90-41ee-a557-dacac6b56b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:00.409758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb8069-1f90-41ee-a557-dacac6b56b34 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:00.410034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb8069-1f90-41ee-a557-dacac6b56b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:00.410309 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb8069-1f90-41ee-a557-dacac6b56b34 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:00.411029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb8069-1f90-41ee-a557-dacac6b56b34 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:01:00.411327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb8069-1f90-41ee-a557-dacac6b56b34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:00.412696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb8069-1f90-41ee-a557-dacac6b56b34 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:00.420284 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 647/1299] 10.222.0.98 () {56 vars in 1116 bytes} [Tue Jul 26 15:01:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:01:00.426965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a7c4c-0bd5-4372-9972-51ad0169a532 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:00.482800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:00.600744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a7c4c-0bd5-4372-9972-51ad0169a532 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:00.660562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd372962-ad50-4c37-b900-fcae4b073e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:00.661633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd372962-ad50-4c37-b900-fcae4b073e09 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:00.662118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd372962-ad50-4c37-b900-fcae4b073e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:00.662656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd372962-ad50-4c37-b900-fcae4b073e09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:00.663959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd372962-ad50-4c37-b900-fcae4b073e09 None admin] RBAC: Adding query filter params (interface=public, service_id=09bfcdde37b7440a9e0f1a351249af53, region_id=RegionOne) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:01:00.664466 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd372962-ad50-4c37-b900-fcae4b073e09 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:00.667149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd372962-ad50-4c37-b900-fcae4b073e09 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:00.678890 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 653/1300] 10.222.0.98 () {56 vars in 1251 bytes} [Tue Jul 26 15:01:00 2022] GET /identity/v3/endpoints?service_id=09bfcdde37b7440a9e0f1a351249af53&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:01:00.685321 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb8069-1f90-41ee-a557-dacac6b56b34 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:00.838816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:00.864358 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb8069-1f90-41ee-a557-dacac6b56b34 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:00.908782 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3690a-2ee5-43c1-a1dc-6ec0070ca294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:00.909821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3690a-2ee5-43c1-a1dc-6ec0070ca294 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:00.910306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3690a-2ee5-43c1-a1dc-6ec0070ca294 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:00.910832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3690a-2ee5-43c1-a1dc-6ec0070ca294 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:00.912083 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3690a-2ee5-43c1-a1dc-6ec0070ca294 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:00.914485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3690a-2ee5-43c1-a1dc-6ec0070ca294 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:00.929324 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 648/1301] 10.222.0.98 () {56 vars in 1087 bytes} [Tue Jul 26 15:01:00 2022] GET /identity/v3/services => generated 2191 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:01:03.437463 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9737768-da1e-4ac1-8ae0-122808f8cb3a None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.438235 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9737768-da1e-4ac1-8ae0-122808f8cb3a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.438414 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9737768-da1e-4ac1-8ae0-122808f8cb3a None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.440455 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 654/1302] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:01:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:01:03.450023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e82076-44b3-4da6-b578-25ef829cb30a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.450935 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e82076-44b3-4da6-b578-25ef829cb30a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.450935 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e82076-44b3-4da6-b578-25ef829cb30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.477162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-99e82076-44b3-4da6-b578-25ef829cb30a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:03.478569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-99e82076-44b3-4da6-b578-25ef829cb30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:03.578832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 649/1303] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:01:03 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:01:03.605703 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9737768-da1e-4ac1-8ae0-122808f8cb3a None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:03.746399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:03.756553 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9737768-da1e-4ac1-8ae0-122808f8cb3a None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:03.799034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505af66c-b7e4-4bd1-a442-e57d57a38bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:03.799711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505af66c-b7e4-4bd1-a442-e57d57a38bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.799996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505af66c-b7e4-4bd1-a442-e57d57a38bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.800278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505af66c-b7e4-4bd1-a442-e57d57a38bd2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.800923 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505af66c-b7e4-4bd1-a442-e57d57a38bd2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:03.802467 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505af66c-b7e4-4bd1-a442-e57d57a38bd2 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application [None req-505af66c-b7e4-4bd1-a442-e57d57a38bd2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:01:03.814251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:01:03.818910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:01:03.820147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:01:03.820147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:01:03.820147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:01:03.820147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:01:03.820147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:01:03.820147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:01:03.820147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:01:03.820147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:01:03.820147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:01:03.820147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:01:03.820147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:01:03.820147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:01:03.820147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:01:03.820147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: ERROR keystone.server.flask.application Jul 26 15:01:03.820147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 655/1304] 10.222.0.98 () {56 vars in 1117 bytes} [Tue Jul 26 15:01:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:01:03.822469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e82076-44b3-4da6-b578-25ef829cb30a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:03.945360 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:03.980302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e82076-44b3-4da6-b578-25ef829cb30a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:04.040452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627c579-8939-49d5-918c-0bd51a63de20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:04.041337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627c579-8939-49d5-918c-0bd51a63de20 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:04.041800 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627c579-8939-49d5-918c-0bd51a63de20 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:04.042179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627c579-8939-49d5-918c-0bd51a63de20 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:04.043032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627c579-8939-49d5-918c-0bd51a63de20 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:01:04.043439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627c579-8939-49d5-918c-0bd51a63de20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:04.044939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627c579-8939-49d5-918c-0bd51a63de20 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:04.052998 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 650/1305] 10.222.0.98 () {56 vars in 1116 bytes} [Tue Jul 26 15:01:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:01:04.059710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505af66c-b7e4-4bd1-a442-e57d57a38bd2 None admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:04.214856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505af66c-b7e4-4bd1-a442-e57d57a38bd2 None admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:04.267375 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbedf05-8cc5-45eb-88c9-2ef92b7e9e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:04.268436 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbedf05-8cc5-45eb-88c9-2ef92b7e9e31 None admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:04.268936 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbedf05-8cc5-45eb-88c9-2ef92b7e9e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:04.269389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbedf05-8cc5-45eb-88c9-2ef92b7e9e31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:04.270690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbedf05-8cc5-45eb-88c9-2ef92b7e9e31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:04.273263 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbedf05-8cc5-45eb-88c9-2ef92b7e9e31 None admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:04.385251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 656/1306] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:01:04 2022] POST /identity/v3/endpoints => generated 331 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:01:14.077998 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=30 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:14.377553 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:31.010762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb8337-e8bd-4f04-82fd-7a22d27cf6b7 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:31.011717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb8337-e8bd-4f04-82fd-7a22d27cf6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:31.011717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb8337-e8bd-4f04-82fd-7a22d27cf6b7 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:31.025144 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 651/1307] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:10:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:10:31.028173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d47287-4371-4c78-baf8-1c148c462162 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:31.028173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d47287-4371-4c78-baf8-1c148c462162 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:31.028173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d47287-4371-4c78-baf8-1c148c462162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:31.302974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a8d47287-4371-4c78-baf8-1c148c462162 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:31.305172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a8d47287-4371-4c78-baf8-1c148c462162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:31.499075 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 657/1308] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:31.580085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4f81f-c49a-4cb7-ad36-f61578467a27 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:31.580660 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4f81f-c49a-4cb7-ad36-f61578467a27 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:31.581234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4f81f-c49a-4cb7-ad36-f61578467a27 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:31.583728 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 652/1309] 10.222.0.98 () {54 vars in 965 bytes} [Tue Jul 26 15:10:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:10:31.594180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e941a-9889-435a-bdc6-09ba1e9082b7 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:31.594768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e941a-9889-435a-bdc6-09ba1e9082b7 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:31.595284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e941a-9889-435a-bdc6-09ba1e9082b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:31.734595 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-879e941a-9889-435a-bdc6-09ba1e9082b7 None None] MFA Rules not processed for user `e44d2d2b50484fb89b0688ff28615d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:31.737104 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-879e941a-9889-435a-bdc6-09ba1e9082b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:31.767730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:31.852673 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 658/1310] 10.222.0.98 () {58 vars in 1062 bytes} [Tue Jul 26 15:10:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:31.863121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4f81f-c49a-4cb7-ad36-f61578467a27 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:31.865865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-17e4f81f-c49a-4cb7-ad36-f61578467a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:32.054647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4f81f-c49a-4cb7-ad36-f61578467a27 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:32.241185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536424f-baf9-4c43-960b-69d58ef6901c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:32.242744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536424f-baf9-4c43-960b-69d58ef6901c service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:32.243379 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536424f-baf9-4c43-960b-69d58ef6901c service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:32.243784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536424f-baf9-4c43-960b-69d58ef6901c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:32.245805 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2536424f-baf9-4c43-960b-69d58ef6901c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:32.344913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:32.447139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536424f-baf9-4c43-960b-69d58ef6901c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:32.448830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536424f-baf9-4c43-960b-69d58ef6901c service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:32.479396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 653/1311] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:35.597877 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64c1a3-9b3c-41bb-912e-a3935cba3aec None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:35.598768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64c1a3-9b3c-41bb-912e-a3935cba3aec None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:35.598934 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64c1a3-9b3c-41bb-912e-a3935cba3aec None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:35.600684 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 659/1312] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:10:35.608291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdddd42-4b87-41b9-b00a-339015f8bcef None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:35.608963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdddd42-4b87-41b9-b00a-339015f8bcef None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:35.609465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdddd42-4b87-41b9-b00a-339015f8bcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:35.719909 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1cdddd42-4b87-41b9-b00a-339015f8bcef None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:35.721665 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1cdddd42-4b87-41b9-b00a-339015f8bcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:35.904342 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 654/1313] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:35.954014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64c1a3-9b3c-41bb-912e-a3935cba3aec None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:35.955993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5e64c1a3-9b3c-41bb-912e-a3935cba3aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:36.137559 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64c1a3-9b3c-41bb-912e-a3935cba3aec None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:36.252070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:36.255745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6fee8-262c-4336-9bdb-5d859f62ea64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:36.256392 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6fee8-262c-4336-9bdb-5d859f62ea64 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:36.256679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6fee8-262c-4336-9bdb-5d859f62ea64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:36.256956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6fee8-262c-4336-9bdb-5d859f62ea64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:36.258763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3dd6fee8-262c-4336-9bdb-5d859f62ea64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:36.475032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6fee8-262c-4336-9bdb-5d859f62ea64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:36.476582 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6fee8-262c-4336-9bdb-5d859f62ea64 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:36.509776 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 660/1314] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:39.620717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d6b28-5bc0-41da-bc36-a7f7f4fc6bd2 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:39.621361 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d6b28-5bc0-41da-bc36-a7f7f4fc6bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:39.621361 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d6b28-5bc0-41da-bc36-a7f7f4fc6bd2 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:39.623343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 655/1315] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:10:39.629964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14e097-a38b-47cb-bb51-5f56919d63d8 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:39.630577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14e097-a38b-47cb-bb51-5f56919d63d8 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:39.630577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14e097-a38b-47cb-bb51-5f56919d63d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:39.723896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-0e14e097-a38b-47cb-bb51-5f56919d63d8 None None] MFA Rules not processed for user `2a32a15f2a584ef0acafa1e4cd085d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:39.725144 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0e14e097-a38b-47cb-bb51-5f56919d63d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:39.788262 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:39.851279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 661/1316] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:10:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:10:39.907559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db9d1c-46d1-4a32-be31-9b28723b5acd None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:39.907858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db9d1c-46d1-4a32-be31-9b28723b5acd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:39.908120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db9d1c-46d1-4a32-be31-9b28723b5acd None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:39.910117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 656/1317] 10.222.0.98 () {54 vars in 965 bytes} [Tue Jul 26 15:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:10:39.918410 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350bd78-76d8-43be-af4a-b2dbb1a5cb20 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:39.918868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350bd78-76d8-43be-af4a-b2dbb1a5cb20 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:39.919317 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350bd78-76d8-43be-af4a-b2dbb1a5cb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:40.013710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-0350bd78-76d8-43be-af4a-b2dbb1a5cb20 None None] MFA Rules not processed for user `e44d2d2b50484fb89b0688ff28615d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:40.015360 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0350bd78-76d8-43be-af4a-b2dbb1a5cb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:40.108830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 662/1318] 10.222.0.98 () {58 vars in 1062 bytes} [Tue Jul 26 15:10:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:10:40.120235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db9d1c-46d1-4a32-be31-9b28723b5acd None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:40.122930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f0db9d1c-46d1-4a32-be31-9b28723b5acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:40.135994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:40.263237 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db9d1c-46d1-4a32-be31-9b28723b5acd None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:40.356800 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292c332-3c22-45c2-b001-12a25f59c742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:40.357523 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292c332-3c22-45c2-b001-12a25f59c742 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:40.357810 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292c332-3c22-45c2-b001-12a25f59c742 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:40.358174 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292c332-3c22-45c2-b001-12a25f59c742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:40.360006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6292c332-3c22-45c2-b001-12a25f59c742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:40.439742 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:40.527912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292c332-3c22-45c2-b001-12a25f59c742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:40.529479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292c332-3c22-45c2-b001-12a25f59c742 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:40.552966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 657/1319] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:10:44.255813 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83e3c2-53cf-418b-be86-bbf0a2c9287c None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:44.256425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83e3c2-53cf-418b-be86-bbf0a2c9287c None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:44.256826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83e3c2-53cf-418b-be86-bbf0a2c9287c None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:44.259509 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 663/1320] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:10:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:10:44.267879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3339dc-21dc-45e6-a215-5d0f7922a849 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:44.268487 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3339dc-21dc-45e6-a215-5d0f7922a849 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:44.268809 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3339dc-21dc-45e6-a215-5d0f7922a849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:44.351651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2d3339dc-21dc-45e6-a215-5d0f7922a849 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:44.353103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2d3339dc-21dc-45e6-a215-5d0f7922a849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:44.478060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 658/1321] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:10:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:44.519641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83e3c2-53cf-418b-be86-bbf0a2c9287c None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:44.521857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0f83e3c2-53cf-418b-be86-bbf0a2c9287c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:44.579759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:44.646395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83e3c2-53cf-418b-be86-bbf0a2c9287c None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:44.762339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e0e31-ed4b-4f44-9eb0-4b9131d81dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:44.763519 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e0e31-ed4b-4f44-9eb0-4b9131d81dcb service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:44.763954 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e0e31-ed4b-4f44-9eb0-4b9131d81dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:44.764443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e0e31-ed4b-4f44-9eb0-4b9131d81dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:44.767829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-190e0e31-ed4b-4f44-9eb0-4b9131d81dcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:44.896823 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:44.914247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e0e31-ed4b-4f44-9eb0-4b9131d81dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:44.915747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e0e31-ed4b-4f44-9eb0-4b9131d81dcb service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:44.936826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 664/1322] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:10:48.578330 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534597fa-a217-4781-b37c-7396a2c166dc None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:48.579115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534597fa-a217-4781-b37c-7396a2c166dc None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:48.579704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534597fa-a217-4781-b37c-7396a2c166dc None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:48.583302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 659/1323] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:10:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:10:48.591901 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e344336-263f-40e3-9041-d0f1718c2a3f None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:48.592656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e344336-263f-40e3-9041-d0f1718c2a3f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:48.592656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e344336-263f-40e3-9041-d0f1718c2a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:48.679461 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-5e344336-263f-40e3-9041-d0f1718c2a3f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:48.680781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5e344336-263f-40e3-9041-d0f1718c2a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:48.827171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 665/1324] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:48.867518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534597fa-a217-4781-b37c-7396a2c166dc None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:48.869058 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-534597fa-a217-4781-b37c-7396a2c166dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:48.890553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:48.998378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534597fa-a217-4781-b37c-7396a2c166dc None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:49.123225 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5021358-529b-40f1-ac89-e8f2e8a3ce26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:49.124315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5021358-529b-40f1-ac89-e8f2e8a3ce26 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:49.124821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5021358-529b-40f1-ac89-e8f2e8a3ce26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:49.125329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5021358-529b-40f1-ac89-e8f2e8a3ce26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:49.129022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b5021358-529b-40f1-ac89-e8f2e8a3ce26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:49.224678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:49.273121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5021358-529b-40f1-ac89-e8f2e8a3ce26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:49.274638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5021358-529b-40f1-ac89-e8f2e8a3ce26 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:49.298285 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 660/1325] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:10:51.657438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9662b-1f38-4cb6-9ae1-152ca4514fe7 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:51.657978 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9662b-1f38-4cb6-9ae1-152ca4514fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:51.657978 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9662b-1f38-4cb6-9ae1-152ca4514fe7 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:51.659468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 666/1326] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:10:51.665395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74053e1-a530-4762-9030-804ea21b9753 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:51.666200 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74053e1-a530-4762-9030-804ea21b9753 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:51.666200 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74053e1-a530-4762-9030-804ea21b9753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:51.756827 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b74053e1-a530-4762-9030-804ea21b9753 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:51.757994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b74053e1-a530-4762-9030-804ea21b9753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:51.879055 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 661/1327] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:51.922011 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9662b-1f38-4cb6-9ae1-152ca4514fe7 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:51.923763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2fb9662b-1f38-4cb6-9ae1-152ca4514fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:52.008360 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:52.068406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9662b-1f38-4cb6-9ae1-152ca4514fe7 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:52.222826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1debad9-aaa1-4f9c-877c-d6ef846dc064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:52.223933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1debad9-aaa1-4f9c-877c-d6ef846dc064 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:52.224441 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1debad9-aaa1-4f9c-877c-d6ef846dc064 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:52.224986 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1debad9-aaa1-4f9c-877c-d6ef846dc064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:52.228422 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f1debad9-aaa1-4f9c-877c-d6ef846dc064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:52.444413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:52.447078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1debad9-aaa1-4f9c-877c-d6ef846dc064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:52.448565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1debad9-aaa1-4f9c-877c-d6ef846dc064 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:52.473175 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 667/1328] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:54.964683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b13ac-11bd-4a68-87bf-688ae3a00abd None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:54.965244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b13ac-11bd-4a68-87bf-688ae3a00abd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:54.965636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b13ac-11bd-4a68-87bf-688ae3a00abd None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:54.968203 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 662/1329] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:10:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:10:54.976441 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8f62c-8a5c-4ccc-aefb-2b5253e627dd None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:54.977111 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8f62c-8a5c-4ccc-aefb-2b5253e627dd None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:54.977111 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8f62c-8a5c-4ccc-aefb-2b5253e627dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:55.062547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-c2d8f62c-8a5c-4ccc-aefb-2b5253e627dd None None] MFA Rules not processed for user `2a32a15f2a584ef0acafa1e4cd085d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:55.063929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c2d8f62c-8a5c-4ccc-aefb-2b5253e627dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:55.181129 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 668/1330] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:10:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:10:55.224349 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b13ac-11bd-4a68-87bf-688ae3a00abd None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:55.227870 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4d5b13ac-11bd-4a68-87bf-688ae3a00abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:55.285039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:55.413011 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b13ac-11bd-4a68-87bf-688ae3a00abd None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:55.518448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35ba46-f31f-4fc5-be69-218acb7069a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:55.519275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35ba46-f31f-4fc5-be69-218acb7069a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:55.519560 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35ba46-f31f-4fc5-be69-218acb7069a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:55.519862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35ba46-f31f-4fc5-be69-218acb7069a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:55.521850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-da35ba46-f31f-4fc5-be69-218acb7069a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:55.629930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:55.689054 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35ba46-f31f-4fc5-be69-218acb7069a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:55.692755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35ba46-f31f-4fc5-be69-218acb7069a0 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:55.715118 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 663/1331] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:58.462627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0280fc1-3c7b-43fc-8529-915a551e88e6 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:58.463238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0280fc1-3c7b-43fc-8529-915a551e88e6 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:58.463238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0280fc1-3c7b-43fc-8529-915a551e88e6 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:58.464835 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 669/1332] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:10:58.471196 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f7f60-9910-4430-9bc9-c6cc9b88a391 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:58.472036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f7f60-9910-4430-9bc9-c6cc9b88a391 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:58.472036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f7f60-9910-4430-9bc9-c6cc9b88a391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:58.555783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-986f7f60-9910-4430-9bc9-c6cc9b88a391 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:58.557053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-986f7f60-9910-4430-9bc9-c6cc9b88a391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:58.682348 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 664/1333] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:10:58.721723 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0280fc1-3c7b-43fc-8529-915a551e88e6 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:58.723496 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c0280fc1-3c7b-43fc-8529-915a551e88e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:58.805280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:58.844665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0280fc1-3c7b-43fc-8529-915a551e88e6 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:58.958677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc066e3-ccf4-4e50-a2ee-1887d1b1ae80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:58.959742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc066e3-ccf4-4e50-a2ee-1887d1b1ae80 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:58.960255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc066e3-ccf4-4e50-a2ee-1887d1b1ae80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:58.960729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc066e3-ccf4-4e50-a2ee-1887d1b1ae80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:58.963834 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4bc066e3-ccf4-4e50-a2ee-1887d1b1ae80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:59.169951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc066e3-ccf4-4e50-a2ee-1887d1b1ae80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:59.172452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc066e3-ccf4-4e50-a2ee-1887d1b1ae80 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:59.193804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:59.213441 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 670/1334] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:01.430283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fcbed-0c65-4928-b5c5-6e5c9b8a0269 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:01.430912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fcbed-0c65-4928-b5c5-6e5c9b8a0269 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:01.430912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fcbed-0c65-4928-b5c5-6e5c9b8a0269 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:01.432240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 665/1335] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:11:01.438017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097cd9b-b48f-4a17-b6d4-52eb17a6083a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:01.438626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097cd9b-b48f-4a17-b6d4-52eb17a6083a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:01.438626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097cd9b-b48f-4a17-b6d4-52eb17a6083a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:01.519825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-7097cd9b-b48f-4a17-b6d4-52eb17a6083a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:01.521070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7097cd9b-b48f-4a17-b6d4-52eb17a6083a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:01.657499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 671/1336] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:01.702561 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fcbed-0c65-4928-b5c5-6e5c9b8a0269 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:01.704178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-047fcbed-0c65-4928-b5c5-6e5c9b8a0269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:01.756168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:01.855469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fcbed-0c65-4928-b5c5-6e5c9b8a0269 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:01.966461 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedeb5e-18d1-4e42-b78e-345fc90d3fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:01.967506 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedeb5e-18d1-4e42-b78e-345fc90d3fde service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:01.967665 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedeb5e-18d1-4e42-b78e-345fc90d3fde service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:01.968180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedeb5e-18d1-4e42-b78e-345fc90d3fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:01.970072 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-eaedeb5e-18d1-4e42-b78e-345fc90d3fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:02.072860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:02.105628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedeb5e-18d1-4e42-b78e-345fc90d3fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:02.107247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedeb5e-18d1-4e42-b78e-345fc90d3fde service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:02.132110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 666/1337] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:11:05.398139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e55492-c693-4559-9823-6fb8d69cbc60 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.398812 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e55492-c693-4559-9823-6fb8d69cbc60 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.398812 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e55492-c693-4559-9823-6fb8d69cbc60 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.400172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 672/1338] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:11:05.406695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9f8dd-ee51-4655-b36b-bee0b43ebd80 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.407498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9f8dd-ee51-4655-b36b-bee0b43ebd80 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.408204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9f8dd-ee51-4655-b36b-bee0b43ebd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.488046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-57b9f8dd-ee51-4655-b36b-bee0b43ebd80 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:05.489211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-57b9f8dd-ee51-4655-b36b-bee0b43ebd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:05.606558 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 667/1339] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:11:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:05.647032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e55492-c693-4559-9823-6fb8d69cbc60 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.648587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a2e55492-c693-4559-9823-6fb8d69cbc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:05.741220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:05.782228 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e55492-c693-4559-9823-6fb8d69cbc60 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.874266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbae2c-4684-4895-ad00-bfe667f14cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.874942 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbae2c-4684-4895-ad00-bfe667f14cfd service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.875230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbae2c-4684-4895-ad00-bfe667f14cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.875507 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbae2c-4684-4895-ad00-bfe667f14cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.877277 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8adbae2c-4684-4895-ad00-bfe667f14cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:06.011697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adbae2c-4684-4895-ad00-bfe667f14cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:06.013098 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adbae2c-4684-4895-ad00-bfe667f14cfd service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:06.037563 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 673/1340] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:11:11.378717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81414093-8c23-402e-a327-23b6faa7c921 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:11.378717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81414093-8c23-402e-a327-23b6faa7c921 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:11.379587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81414093-8c23-402e-a327-23b6faa7c921 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:11.382937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 668/1341] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:11:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:11:11.389314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f2e45-5390-46e7-945f-d1f792bff79d None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:11.390156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f2e45-5390-46e7-945f-d1f792bff79d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:11.390156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f2e45-5390-46e7-945f-d1f792bff79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:11.401784 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:11.522214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a31f2e45-5390-46e7-945f-d1f792bff79d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:11.523568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a31f2e45-5390-46e7-945f-d1f792bff79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:11.685736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 674/1342] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:11.763317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81414093-8c23-402e-a327-23b6faa7c921 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:11.766843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-81414093-8c23-402e-a327-23b6faa7c921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:11.879370 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:11.973301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81414093-8c23-402e-a327-23b6faa7c921 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:12.109650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aae93-649e-4186-978b-dc08348a0335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:12.111938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aae93-649e-4186-978b-dc08348a0335 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:12.112411 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aae93-649e-4186-978b-dc08348a0335 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:12.112985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aae93-649e-4186-978b-dc08348a0335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:12.115901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-748aae93-649e-4186-978b-dc08348a0335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:12.264019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:12.289301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748aae93-649e-4186-978b-dc08348a0335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:12.290983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748aae93-649e-4186-978b-dc08348a0335 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:12.317703 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 669/1343] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:15.874014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79919a07-335c-41a9-9892-2ce3a6363c2b None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:15.874605 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79919a07-335c-41a9-9892-2ce3a6363c2b None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:15.874605 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79919a07-335c-41a9-9892-2ce3a6363c2b None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:15.876529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 675/1344] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:11:15.882742 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04dbf6-062c-4fe3-a7d3-2a46716cd31a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:15.883258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04dbf6-062c-4fe3-a7d3-2a46716cd31a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:15.883346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04dbf6-062c-4fe3-a7d3-2a46716cd31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:15.975275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9d04dbf6-062c-4fe3-a7d3-2a46716cd31a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:15.977578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9d04dbf6-062c-4fe3-a7d3-2a46716cd31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:16.129165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 670/1345] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:11:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:16.173246 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79919a07-335c-41a9-9892-2ce3a6363c2b None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:16.176258 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-79919a07-335c-41a9-9892-2ce3a6363c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:16.317812 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:16.346297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79919a07-335c-41a9-9892-2ce3a6363c2b None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:16.460565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529ee1d-5cac-425e-b5ec-329a2a3c3615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:16.461556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529ee1d-5cac-425e-b5ec-329a2a3c3615 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:16.462067 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529ee1d-5cac-425e-b5ec-329a2a3c3615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:16.462687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529ee1d-5cac-425e-b5ec-329a2a3c3615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:16.470399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e529ee1d-5cac-425e-b5ec-329a2a3c3615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:16.642172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529ee1d-5cac-425e-b5ec-329a2a3c3615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:16.644150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529ee1d-5cac-425e-b5ec-329a2a3c3615 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:16.667991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 676/1346] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:21.691235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99fdff-4ccc-4309-bfc3-f30511aec69d None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:21.691948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99fdff-4ccc-4309-bfc3-f30511aec69d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:21.691948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99fdff-4ccc-4309-bfc3-f30511aec69d None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:21.693175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 671/1347] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:11:21.699088 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dae7f1-a109-4c4b-90d3-ffd8abd17bfd None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:21.699664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dae7f1-a109-4c4b-90d3-ffd8abd17bfd None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:21.699778 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dae7f1-a109-4c4b-90d3-ffd8abd17bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:21.718195 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:21.792070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-06dae7f1-a109-4c4b-90d3-ffd8abd17bfd None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:21.793701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-06dae7f1-a109-4c4b-90d3-ffd8abd17bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:21.935190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 677/1348] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:21.981529 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99fdff-4ccc-4309-bfc3-f30511aec69d None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:21.984060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7f99fdff-4ccc-4309-bfc3-f30511aec69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:22.079987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:22.164895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99fdff-4ccc-4309-bfc3-f30511aec69d None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:22.314246 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4215c9-7b03-4fd7-bb9f-95697d12edeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:22.315281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4215c9-7b03-4fd7-bb9f-95697d12edeb service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.315747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4215c9-7b03-4fd7-bb9f-95697d12edeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.316171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4215c9-7b03-4fd7-bb9f-95697d12edeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.319236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7c4215c9-7b03-4fd7-bb9f-95697d12edeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:22.529826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:22.537299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4215c9-7b03-4fd7-bb9f-95697d12edeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:22.539783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4215c9-7b03-4fd7-bb9f-95697d12edeb service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:22.578998 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 672/1349] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:29.610565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fd3ee-c376-472e-9e8d-586578f9fa72 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.612533 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fd3ee-c376-472e-9e8d-586578f9fa72 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.616737 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fd3ee-c376-472e-9e8d-586578f9fa72 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.621568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 678/1350] 10.222.0.98 () {54 vars in 921 bytes} [Tue Jul 26 15:11:29 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:11:29.631015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e8d5-ec87-4815-abba-57ad80c50949 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.631754 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e8d5-ec87-4815-abba-57ad80c50949 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.631754 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e8d5-ec87-4815-abba-57ad80c50949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.771663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-6683e8d5-ec87-4815-abba-57ad80c50949 None None] MFA Rules not processed for user `448161cd39dc4a6786c8813faa79376a`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:29.773001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6683e8d5-ec87-4815-abba-57ad80c50949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:30.046316 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 673/1351] 10.222.0.98 () {58 vars in 1018 bytes} [Tue Jul 26 15:11:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:31.932687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=59 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:35.864744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea178a3-2d3b-4b33-97c6-de3a40a1a4cf None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:35.865723 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea178a3-2d3b-4b33-97c6-de3a40a1a4cf None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:35.866178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea178a3-2d3b-4b33-97c6-de3a40a1a4cf None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:35.868198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 679/1352] 10.222.0.98 () {54 vars in 921 bytes} [Tue Jul 26 15:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:11:35.878839 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b08e89-cbd9-4183-b0b6-13609778cb75 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:35.880256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b08e89-cbd9-4183-b0b6-13609778cb75 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:35.881036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b08e89-cbd9-4183-b0b6-13609778cb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:35.990982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:36.024846 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a5b08e89-cbd9-4183-b0b6-13609778cb75 None None] MFA Rules not processed for user `448161cd39dc4a6786c8813faa79376a`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:36.027482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a5b08e89-cbd9-4183-b0b6-13609778cb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:36.261166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 674/1353] 10.222.0.98 () {58 vars in 1018 bytes} [Tue Jul 26 15:11:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:37.535351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fe710-1204-45e3-ba64-75b7cb7b2adb None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:37.535911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fe710-1204-45e3-ba64-75b7cb7b2adb None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:37.535911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fe710-1204-45e3-ba64-75b7cb7b2adb None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:37.537360 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 680/1354] 10.222.0.98 () {54 vars in 921 bytes} [Tue Jul 26 15:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:11:37.544367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b94ae4-6893-47c1-b298-97086bfb6449 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:37.545153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b94ae4-6893-47c1-b298-97086bfb6449 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:37.545153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b94ae4-6893-47c1-b298-97086bfb6449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:37.682173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-88b94ae4-6893-47c1-b298-97086bfb6449 None None] MFA Rules not processed for user `448161cd39dc4a6786c8813faa79376a`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:37.684217 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-88b94ae4-6893-47c1-b298-97086bfb6449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:37.757439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:37.872581 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 675/1355] 10.222.0.98 () {58 vars in 1018 bytes} [Tue Jul 26 15:11:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:42.288950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59173c2b-706e-4e6e-9be2-4fd581df14d2 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:42.289817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59173c2b-706e-4e6e-9be2-4fd581df14d2 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:42.289817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59173c2b-706e-4e6e-9be2-4fd581df14d2 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:42.291103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 681/1356] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:11:42.298975 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f7948-0ecd-4772-8daa-0539bdf66cd9 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:42.299523 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f7948-0ecd-4772-8daa-0539bdf66cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:42.300163 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f7948-0ecd-4772-8daa-0539bdf66cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:42.420354 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ac0f7948-0ecd-4772-8daa-0539bdf66cd9 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:42.422268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ac0f7948-0ecd-4772-8daa-0539bdf66cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:42.685197 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 676/1357] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:11:42.761146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3b12-f419-4dc9-a384-2f5520a6283d None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:42.762214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3b12-f419-4dc9-a384-2f5520a6283d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:42.763151 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3b12-f419-4dc9-a384-2f5520a6283d None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:42.766405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 682/1358] 10.222.0.98 () {54 vars in 962 bytes} [Tue Jul 26 15:11:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:11:42.788999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab686d-4b14-4164-824e-174917467c09 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:42.789292 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab686d-4b14-4164-824e-174917467c09 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:42.789480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab686d-4b14-4164-824e-174917467c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:42.822725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:42.901966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-54ab686d-4b14-4164-824e-174917467c09 None None] MFA Rules not processed for user `a4a6c0e7ca434010980d7cac1800dbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:42.903273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-54ab686d-4b14-4164-824e-174917467c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:43.099942 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 677/1359] 10.222.0.98 () {58 vars in 1059 bytes} [Tue Jul 26 15:11:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:43.116668 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3b12-f419-4dc9-a384-2f5520a6283d None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:43.118215 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-375e3b12-f419-4dc9-a384-2f5520a6283d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:43.302750 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3b12-f419-4dc9-a384-2f5520a6283d None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:43.404199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:43.500386 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21c13a-e0a8-414e-8019-3366bd13257d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:43.502643 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21c13a-e0a8-414e-8019-3366bd13257d service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:43.503610 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21c13a-e0a8-414e-8019-3366bd13257d service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:43.504662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21c13a-e0a8-414e-8019-3366bd13257d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:43.508890 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5a21c13a-e0a8-414e-8019-3366bd13257d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:43.699197 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21c13a-e0a8-414e-8019-3366bd13257d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:43.700853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21c13a-e0a8-414e-8019-3366bd13257d service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:43.727825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 683/1360] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:11:46.373057 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025913b-f50e-4314-8155-8ff69bd68693 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:46.374905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025913b-f50e-4314-8155-8ff69bd68693 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:46.374905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025913b-f50e-4314-8155-8ff69bd68693 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:46.377480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 678/1361] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:11:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:11:46.386568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef2c6f-177a-4585-a929-c242a32fd498 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:46.387119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef2c6f-177a-4585-a929-c242a32fd498 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:46.387573 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef2c6f-177a-4585-a929-c242a32fd498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:46.573355 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-89ef2c6f-177a-4585-a929-c242a32fd498 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:46.575800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-89ef2c6f-177a-4585-a929-c242a32fd498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:46.641732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:46.742229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 684/1362] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:46.790535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025913b-f50e-4314-8155-8ff69bd68693 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:46.792662 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b025913b-f50e-4314-8155-8ff69bd68693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:46.905191 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:47.042576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025913b-f50e-4314-8155-8ff69bd68693 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:47.243820 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d334300-b0b9-42c3-8d50-6de4f9d7e4cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:47.245619 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d334300-b0b9-42c3-8d50-6de4f9d7e4cb service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:47.246411 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d334300-b0b9-42c3-8d50-6de4f9d7e4cb service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:47.247121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d334300-b0b9-42c3-8d50-6de4f9d7e4cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:47.250947 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2d334300-b0b9-42c3-8d50-6de4f9d7e4cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:47.304040 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:47.446532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d334300-b0b9-42c3-8d50-6de4f9d7e4cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:47.449813 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d334300-b0b9-42c3-8d50-6de4f9d7e4cb service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:47.489138 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 679/1363] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:11:50.466271 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328ccf6-8995-4662-9bc6-8de8b4c5942f None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:50.467362 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328ccf6-8995-4662-9bc6-8de8b4c5942f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:50.468378 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328ccf6-8995-4662-9bc6-8de8b4c5942f None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:50.470803 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 685/1364] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:11:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:11:50.476597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e1966-2303-4c06-92ed-7e324bb45551 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:50.477266 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e1966-2303-4c06-92ed-7e324bb45551 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:50.477266 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e1966-2303-4c06-92ed-7e324bb45551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:50.631648 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3a5e1966-2303-4c06-92ed-7e324bb45551 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:50.634350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3a5e1966-2303-4c06-92ed-7e324bb45551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:50.804892 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:50.809368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 680/1365] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:11:50.887372 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf7e10-3653-45c6-bc97-6642cbe309bb None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:50.887372 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf7e10-3653-45c6-bc97-6642cbe309bb None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:50.887943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf7e10-3653-45c6-bc97-6642cbe309bb None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:50.891146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 686/1366] 10.222.0.98 () {54 vars in 962 bytes} [Tue Jul 26 15:11:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:11:50.900749 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cb2ae-7c24-4c36-8c2a-74a3f20c1f43 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:50.901229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cb2ae-7c24-4c36-8c2a-74a3f20c1f43 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:50.902241 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cb2ae-7c24-4c36-8c2a-74a3f20c1f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:51.080561 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1e8cb2ae-7c24-4c36-8c2a-74a3f20c1f43 None None] MFA Rules not processed for user `a4a6c0e7ca434010980d7cac1800dbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:51.080561 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1e8cb2ae-7c24-4c36-8c2a-74a3f20c1f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:51.407149 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 681/1367] 10.222.0.98 () {58 vars in 1059 bytes} [Tue Jul 26 15:11:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:51.416102 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf7e10-3653-45c6-bc97-6642cbe309bb None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:51.419870 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-afdf7e10-3653-45c6-bc97-6642cbe309bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:51.729226 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf7e10-3653-45c6-bc97-6642cbe309bb None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:51.759274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:51.897923 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2f261-fd5b-454a-97bc-fd650d3ad688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:51.898588 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2f261-fd5b-454a-97bc-fd650d3ad688 service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:51.898868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2f261-fd5b-454a-97bc-fd650d3ad688 service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:51.899147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2f261-fd5b-454a-97bc-fd650d3ad688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:51.900890 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-dfd2f261-fd5b-454a-97bc-fd650d3ad688 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:52.047138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2f261-fd5b-454a-97bc-fd650d3ad688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:52.049238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2f261-fd5b-454a-97bc-fd650d3ad688 service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:52.086493 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 687/1368] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:52.211475 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e23ffc-3370-49cf-a710-f03c5b3a6f1b None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.212082 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e23ffc-3370-49cf-a710-f03c5b3a6f1b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.212082 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e23ffc-3370-49cf-a710-f03c5b3a6f1b None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.213499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 682/1369] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:11:52.221177 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41025b36-d495-488e-a63c-07a009fde4e5 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.221539 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41025b36-d495-488e-a63c-07a009fde4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.221874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41025b36-d495-488e-a63c-07a009fde4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.266933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:52.317370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-41025b36-d495-488e-a63c-07a009fde4e5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:52.319027 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-41025b36-d495-488e-a63c-07a009fde4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:52.509037 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 688/1370] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:11:52.888600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f1bd-9bf5-4247-a597-89a06bcf8a3a None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.888600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f1bd-9bf5-4247-a597-89a06bcf8a3a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.888600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f1bd-9bf5-4247-a597-89a06bcf8a3a None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.890797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 683/1371] 10.222.0.98 () {54 vars in 964 bytes} [Tue Jul 26 15:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:11:52.896045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90268e8f-adb0-4266-b9a5-e279922c34bb None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.896471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90268e8f-adb0-4266-b9a5-e279922c34bb None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.896471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90268e8f-adb0-4266-b9a5-e279922c34bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:53.004376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-90268e8f-adb0-4266-b9a5-e279922c34bb None None] MFA Rules not processed for user `96d09fca7f864129ab0dcb90fb5d24e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:53.005661 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-90268e8f-adb0-4266-b9a5-e279922c34bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:53.072962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:53.117842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 689/1372] 10.222.0.98 () {58 vars in 1061 bytes} [Tue Jul 26 15:11:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:53.128251 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079f1bd-9bf5-4247-a597-89a06bcf8a3a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:53.129827 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6079f1bd-9bf5-4247-a597-89a06bcf8a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:53.201645 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:53.284363 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079f1bd-9bf5-4247-a597-89a06bcf8a3a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:53.424032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39082c57-f44b-4b65-afe7-54530e479d00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:53.425388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39082c57-f44b-4b65-afe7-54530e479d00 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:53.425793 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39082c57-f44b-4b65-afe7-54530e479d00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:53.426284 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39082c57-f44b-4b65-afe7-54530e479d00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:53.430029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-39082c57-f44b-4b65-afe7-54530e479d00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:53.681162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:53.718806 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39082c57-f44b-4b65-afe7-54530e479d00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:53.724609 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39082c57-f44b-4b65-afe7-54530e479d00 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:53.784869 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 684/1373] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:11:54.532382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afdc64-4dd5-48db-a979-89a3e904b854 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:54.533188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afdc64-4dd5-48db-a979-89a3e904b854 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:54.533188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afdc64-4dd5-48db-a979-89a3e904b854 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:54.534305 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 690/1374] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:11:54.540481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89caebb-aa3b-4b21-b793-a1ad823f7921 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:54.541287 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89caebb-aa3b-4b21-b793-a1ad823f7921 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:54.541433 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89caebb-aa3b-4b21-b793-a1ad823f7921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:54.627414 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f89caebb-aa3b-4b21-b793-a1ad823f7921 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:54.628685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f89caebb-aa3b-4b21-b793-a1ad823f7921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:54.755370 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 685/1375] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:54.802436 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afdc64-4dd5-48db-a979-89a3e904b854 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:54.804117 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e3afdc64-4dd5-48db-a979-89a3e904b854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:55.023430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afdc64-4dd5-48db-a979-89a3e904b854 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:55.124456 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:55.241379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3785c77-529f-4f93-bb65-09ecacf1931c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:55.242550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3785c77-529f-4f93-bb65-09ecacf1931c service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:55.243201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3785c77-529f-4f93-bb65-09ecacf1931c service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:55.243734 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3785c77-529f-4f93-bb65-09ecacf1931c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:55.247290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d3785c77-529f-4f93-bb65-09ecacf1931c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:55.435331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3785c77-529f-4f93-bb65-09ecacf1931c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:55.439375 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3785c77-529f-4f93-bb65-09ecacf1931c service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:55.476369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 691/1376] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:58.096389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc9592-d24d-45f3-a149-0ea3fc44b76f None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:58.096922 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc9592-d24d-45f3-a149-0ea3fc44b76f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:58.096922 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc9592-d24d-45f3-a149-0ea3fc44b76f None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:58.098816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 686/1377] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:11:58.105378 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ba980-5b7e-4a6f-b075-624e31453fcd None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:58.106038 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ba980-5b7e-4a6f-b075-624e31453fcd None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:58.106038 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ba980-5b7e-4a6f-b075-624e31453fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:58.196729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-ff7ba980-5b7e-4a6f-b075-624e31453fcd None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:58.198399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ff7ba980-5b7e-4a6f-b075-624e31453fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:58.207393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:58.326198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 692/1378] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:58.375527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc9592-d24d-45f3-a149-0ea3fc44b76f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:58.377183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-54fc9592-d24d-45f3-a149-0ea3fc44b76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:58.453028 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:58.610679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc9592-d24d-45f3-a149-0ea3fc44b76f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:58.941217 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f111178-6259-4b60-902b-2922c253bbfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:58.946854 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f111178-6259-4b60-902b-2922c253bbfb service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:58.948187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f111178-6259-4b60-902b-2922c253bbfb service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:58.948187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f111178-6259-4b60-902b-2922c253bbfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:58.954581 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1f111178-6259-4b60-902b-2922c253bbfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:59.153189 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:59.153189 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f111178-6259-4b60-902b-2922c253bbfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:59.153189 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f111178-6259-4b60-902b-2922c253bbfb service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:59.153189 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 687/1379] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 751 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:12:02.259331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888d985-052a-4b38-99e3-52f391e14d26 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.260402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888d985-052a-4b38-99e3-52f391e14d26 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.260402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888d985-052a-4b38-99e3-52f391e14d26 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:02.262730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 693/1380] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:12:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:02.278602 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ce73b-7f98-4f7c-9c0e-eb455d96df93 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.279997 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ce73b-7f98-4f7c-9c0e-eb455d96df93 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.279997 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ce73b-7f98-4f7c-9c0e-eb455d96df93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:02.424503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f26ce73b-7f98-4f7c-9c0e-eb455d96df93 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:02.427284 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f26ce73b-7f98-4f7c-9c0e-eb455d96df93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:02.633148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:02.644601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 688/1381] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:12:02.729525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888d985-052a-4b38-99e3-52f391e14d26 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:02.732174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8888d985-052a-4b38-99e3-52f391e14d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:03.057638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:03.083955 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888d985-052a-4b38-99e3-52f391e14d26 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:03.351606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c7562-7b74-4052-be8e-c17913f74faf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:03.353225 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c7562-7b74-4052-be8e-c17913f74faf service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:03.353726 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c7562-7b74-4052-be8e-c17913f74faf service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:03.354233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c7562-7b74-4052-be8e-c17913f74faf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.358840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-941c7562-7b74-4052-be8e-c17913f74faf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:03.531045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c7562-7b74-4052-be8e-c17913f74faf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:03.535673 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c7562-7b74-4052-be8e-c17913f74faf service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:03.557331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:03.568865 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 694/1382] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 840 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:12:07.097801 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8528aa-b12b-4443-8bd7-e3d12ec67181 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:07.098429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8528aa-b12b-4443-8bd7-e3d12ec67181 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:07.098542 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8528aa-b12b-4443-8bd7-e3d12ec67181 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:07.100473 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 689/1383] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:07.107380 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeee518-73e8-4a14-983f-18bd5c3ab646 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:07.108472 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeee518-73e8-4a14-983f-18bd5c3ab646 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:07.108472 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeee518-73e8-4a14-983f-18bd5c3ab646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:07.197813 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-dfeee518-73e8-4a14-983f-18bd5c3ab646 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:07.199392 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-dfeee518-73e8-4a14-983f-18bd5c3ab646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:07.360438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 695/1384] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:12:07.409595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8528aa-b12b-4443-8bd7-e3d12ec67181 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:07.411195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-fe8528aa-b12b-4443-8bd7-e3d12ec67181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:07.687323 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8528aa-b12b-4443-8bd7-e3d12ec67181 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:07.813796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:07.898945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6744a-e9a2-4c6f-b534-f92e25414044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:07.899904 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6744a-e9a2-4c6f-b534-f92e25414044 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:07.900348 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6744a-e9a2-4c6f-b534-f92e25414044 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:07.900788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6744a-e9a2-4c6f-b534-f92e25414044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:07.903090 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-59f6744a-e9a2-4c6f-b534-f92e25414044 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:08.055520 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6744a-e9a2-4c6f-b534-f92e25414044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:08.057110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6744a-e9a2-4c6f-b534-f92e25414044 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:08.080254 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 690/1385] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:12:10.753323 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d0692-7bd9-41fd-a5c8-3fac596aaa31 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:10.754029 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d0692-7bd9-41fd-a5c8-3fac596aaa31 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:10.754186 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d0692-7bd9-41fd-a5c8-3fac596aaa31 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:10.756887 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 696/1386] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:12:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:10.766476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c31a31-1217-4fdc-9a76-d50a96f34afe None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:10.767274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c31a31-1217-4fdc-9a76-d50a96f34afe None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:10.767487 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c31a31-1217-4fdc-9a76-d50a96f34afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:10.882090 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d5c31a31-1217-4fdc-9a76-d50a96f34afe None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:10.884297 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d5c31a31-1217-4fdc-9a76-d50a96f34afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:10.943177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:11.081129 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 691/1387] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:11.162200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d0692-7bd9-41fd-a5c8-3fac596aaa31 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:11.164134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e91d0692-7bd9-41fd-a5c8-3fac596aaa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:11.283955 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:11.417683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d0692-7bd9-41fd-a5c8-3fac596aaa31 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:11.655578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3176de-e0ce-4ce2-8729-00fe38bbe4ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:11.656850 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3176de-e0ce-4ce2-8729-00fe38bbe4ec service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:11.657471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3176de-e0ce-4ce2-8729-00fe38bbe4ec service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:11.658111 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3176de-e0ce-4ce2-8729-00fe38bbe4ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:11.662207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-de3176de-e0ce-4ce2-8729-00fe38bbe4ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:11.729467 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:11.810151 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3176de-e0ce-4ce2-8729-00fe38bbe4ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:11.812167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3176de-e0ce-4ce2-8729-00fe38bbe4ec service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:11.839358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 697/1388] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:12:12.644317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98b364-06a9-4903-a238-929098420329 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:12.645123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98b364-06a9-4903-a238-929098420329 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:12.645307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98b364-06a9-4903-a238-929098420329 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:12.647761 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 692/1389] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:12:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:12.656051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711dde9-53da-4c9f-85c1-0cb9f438feb9 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:12.656555 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711dde9-53da-4c9f-85c1-0cb9f438feb9 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:12.657060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711dde9-53da-4c9f-85c1-0cb9f438feb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:12.770407 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b711dde9-53da-4c9f-85c1-0cb9f438feb9 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:12.771724 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b711dde9-53da-4c9f-85c1-0cb9f438feb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:12.944912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 698/1390] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:13.046147 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c488b8e-610a-4509-8a4a-81512e3730c9 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:13.051569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c488b8e-610a-4509-8a4a-81512e3730c9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:13.051569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c488b8e-610a-4509-8a4a-81512e3730c9 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:13.051569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 693/1391] 10.222.0.98 () {54 vars in 966 bytes} [Tue Jul 26 15:12:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:13.058883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036707ae-1c6c-420d-b98f-8fcbc5dd18a4 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:13.059360 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036707ae-1c6c-420d-b98f-8fcbc5dd18a4 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:13.061549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036707ae-1c6c-420d-b98f-8fcbc5dd18a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:13.091086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:13.189480 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-036707ae-1c6c-420d-b98f-8fcbc5dd18a4 None None] MFA Rules not processed for user `4d85dc9f9f15480db927e617c992e1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:13.190813 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-036707ae-1c6c-420d-b98f-8fcbc5dd18a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:13.313658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 699/1392] 10.222.0.98 () {58 vars in 1063 bytes} [Tue Jul 26 15:12:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:13.322653 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c488b8e-610a-4509-8a4a-81512e3730c9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:13.324260 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3c488b8e-610a-4509-8a4a-81512e3730c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:13.479230 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c488b8e-610a-4509-8a4a-81512e3730c9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:13.571227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:13.606103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d101e09-26f3-4208-9591-f65827c5684b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d85dc9f9f15480db927e617c992e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:13.607891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d101e09-26f3-4208-9591-f65827c5684b service glance] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:13.608651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d101e09-26f3-4208-9591-f65827c5684b service glance] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:13.609391 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d101e09-26f3-4208-9591-f65827c5684b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:13.612807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4d101e09-26f3-4208-9591-f65827c5684b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:13.790074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d101e09-26f3-4208-9591-f65827c5684b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:13.792010 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d101e09-26f3-4208-9591-f65827c5684b service glance] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:13.817098 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 694/1393] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:12:14.352359 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05625aff-7c66-4116-9700-5f1e02b521c2 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:14.352359 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05625aff-7c66-4116-9700-5f1e02b521c2 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:14.353023 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05625aff-7c66-4116-9700-5f1e02b521c2 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:14.354191 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 700/1394] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:14.360721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac1227-82a8-410e-ac7e-b2e8e0761249 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:14.361156 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac1227-82a8-410e-ac7e-b2e8e0761249 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:14.361439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac1227-82a8-410e-ac7e-b2e8e0761249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:14.462466 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-04ac1227-82a8-410e-ac7e-b2e8e0761249 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:14.463718 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-04ac1227-82a8-410e-ac7e-b2e8e0761249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:14.539147 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:14.638896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 695/1395] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:14.693997 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05625aff-7c66-4116-9700-5f1e02b521c2 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:14.704711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-05625aff-7c66-4116-9700-5f1e02b521c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:14.825752 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:14.874918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05625aff-7c66-4116-9700-5f1e02b521c2 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:15.007490 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224aff03-d269-4211-91f4-a992c59e7e0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:15.008138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224aff03-d269-4211-91f4-a992c59e7e0e service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:15.008425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224aff03-d269-4211-91f4-a992c59e7e0e service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:15.008738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224aff03-d269-4211-91f4-a992c59e7e0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:15.010536 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-224aff03-d269-4211-91f4-a992c59e7e0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:15.124333 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224aff03-d269-4211-91f4-a992c59e7e0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:15.126166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224aff03-d269-4211-91f4-a992c59e7e0e service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:15.150816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 701/1396] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:12:15.161435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:15.211205 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4301ce-6027-4565-a36d-7f1a362ecd39 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:15.211919 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4301ce-6027-4565-a36d-7f1a362ecd39 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:15.212193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4301ce-6027-4565-a36d-7f1a362ecd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:15.318707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2e4301ce-6027-4565-a36d-7f1a362ecd39 None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:15.328392 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2e4301ce-6027-4565-a36d-7f1a362ecd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:15.458779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 696/1397] 10.222.0.98 () {58 vars in 1009 bytes} [Tue Jul 26 15:12:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:15.517888 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb822cdb-6f62-460d-a83b-bd3a58dbc000 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:15.518825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb822cdb-6f62-460d-a83b-bd3a58dbc000 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:15.518825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb822cdb-6f62-460d-a83b-bd3a58dbc000 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:15.519983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 702/1398] 10.222.0.98 () {54 vars in 943 bytes} [Tue Jul 26 15:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:15.529722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c84ed-a089-44c7-bf59-f4967fceab2f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:15.530303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c84ed-a089-44c7-bf59-f4967fceab2f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:15.530853 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c84ed-a089-44c7-bf59-f4967fceab2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:15.629454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:15.703047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-dc7c84ed-a089-44c7-bf59-f4967fceab2f None None] MFA Rules not processed for user `013ae8b88160433db6876f84947f0d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:15.705069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-dc7c84ed-a089-44c7-bf59-f4967fceab2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:15.917912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 697/1399] 10.222.0.98 () {58 vars in 1040 bytes} [Tue Jul 26 15:12:15 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:15.935442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb822cdb-6f62-460d-a83b-bd3a58dbc000 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:15.937625 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-cb822cdb-6f62-460d-a83b-bd3a58dbc000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:16.111062 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb822cdb-6f62-460d-a83b-bd3a58dbc000 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:16.176301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:16.235932 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f88107-9db8-4e0b-abd7-6f7a01c96c28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:16.236566 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f88107-9db8-4e0b-abd7-6f7a01c96c28 service swift] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:16.236830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f88107-9db8-4e0b-abd7-6f7a01c96c28 service swift] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:16.237287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f88107-9db8-4e0b-abd7-6f7a01c96c28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:16.239806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-84f88107-9db8-4e0b-abd7-6f7a01c96c28 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:16.335772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f88107-9db8-4e0b-abd7-6f7a01c96c28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:16.337704 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f88107-9db8-4e0b-abd7-6f7a01c96c28 service swift] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:16.347481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 703/1400] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:12:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:12:17.689145 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1f767-216e-405d-b393-ce3c073c9254 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:17.690029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1f767-216e-405d-b393-ce3c073c9254 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:17.690029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1f767-216e-405d-b393-ce3c073c9254 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:17.691656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 698/1401] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:17.697738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33aebcc-e10e-4b12-9cc0-7d513feacd18 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:17.698632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33aebcc-e10e-4b12-9cc0-7d513feacd18 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:17.698632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33aebcc-e10e-4b12-9cc0-7d513feacd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:17.789967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-f33aebcc-e10e-4b12-9cc0-7d513feacd18 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:17.791336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f33aebcc-e10e-4b12-9cc0-7d513feacd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:17.879026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:18.015874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 704/1402] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:18.094183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1f767-216e-405d-b393-ce3c073c9254 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:18.098003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-dcc1f767-216e-405d-b393-ce3c073c9254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:18.228827 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:18.322021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1f767-216e-405d-b393-ce3c073c9254 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:18.508527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306ff2e-25aa-4f9a-a43a-7568cf57cb37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:18.509175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306ff2e-25aa-4f9a-a43a-7568cf57cb37 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:18.509451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306ff2e-25aa-4f9a-a43a-7568cf57cb37 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:18.509725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306ff2e-25aa-4f9a-a43a-7568cf57cb37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:18.511506 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e306ff2e-25aa-4f9a-a43a-7568cf57cb37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:18.587086 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:18.640382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306ff2e-25aa-4f9a-a43a-7568cf57cb37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:18.642219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306ff2e-25aa-4f9a-a43a-7568cf57cb37 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:18.676774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 699/1403] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:12:21.489236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af57da6-d193-421a-8cfc-e838a56ab5e8 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:21.490743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af57da6-d193-421a-8cfc-e838a56ab5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:21.491506 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af57da6-d193-421a-8cfc-e838a56ab5e8 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:21.493787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 705/1404] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:12:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:21.503970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9cb4b-1bbf-46d1-945f-5156402fe010 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:21.504529 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9cb4b-1bbf-46d1-945f-5156402fe010 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:21.505005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9cb4b-1bbf-46d1-945f-5156402fe010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:21.623748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7ef9cb4b-1bbf-46d1-945f-5156402fe010 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:21.625014 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7ef9cb4b-1bbf-46d1-945f-5156402fe010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:21.795102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 700/1405] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:21.850707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af57da6-d193-421a-8cfc-e838a56ab5e8 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:21.858217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8af57da6-d193-421a-8cfc-e838a56ab5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:22.146114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af57da6-d193-421a-8cfc-e838a56ab5e8 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:22.195751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:22.362999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825465f-9635-4a22-86c8-cd92d38d3f7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:22.363650 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825465f-9635-4a22-86c8-cd92d38d3f7d service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:22.363953 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825465f-9635-4a22-86c8-cd92d38d3f7d service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:22.364215 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825465f-9635-4a22-86c8-cd92d38d3f7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:22.366028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8825465f-9635-4a22-86c8-cd92d38d3f7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:22.537089 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825465f-9635-4a22-86c8-cd92d38d3f7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:22.540220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825465f-9635-4a22-86c8-cd92d38d3f7d service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:22.577333 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 706/1406] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:12:25.167409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79849910-915c-4602-9a4d-88a7df2c4bc6 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:25.167998 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79849910-915c-4602-9a4d-88a7df2c4bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:25.167998 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79849910-915c-4602-9a4d-88a7df2c4bc6 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:25.169391 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 701/1407] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:25.175406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383af45-f3b8-4c69-b6d6-721fd04b8e6b None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:25.183529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383af45-f3b8-4c69-b6d6-721fd04b8e6b None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:25.183529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383af45-f3b8-4c69-b6d6-721fd04b8e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:25.226202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:25.282443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-5383af45-f3b8-4c69-b6d6-721fd04b8e6b None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:25.282837 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5383af45-f3b8-4c69-b6d6-721fd04b8e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:25.428695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 707/1408] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:25.485571 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79849910-915c-4602-9a4d-88a7df2c4bc6 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:25.488395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-79849910-915c-4602-9a4d-88a7df2c4bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:25.560897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:25.781389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79849910-915c-4602-9a4d-88a7df2c4bc6 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:26.018022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:26.032746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d489b-465c-4dbe-a074-64506475ab05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:26.033723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d489b-465c-4dbe-a074-64506475ab05 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:26.034152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d489b-465c-4dbe-a074-64506475ab05 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:26.034600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d489b-465c-4dbe-a074-64506475ab05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:26.036605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9a4d489b-465c-4dbe-a074-64506475ab05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:26.239330 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d489b-465c-4dbe-a074-64506475ab05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:26.242525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d489b-465c-4dbe-a074-64506475ab05 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:26.279884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 702/1409] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 796 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:12:35.425920 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=52 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:36.274115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=48 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:44.393810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772f308-9706-4c7c-b997-acea3c11093d None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:44.394628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772f308-9706-4c7c-b997-acea3c11093d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:44.394628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772f308-9706-4c7c-b997-acea3c11093d None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:44.396347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 708/1410] 10.222.0.98 () {54 vars in 918 bytes} [Tue Jul 26 15:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:44.403748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfbef2-b338-4539-b41d-6f74be1158ba None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:44.404345 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfbef2-b338-4539-b41d-6f74be1158ba None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:44.404345 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfbef2-b338-4539-b41d-6f74be1158ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:44.511649 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-bacfbef2-b338-4539-b41d-6f74be1158ba None None] MFA Rules not processed for user `448161cd39dc4a6786c8813faa79376a`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:44.513490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bacfbef2-b338-4539-b41d-6f74be1158ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:44.677924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 703/1411] 10.222.0.98 () {58 vars in 1015 bytes} [Tue Jul 26 15:12:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:12:44.696822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf18fc-cfe7-45de-a511-69fe6015bfbc None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:44.697206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf18fc-cfe7-45de-a511-69fe6015bfbc None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:44.697388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf18fc-cfe7-45de-a511-69fe6015bfbc None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:44.699627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 709/1412] 10.222.0.98 () {54 vars in 918 bytes} [Tue Jul 26 15:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:12:44.705494 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000101-b985-41e0-92bd-3d4f4a865b6f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:44.705787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000101-b985-41e0-92bd-3d4f4a865b6f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:44.706104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000101-b985-41e0-92bd-3d4f4a865b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:44.805284 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:44.809073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2f000101-b985-41e0-92bd-3d4f4a865b6f None None] MFA Rules not processed for user `a4a6c0e7ca434010980d7cac1800dbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:44.810423 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2f000101-b985-41e0-92bd-3d4f4a865b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:44.966479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 704/1413] 10.222.0.98 () {58 vars in 1015 bytes} [Tue Jul 26 15:12:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:12:47.787437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed9ea9-2f96-4876-9292-f758b40243ad None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:47.788357 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed9ea9-2f96-4876-9292-f758b40243ad None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:47.788357 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed9ea9-2f96-4876-9292-f758b40243ad None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:47.789977 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:47.797568 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570792a-cb2a-4628-8ac0-d96ad77e77e6 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:47.798476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570792a-cb2a-4628-8ac0-d96ad77e77e6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:47.798476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570792a-cb2a-4628-8ac0-d96ad77e77e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:47.910555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9570792a-cb2a-4628-8ac0-d96ad77e77e6 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:47.912234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9570792a-cb2a-4628-8ac0-d96ad77e77e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:48.005326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:48.087869 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:48.156959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed9ea9-2f96-4876-9292-f758b40243ad None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:48.158678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-afed9ea9-2f96-4876-9292-f758b40243ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:48.357691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed9ea9-2f96-4876-9292-f758b40243ad None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:48.453886 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:48.535164 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a496b4-62c3-4f0e-84f3-a1a4cc9921cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:48.535999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a496b4-62c3-4f0e-84f3-a1a4cc9921cc service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:48.536494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a496b4-62c3-4f0e-84f3-a1a4cc9921cc service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:48.536973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a496b4-62c3-4f0e-84f3-a1a4cc9921cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:48.539076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b1a496b4-62c3-4f0e-84f3-a1a4cc9921cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:48.690891 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a496b4-62c3-4f0e-84f3-a1a4cc9921cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:48.692418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a496b4-62c3-4f0e-84f3-a1a4cc9921cc service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:48.716276 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 711/1416] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:12:50.013563 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205da600-0065-4d3e-b088-1a0bbaed528d None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:50.014408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205da600-0065-4d3e-b088-1a0bbaed528d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:50.014597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205da600-0065-4d3e-b088-1a0bbaed528d None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:50.016167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:50.022254 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9744845-ba00-4a95-ad06-3cb81b737f84 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:50.022982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9744845-ba00-4a95-ad06-3cb81b737f84 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:50.022982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9744845-ba00-4a95-ad06-3cb81b737f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:50.118697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-f9744845-ba00-4a95-ad06-3cb81b737f84 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:50.120576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f9744845-ba00-4a95-ad06-3cb81b737f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:50.155243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:50.242721 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:50.413227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205da600-0065-4d3e-b088-1a0bbaed528d None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:50.415122 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-205da600-0065-4d3e-b088-1a0bbaed528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:50.599191 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205da600-0065-4d3e-b088-1a0bbaed528d None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:50.651867 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:50.761384 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386eecf-199a-4a55-ab0d-80eb4adcac9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:50.761989 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386eecf-199a-4a55-ab0d-80eb4adcac9e service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:50.762429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386eecf-199a-4a55-ab0d-80eb4adcac9e service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:50.762758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386eecf-199a-4a55-ab0d-80eb4adcac9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:50.764657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d386eecf-199a-4a55-ab0d-80eb4adcac9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:50.874633 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386eecf-199a-4a55-ab0d-80eb4adcac9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:50.876249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386eecf-199a-4a55-ab0d-80eb4adcac9e service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:50.898268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 707/1419] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:12:51.893639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad704de-1d01-40b1-b6a4-6dde5e509ac2 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:51.894270 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad704de-1d01-40b1-b6a4-6dde5e509ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:51.894270 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad704de-1d01-40b1-b6a4-6dde5e509ac2 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:51.895852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:51.902980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3aa1e5-1ce5-4421-a733-e168d67bac26 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:51.903845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3aa1e5-1ce5-4421-a733-e168d67bac26 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:51.904021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3aa1e5-1ce5-4421-a733-e168d67bac26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:51.972437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:52.002199 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8b3aa1e5-1ce5-4421-a733-e168d67bac26 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:52.003585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8b3aa1e5-1ce5-4421-a733-e168d67bac26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:52.180031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:52.348965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad704de-1d01-40b1-b6a4-6dde5e509ac2 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:52.351525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-bad704de-1d01-40b1-b6a4-6dde5e509ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:52.541070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad704de-1d01-40b1-b6a4-6dde5e509ac2 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:52.556641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:52.740950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15379f5-50ca-41bd-9903-91dcb74aa39a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:52.742080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15379f5-50ca-41bd-9903-91dcb74aa39a service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:52.742637 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15379f5-50ca-41bd-9903-91dcb74aa39a service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:52.743141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15379f5-50ca-41bd-9903-91dcb74aa39a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:52.747349 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f15379f5-50ca-41bd-9903-91dcb74aa39a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:52.861590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15379f5-50ca-41bd-9903-91dcb74aa39a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:52.863415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15379f5-50ca-41bd-9903-91dcb74aa39a service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:52.886600 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 714/1422] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:12:53.857071 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d848da7-df3c-4d63-b3e9-5b323f859697 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:53.857690 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d848da7-df3c-4d63-b3e9-5b323f859697 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:53.857871 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d848da7-df3c-4d63-b3e9-5b323f859697 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:53.860580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:12:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:53.866569 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb642a-0266-444a-aca9-4643bdbc406b None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:53.867427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb642a-0266-444a-aca9-4643bdbc406b None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:53.867611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb642a-0266-444a-aca9-4643bdbc406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:53.895609 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:53.972377 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-3feb642a-0266-444a-aca9-4643bdbc406b None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:53.973676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3feb642a-0266-444a-aca9-4643bdbc406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:54.102018 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:12:54.261777 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d848da7-df3c-4d63-b3e9-5b323f859697 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:54.263819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3d848da7-df3c-4d63-b3e9-5b323f859697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:54.406947 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:54.453067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d848da7-df3c-4d63-b3e9-5b323f859697 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:54.610509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf5645-f815-46fd-9cfe-e46abfa3c05c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:54.611245 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf5645-f815-46fd-9cfe-e46abfa3c05c service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:54.611617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf5645-f815-46fd-9cfe-e46abfa3c05c service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:54.611967 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf5645-f815-46fd-9cfe-e46abfa3c05c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:54.613765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-55cf5645-f815-46fd-9cfe-e46abfa3c05c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:54.711107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:54.728233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf5645-f815-46fd-9cfe-e46abfa3c05c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:54.731519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf5645-f815-46fd-9cfe-e46abfa3c05c service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:54.753394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 710/1425] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:12:55.712628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad127f9-f94f-4800-abeb-2b5cfbca858b None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:55.713869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad127f9-f94f-4800-abeb-2b5cfbca858b None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:55.714041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad127f9-f94f-4800-abeb-2b5cfbca858b None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:55.715564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:12:55.721736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83ff33-60b3-4938-8223-e1fd7f72d6ff None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:55.722326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83ff33-60b3-4938-8223-e1fd7f72d6ff None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:55.722656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83ff33-60b3-4938-8223-e1fd7f72d6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:55.833338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-0e83ff33-60b3-4938-8223-e1fd7f72d6ff None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:55.835758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0e83ff33-60b3-4938-8223-e1fd7f72d6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:55.977882 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:56.141688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad127f9-f94f-4800-abeb-2b5cfbca858b None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:56.143454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-dad127f9-f94f-4800-abeb-2b5cfbca858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:56.253684 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:56.331845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad127f9-f94f-4800-abeb-2b5cfbca858b None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:56.492916 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21217b6a-6073-448a-b891-eec851a8b1b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:56.493996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21217b6a-6073-448a-b891-eec851a8b1b2 service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:56.495264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21217b6a-6073-448a-b891-eec851a8b1b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:56.495779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21217b6a-6073-448a-b891-eec851a8b1b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:56.499768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-21217b6a-6073-448a-b891-eec851a8b1b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:56.597232 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:56.661202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21217b6a-6073-448a-b891-eec851a8b1b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:56.663294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21217b6a-6073-448a-b891-eec851a8b1b2 service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:56.688724 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 717/1428] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:12:57.648864 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc578b5-c57c-459a-828b-18d1f8ebb677 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:57.649502 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc578b5-c57c-459a-828b-18d1f8ebb677 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:57.649502 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc578b5-c57c-459a-828b-18d1f8ebb677 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:57.651619 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:57.659665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450900f-ec20-4492-a316-484b21fc683f None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:57.660558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450900f-ec20-4492-a316-484b21fc683f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:57.660558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450900f-ec20-4492-a316-484b21fc683f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:57.764582 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-4450900f-ec20-4492-a316-484b21fc683f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:57.766016 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4450900f-ec20-4492-a316-484b21fc683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:57.904543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:58.061470 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc578b5-c57c-459a-828b-18d1f8ebb677 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:58.063302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5cc578b5-c57c-459a-828b-18d1f8ebb677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:58.126844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:58.252031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc578b5-c57c-459a-828b-18d1f8ebb677 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:58.424455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255683cb-5cc1-46c6-85d5-41dc5193bb76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:58.425068 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255683cb-5cc1-46c6-85d5-41dc5193bb76 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:58.425353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255683cb-5cc1-46c6-85d5-41dc5193bb76 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:58.425621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255683cb-5cc1-46c6-85d5-41dc5193bb76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:58.427410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-255683cb-5cc1-46c6-85d5-41dc5193bb76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:58.436398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:58.552404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255683cb-5cc1-46c6-85d5-41dc5193bb76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:58.554188 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255683cb-5cc1-46c6-85d5-41dc5193bb76 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:58.577754 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 713/1431] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:12:59.546014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558f9bf-4a97-4ad9-8153-2148a439c1c3 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:59.546968 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558f9bf-4a97-4ad9-8153-2148a439c1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:59.546968 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558f9bf-4a97-4ad9-8153-2148a439c1c3 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:59.548030 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:12:59.553848 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9652be-aaa2-44c9-8f39-0c8a3ccd134c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:59.554417 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9652be-aaa2-44c9-8f39-0c8a3ccd134c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:59.554417 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9652be-aaa2-44c9-8f39-0c8a3ccd134c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:59.654647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-4e9652be-aaa2-44c9-8f39-0c8a3ccd134c None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:59.655978 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4e9652be-aaa2-44c9-8f39-0c8a3ccd134c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:59.741365 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:59.775269 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:12:59.944140 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558f9bf-4a97-4ad9-8153-2148a439c1c3 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:59.945756 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2558f9bf-4a97-4ad9-8153-2148a439c1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:59.969440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:00.155464 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558f9bf-4a97-4ad9-8153-2148a439c1c3 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:13:00.256871 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:00.294251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e1e4d-4016-4607-9075-fd16a9c49e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:13:00.294919 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1e4d-4016-4607-9075-fd16a9c49e7a service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:00.295200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1e4d-4016-4607-9075-fd16a9c49e7a service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:00.295471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1e4d-4016-4607-9075-fd16a9c49e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:00.297178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a98e1e4d-4016-4607-9075-fd16a9c49e7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:00.410874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e1e4d-4016-4607-9075-fd16a9c49e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:13:00.412621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e1e4d-4016-4607-9075-fd16a9c49e7a service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:13:00.436078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 720/1434] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:13:01.663860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37483400-993b-40a5-920c-097a98e96227 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:01.664588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37483400-993b-40a5-920c-097a98e96227 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:01.664588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37483400-993b-40a5-920c-097a98e96227 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:01.666696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:13:01.675407 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef2db9-527c-4cc3-a441-ac8e4b335fc1 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:01.676174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef2db9-527c-4cc3-a441-ac8e4b335fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:01.676174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef2db9-527c-4cc3-a441-ac8e4b335fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:01.780578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-cdef2db9-527c-4cc3-a441-ac8e4b335fc1 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:13:01.782446 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-cdef2db9-527c-4cc3-a441-ac8e4b335fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:01.844799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:01.947923 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:13:02.143350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37483400-993b-40a5-920c-097a98e96227 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:13:02.145124 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-37483400-993b-40a5-920c-097a98e96227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:02.429194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37483400-993b-40a5-920c-097a98e96227 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:13:02.494346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:02.585261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d3df8-e664-49b8-873f-61c3179fba7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:13:02.586117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d3df8-e664-49b8-873f-61c3179fba7d service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:02.586464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d3df8-e664-49b8-873f-61c3179fba7d service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:02.586831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d3df8-e664-49b8-873f-61c3179fba7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:02.588940 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a44d3df8-e664-49b8-873f-61c3179fba7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:02.728207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d3df8-e664-49b8-873f-61c3179fba7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:13:02.731687 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d3df8-e664-49b8-873f-61c3179fba7d service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:13:02.765593 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 716/1437] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:13:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:13:03.737098 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199fc2f-8911-4216-82f6-eee8d6300b2e None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:03.737720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199fc2f-8911-4216-82f6-eee8d6300b2e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:03.737720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199fc2f-8911-4216-82f6-eee8d6300b2e None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:03.739546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:13:03.745130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9eec5-6852-4db2-b1b8-436fbd1b26c5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:03.745750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9eec5-6852-4db2-b1b8-436fbd1b26c5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:03.745750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9eec5-6852-4db2-b1b8-436fbd1b26c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:03.835856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-74a9eec5-6852-4db2-b1b8-436fbd1b26c5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:13:03.837091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-74a9eec5-6852-4db2-b1b8-436fbd1b26c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:03.839974 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:03.959771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:13:04.156563 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199fc2f-8911-4216-82f6-eee8d6300b2e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:13:04.172170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5199fc2f-8911-4216-82f6-eee8d6300b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:04.362199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199fc2f-8911-4216-82f6-eee8d6300b2e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:13:04.400209 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:04.512857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a354a-f02e-4ab4-ae41-3b2673ff0adc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:13:04.513576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a354a-f02e-4ab4-ae41-3b2673ff0adc service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:04.513746 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a354a-f02e-4ab4-ae41-3b2673ff0adc service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:04.514024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a354a-f02e-4ab4-ae41-3b2673ff0adc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:04.515825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c06a354a-f02e-4ab4-ae41-3b2673ff0adc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:04.632253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a354a-f02e-4ab4-ae41-3b2673ff0adc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:13:04.633873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a354a-f02e-4ab4-ae41-3b2673ff0adc service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:13:04.655406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 723/1440] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:13:06.698846 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b764c-5487-458b-af76-f9e63ffefd4a None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:06.699597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b764c-5487-458b-af76-f9e63ffefd4a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:06.699597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b764c-5487-458b-af76-f9e63ffefd4a None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:06.701064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:13:06.707339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b04e1b-11de-4ff0-911b-562bf721cafc None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:06.707937 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b04e1b-11de-4ff0-911b-562bf721cafc None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:06.708072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b04e1b-11de-4ff0-911b-562bf721cafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:06.757321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:06.789608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-82b04e1b-11de-4ff0-911b-562bf721cafc None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:13:06.791201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-82b04e1b-11de-4ff0-911b-562bf721cafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:06.909037 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:13:06.949519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b764c-5487-458b-af76-f9e63ffefd4a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:13:06.951262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-880b764c-5487-458b-af76-f9e63ffefd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:07.080004 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b764c-5487-458b-af76-f9e63ffefd4a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:13:07.129593 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:07.188388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c31a6-61b1-492e-9c1c-7b29196b8beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:13:07.189016 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c31a6-61b1-492e-9c1c-7b29196b8beb service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:07.189296 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c31a6-61b1-492e-9c1c-7b29196b8beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:07.189568 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c31a6-61b1-492e-9c1c-7b29196b8beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:07.191302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-764c31a6-61b1-492e-9c1c-7b29196b8beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:07.336537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c31a6-61b1-492e-9c1c-7b29196b8beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:13:07.339115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c31a6-61b1-492e-9c1c-7b29196b8beb service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:13:07.361920 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 719/1443] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:13:09.889476 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1ca4-bac2-42d1-974e-a6dcb3d9e07d None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:09.890113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1ca4-bac2-42d1-974e-a6dcb3d9e07d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:09.890113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1ca4-bac2-42d1-974e-a6dcb3d9e07d None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:09.891519 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:13:09.898031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0afaa-d5c9-46ee-815e-159630678bc8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:09.898725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0afaa-d5c9-46ee-815e-159630678bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:09.898725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0afaa-d5c9-46ee-815e-159630678bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:09.985660 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b0e0afaa-d5c9-46ee-815e-159630678bc8 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:13:09.987115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b0e0afaa-d5c9-46ee-815e-159630678bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:10.003171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:10.116354 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:13:10.162960 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd1ca4-bac2-42d1-974e-a6dcb3d9e07d None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:13:10.164579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-46cd1ca4-bac2-42d1-974e-a6dcb3d9e07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:10.312003 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd1ca4-bac2-42d1-974e-a6dcb3d9e07d None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:13:10.336523 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:10.429856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0899f2-43d2-4ad9-bdb3-5298562f9953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:13:10.430419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0899f2-43d2-4ad9-bdb3-5298562f9953 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:10.430709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0899f2-43d2-4ad9-bdb3-5298562f9953 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:10.431278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0899f2-43d2-4ad9-bdb3-5298562f9953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:10.433166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2b0899f2-43d2-4ad9-bdb3-5298562f9953 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:10.577499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0899f2-43d2-4ad9-bdb3-5298562f9953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:13:10.579237 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0899f2-43d2-4ad9-bdb3-5298562f9953 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:13:10.601977 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 726/1446] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:13:13.697032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f27ed-b06f-4b44-a66c-cae7f6afe03f None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:13.697652 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f27ed-b06f-4b44-a66c-cae7f6afe03f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:13.697913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f27ed-b06f-4b44-a66c-cae7f6afe03f None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:13.699656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:13:13.706291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a4ee6-831e-451f-bd9d-0831a6039ec6 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:13.707189 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a4ee6-831e-451f-bd9d-0831a6039ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:13.707523 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a4ee6-831e-451f-bd9d-0831a6039ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:13.765745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:13.789190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-cc4a4ee6-831e-451f-bd9d-0831a6039ec6 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:13:13.790608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-cc4a4ee6-831e-451f-bd9d-0831a6039ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:13.947788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:13:13.990137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f27ed-b06f-4b44-a66c-cae7f6afe03f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:13:13.991780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-354f27ed-b06f-4b44-a66c-cae7f6afe03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:14.138214 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f27ed-b06f-4b44-a66c-cae7f6afe03f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:13:14.215475 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:14.285962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838ed88-a875-4b5a-9b64-f9795e2632bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:13:14.287175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838ed88-a875-4b5a-9b64-f9795e2632bb service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:14.287671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838ed88-a875-4b5a-9b64-f9795e2632bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:14.288153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838ed88-a875-4b5a-9b64-f9795e2632bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:14.292141 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b838ed88-a875-4b5a-9b64-f9795e2632bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:14.442938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838ed88-a875-4b5a-9b64-f9795e2632bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:13:14.444590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838ed88-a875-4b5a-9b64-f9795e2632bb service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:13:14.469516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 722/1449] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:13:16.817760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecc108-f702-4157-a3da-ee3a9aff6fe8 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:16.818622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecc108-f702-4157-a3da-ee3a9aff6fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:16.818622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecc108-f702-4157-a3da-ee3a9aff6fe8 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:16.819657 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:13:16.826402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ce098-af3d-4f01-99e7-6e0efb2d763d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:16.826965 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ce098-af3d-4f01-99e7-6e0efb2d763d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:16.826965 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ce098-af3d-4f01-99e7-6e0efb2d763d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:16.908559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5e5ce098-af3d-4f01-99e7-6e0efb2d763d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:13:16.910153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5e5ce098-af3d-4f01-99e7-6e0efb2d763d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:16.939750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:17.088225 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:13:17.128983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecc108-f702-4157-a3da-ee3a9aff6fe8 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:13:17.130681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-34ecc108-f702-4157-a3da-ee3a9aff6fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:17.257485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecc108-f702-4157-a3da-ee3a9aff6fe8 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:13:17.282819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:17.366818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf6f79-4e97-4f52-bf85-23c59a5835ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:13:17.367497 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf6f79-4e97-4f52-bf85-23c59a5835ec service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:17.367783 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf6f79-4e97-4f52-bf85-23c59a5835ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:17.368083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf6f79-4e97-4f52-bf85-23c59a5835ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:17.369851 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-1eaf6f79-4e97-4f52-bf85-23c59a5835ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:17.505172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf6f79-4e97-4f52-bf85-23c59a5835ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:13:17.506932 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf6f79-4e97-4f52-bf85-23c59a5835ec service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:13:17.531152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 729/1452] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:13:19.844754 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed675ee-6679-43c6-95d3-53cf9ae05082 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:19.845357 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed675ee-6679-43c6-95d3-53cf9ae05082 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:19.845498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed675ee-6679-43c6-95d3-53cf9ae05082 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:19.846945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:13:19.853584 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a537323-cf86-42bb-b3d3-d8cb5e1709f1 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:19.854139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a537323-cf86-42bb-b3d3-d8cb5e1709f1 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:19.854139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a537323-cf86-42bb-b3d3-d8cb5e1709f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:19.933257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:19.936586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-3a537323-cf86-42bb-b3d3-d8cb5e1709f1 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:13:19.937844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3a537323-cf86-42bb-b3d3-d8cb5e1709f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:20.058943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:13:20.098229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed675ee-6679-43c6-95d3-53cf9ae05082 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:13:20.099828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bed675ee-6679-43c6-95d3-53cf9ae05082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:20.224477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed675ee-6679-43c6-95d3-53cf9ae05082 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:13:20.288241 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:20.319933 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43082b-6519-48f8-86fc-63ae4c155632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:13:20.320578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43082b-6519-48f8-86fc-63ae4c155632 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:20.321379 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43082b-6519-48f8-86fc-63ae4c155632 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:20.321646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43082b-6519-48f8-86fc-63ae4c155632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:20.323598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1d43082b-6519-48f8-86fc-63ae4c155632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:20.464682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43082b-6519-48f8-86fc-63ae4c155632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:13:20.466151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43082b-6519-48f8-86fc-63ae4c155632 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:13:20.492549 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 725/1455] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:13:22.790882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c0ded-57b6-43c3-86aa-12fea402dbd5 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:22.791422 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c0ded-57b6-43c3-86aa-12fea402dbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:22.791811 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c0ded-57b6-43c3-86aa-12fea402dbd5 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:22.794632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:13:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:13:22.800636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50f969-4838-4a7c-a6ca-2cc2f7c4148c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:22.801236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50f969-4838-4a7c-a6ca-2cc2f7c4148c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:22.801236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50f969-4838-4a7c-a6ca-2cc2f7c4148c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:22.892264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ad50f969-4838-4a7c-a6ca-2cc2f7c4148c None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:13:22.893694 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ad50f969-4838-4a7c-a6ca-2cc2f7c4148c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:22.932155 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:23.018221 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:13:23.070542 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c0ded-57b6-43c3-86aa-12fea402dbd5 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:13:23.073947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-558c0ded-57b6-43c3-86aa-12fea402dbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:23.247147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c0ded-57b6-43c3-86aa-12fea402dbd5 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:13:23.298791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:23.371857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73019dc7-3a5f-4292-b987-bcf4fb3c1e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:13:23.372948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73019dc7-3a5f-4292-b987-bcf4fb3c1e9f service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:23.373461 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73019dc7-3a5f-4292-b987-bcf4fb3c1e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:23.373976 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73019dc7-3a5f-4292-b987-bcf4fb3c1e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:23.377413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-73019dc7-3a5f-4292-b987-bcf4fb3c1e9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:23.567347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73019dc7-3a5f-4292-b987-bcf4fb3c1e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:13:23.570027 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73019dc7-3a5f-4292-b987-bcf4fb3c1e9f service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:13:23.598718 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 732/1458] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:13:25.840531 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47a220-f684-428a-b93e-626029f9fcd8 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:25.841165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47a220-f684-428a-b93e-626029f9fcd8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:25.841165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47a220-f684-428a-b93e-626029f9fcd8 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:25.842509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:13:25.849632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60327e-2e25-4660-a82b-8fb23fe346b1 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:25.850208 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60327e-2e25-4660-a82b-8fb23fe346b1 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:25.850697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60327e-2e25-4660-a82b-8fb23fe346b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:25.971428 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-da60327e-2e25-4660-a82b-8fb23fe346b1 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:13:25.973770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-da60327e-2e25-4660-a82b-8fb23fe346b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:25.986437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:26.107092 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:13:26.150238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47a220-f684-428a-b93e-626029f9fcd8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:13:26.151996 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7f47a220-f684-428a-b93e-626029f9fcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:26.286403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47a220-f684-428a-b93e-626029f9fcd8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:13:26.361576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:26.400405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529dbac-8968-4d9c-aa27-5ea2e4d1795b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:13:26.401349 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529dbac-8968-4d9c-aa27-5ea2e4d1795b service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:26.401797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529dbac-8968-4d9c-aa27-5ea2e4d1795b service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:26.402252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529dbac-8968-4d9c-aa27-5ea2e4d1795b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:26.406630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6529dbac-8968-4d9c-aa27-5ea2e4d1795b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:26.587988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529dbac-8968-4d9c-aa27-5ea2e4d1795b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:13:26.589663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529dbac-8968-4d9c-aa27-5ea2e4d1795b service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:13:26.613274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 728/1461] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:13:28.865788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51144534-bbe7-42a7-b154-8321d57ab02e None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:28.866351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51144534-bbe7-42a7-b154-8321d57ab02e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:28.866351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51144534-bbe7-42a7-b154-8321d57ab02e None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:28.867848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:13:28.874432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6850d-a5c7-457f-9da6-933b0c880b36 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:28.875350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6850d-a5c7-457f-9da6-933b0c880b36 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:28.875350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6850d-a5c7-457f-9da6-933b0c880b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:28.964132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-6ad6850d-a5c7-457f-9da6-933b0c880b36 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:13:28.965481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6ad6850d-a5c7-457f-9da6-933b0c880b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:29.017077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:29.095855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:13:29.152254 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51144534-bbe7-42a7-b154-8321d57ab02e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:13:29.153958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-51144534-bbe7-42a7-b154-8321d57ab02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:29.298845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51144534-bbe7-42a7-b154-8321d57ab02e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:13:29.347439 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:29.392202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cdad5-f50e-4234-93f2-aae7a8c25700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:13:29.392968 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cdad5-f50e-4234-93f2-aae7a8c25700 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:29.393342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cdad5-f50e-4234-93f2-aae7a8c25700 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:29.393727 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cdad5-f50e-4234-93f2-aae7a8c25700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:29.395618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-fc8cdad5-f50e-4234-93f2-aae7a8c25700 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:29.530758 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cdad5-f50e-4234-93f2-aae7a8c25700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:13:29.532222 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cdad5-f50e-4234-93f2-aae7a8c25700 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:13:29.563184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 735/1464] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:13:31.739265 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52639141-88ec-45a4-8158-6d651589d3fe None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:31.740120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52639141-88ec-45a4-8158-6d651589d3fe None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:31.740120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52639141-88ec-45a4-8158-6d651589d3fe None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:31.741508 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:13:31.748600 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dee5e-03d3-4094-b076-ca14d9c9694c None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:31.749428 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dee5e-03d3-4094-b076-ca14d9c9694c None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:31.749640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dee5e-03d3-4094-b076-ca14d9c9694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:31.847565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-371dee5e-03d3-4094-b076-ca14d9c9694c None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:13:31.849712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-371dee5e-03d3-4094-b076-ca14d9c9694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:31.887139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:32.036523 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:13:32.077329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52639141-88ec-45a4-8158-6d651589d3fe None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:13:32.079120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-52639141-88ec-45a4-8158-6d651589d3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:32.208300 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52639141-88ec-45a4-8158-6d651589d3fe None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:13:32.292275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:32.300145 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b334a7-8fe2-4e84-9b59-bc91a4a13ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:13:32.300817 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b334a7-8fe2-4e84-9b59-bc91a4a13ccb service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:32.301170 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b334a7-8fe2-4e84-9b59-bc91a4a13ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:32.301491 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b334a7-8fe2-4e84-9b59-bc91a4a13ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:32.303594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f4b334a7-8fe2-4e84-9b59-bc91a4a13ccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:32.500866 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b334a7-8fe2-4e84-9b59-bc91a4a13ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:13:32.503860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b334a7-8fe2-4e84-9b59-bc91a4a13ccb service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:13:32.533346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 731/1467] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:13:34.824016 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94c4de-a902-4711-a9a0-d7aaabd4ddca None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:34.825019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94c4de-a902-4711-a9a0-d7aaabd4ddca None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:34.825019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94c4de-a902-4711-a9a0-d7aaabd4ddca None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:34.825879 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:13:34.832112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa6e3c-71ce-4764-a6fd-301ef7520d3e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:34.832988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa6e3c-71ce-4764-a6fd-301ef7520d3e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:34.832988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa6e3c-71ce-4764-a6fd-301ef7520d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:34.917960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-98aa6e3c-71ce-4764-a6fd-301ef7520d3e None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:13:34.919451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-98aa6e3c-71ce-4764-a6fd-301ef7520d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:34.977814 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:35.060456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:13:35.099775 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94c4de-a902-4711-a9a0-d7aaabd4ddca None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:13:35.101596 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2f94c4de-a902-4711-a9a0-d7aaabd4ddca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:35.278045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94c4de-a902-4711-a9a0-d7aaabd4ddca None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:13:35.360822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:35.409905 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750b843-5b33-4e94-b8ea-ac40a2e05554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:13:35.410581 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750b843-5b33-4e94-b8ea-ac40a2e05554 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:35.410869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750b843-5b33-4e94-b8ea-ac40a2e05554 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:35.411146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750b843-5b33-4e94-b8ea-ac40a2e05554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:35.412854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c750b843-5b33-4e94-b8ea-ac40a2e05554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:35.600740 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750b843-5b33-4e94-b8ea-ac40a2e05554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:13:35.602823 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750b843-5b33-4e94-b8ea-ac40a2e05554 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:13:35.626985 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 738/1470] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:13:45.056595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=22 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:45.624269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=66 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:57.195212 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3ab79-9929-4d01-bd2b-bc4c4baf6861 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:57.196088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3ab79-9929-4d01-bd2b-bc4c4baf6861 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:57.196088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3ab79-9929-4d01-bd2b-bc4c4baf6861 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:57.197853 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 733/1471] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:13:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:13:57.204041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d782d4-9d2b-4130-8931-463a14a4c643 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:57.204631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d782d4-9d2b-4130-8931-463a14a4c643 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:57.204631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d782d4-9d2b-4130-8931-463a14a4c643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:57.286001 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-83d782d4-9d2b-4130-8931-463a14a4c643 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:13:57.287804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-83d782d4-9d2b-4130-8931-463a14a4c643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:57.405136 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 739/1472] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:13:57.501775 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86705a-dd31-4e1f-9e91-0419c7d22b12 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:57.502085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86705a-dd31-4e1f-9e91-0419c7d22b12 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:57.502405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86705a-dd31-4e1f-9e91-0419c7d22b12 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:57.503796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 734/1473] 10.222.0.98 () {54 vars in 966 bytes} [Tue Jul 26 15:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:13:57.512724 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7eea6-03d5-461a-b31d-8479477daf39 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:57.513010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7eea6-03d5-461a-b31d-8479477daf39 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:57.519316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7eea6-03d5-461a-b31d-8479477daf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:57.612798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-beb7eea6-03d5-461a-b31d-8479477daf39 None None] MFA Rules not processed for user `4d85dc9f9f15480db927e617c992e1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:13:57.614346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-beb7eea6-03d5-461a-b31d-8479477daf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:57.642681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:57.711757 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 740/1474] 10.222.0.98 () {58 vars in 1063 bytes} [Tue Jul 26 15:13:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:13:57.720679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86705a-dd31-4e1f-9e91-0419c7d22b12 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:13:57.723744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7a86705a-dd31-4e1f-9e91-0419c7d22b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:57.883872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86705a-dd31-4e1f-9e91-0419c7d22b12 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:13:57.975976 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203f0b7-2593-451e-885c-349b179bb5de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d85dc9f9f15480db927e617c992e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:13:57.976633 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203f0b7-2593-451e-885c-349b179bb5de service glance] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:57.976906 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203f0b7-2593-451e-885c-349b179bb5de service glance] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:57.977181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203f0b7-2593-451e-885c-349b179bb5de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:57.978965 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e203f0b7-2593-451e-885c-349b179bb5de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:58.045769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:58.129169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203f0b7-2593-451e-885c-349b179bb5de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:13:58.130686 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203f0b7-2593-451e-885c-349b179bb5de service glance] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:13:58.155155 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 735/1475] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:13:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:14:00.414847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79052278-3b52-4cdd-a7e5-1a64072075dc None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:00.415451 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79052278-3b52-4cdd-a7e5-1a64072075dc None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:00.415830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79052278-3b52-4cdd-a7e5-1a64072075dc None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:00.418332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 741/1476] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:14:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:14:00.424706 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f440755-95f7-44c1-832a-ea3371b449e7 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:00.425312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f440755-95f7-44c1-832a-ea3371b449e7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:00.425312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f440755-95f7-44c1-832a-ea3371b449e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:00.511223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9f440755-95f7-44c1-832a-ea3371b449e7 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:00.512502 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9f440755-95f7-44c1-832a-ea3371b449e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:00.641393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 736/1477] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:14:00.683673 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79052278-3b52-4cdd-a7e5-1a64072075dc None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:00.685184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-79052278-3b52-4cdd-a7e5-1a64072075dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:00.840571 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79052278-3b52-4cdd-a7e5-1a64072075dc None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:00.899567 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:00.975391 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13952297-21e6-43f3-8544-813b95a94194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:00.976396 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13952297-21e6-43f3-8544-813b95a94194 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:00.976898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13952297-21e6-43f3-8544-813b95a94194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:00.977403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13952297-21e6-43f3-8544-813b95a94194 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:00.978786 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13952297-21e6-43f3-8544-813b95a94194 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:00.982138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: WARNING py.warnings [None req-13952297-21e6-43f3-8544-813b95a94194 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:14:00.982138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: warnings.warn(msg) Jul 26 15:14:00.982138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: Jul 26 15:14:00.984722 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13952297-21e6-43f3-8544-813b95a94194 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:01.022774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 742/1478] 10.222.0.98 () {56 vars in 1108 bytes} [Tue Jul 26 15:14:00 2022] GET /identity/v3/projects => generated 2553 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:14:03.420388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd209e6-2392-4f1f-83f3-33778664ae56 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:03.421145 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd209e6-2392-4f1f-83f3-33778664ae56 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:03.421145 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd209e6-2392-4f1f-83f3-33778664ae56 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:03.422270 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 737/1479] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:14:03.429059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9243f-78bc-4998-a0fd-bf052c93d55a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:03.429664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9243f-78bc-4998-a0fd-bf052c93d55a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:03.429664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9243f-78bc-4998-a0fd-bf052c93d55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:03.530488 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-31f9243f-78bc-4998-a0fd-bf052c93d55a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:03.532648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-31f9243f-78bc-4998-a0fd-bf052c93d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:03.801951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 743/1480] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:14:03.852897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd209e6-2392-4f1f-83f3-33778664ae56 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:03.854717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-edd209e6-2392-4f1f-83f3-33778664ae56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:03.867760 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:04.101350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd209e6-2392-4f1f-83f3-33778664ae56 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:04.207282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:04.249167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e68e9-f9cc-407b-9dad-c87d7eb03aec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:04.249796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e68e9-f9cc-407b-9dad-c87d7eb03aec service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:04.250076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e68e9-f9cc-407b-9dad-c87d7eb03aec service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:04.250351 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e68e9-f9cc-407b-9dad-c87d7eb03aec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:04.252102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-252e68e9-f9cc-407b-9dad-c87d7eb03aec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:04.399051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e68e9-f9cc-407b-9dad-c87d7eb03aec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:04.400689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e68e9-f9cc-407b-9dad-c87d7eb03aec service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:04.423772 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 738/1481] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:14:07.020226 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa50633-3a70-4500-8642-880b39014951 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:07.020876 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa50633-3a70-4500-8642-880b39014951 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:07.020876 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa50633-3a70-4500-8642-880b39014951 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:07.022613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 744/1482] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:14:07.031104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ade4f2-18b6-4648-8b1b-31f67f46aa01 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:07.031957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ade4f2-18b6-4648-8b1b-31f67f46aa01 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:07.031957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ade4f2-18b6-4648-8b1b-31f67f46aa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:07.116507 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-33ade4f2-18b6-4648-8b1b-31f67f46aa01 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:07.117850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-33ade4f2-18b6-4648-8b1b-31f67f46aa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:07.176185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:07.240417 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 739/1483] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:14:07.281090 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa50633-3a70-4500-8642-880b39014951 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:07.282944 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4fa50633-3a70-4500-8642-880b39014951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:07.312446 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:07.413819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa50633-3a70-4500-8642-880b39014951 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:07.511658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29e92b-9800-4098-9b4d-deff24f6cd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:07.512435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29e92b-9800-4098-9b4d-deff24f6cd76 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:07.512825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29e92b-9800-4098-9b4d-deff24f6cd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:07.513350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29e92b-9800-4098-9b4d-deff24f6cd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:07.515382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7d29e92b-9800-4098-9b4d-deff24f6cd76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:07.620788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:07.678390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29e92b-9800-4098-9b4d-deff24f6cd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:07.679895 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29e92b-9800-4098-9b4d-deff24f6cd76 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:07.703040 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 745/1484] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:14:09.956745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0516d-7cd8-446c-8536-c60a18e79ec5 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:09.957356 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0516d-7cd8-446c-8536-c60a18e79ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:09.957356 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0516d-7cd8-446c-8536-c60a18e79ec5 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:09.959401 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 740/1485] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:14:09.965747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d908e-7a18-4dba-91df-98bfffebc224 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:09.966348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d908e-7a18-4dba-91df-98bfffebc224 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:09.966348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d908e-7a18-4dba-91df-98bfffebc224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:10.050188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a58d908e-7a18-4dba-91df-98bfffebc224 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:10.051593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a58d908e-7a18-4dba-91df-98bfffebc224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:10.182221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 746/1486] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:14:10.223657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0516d-7cd8-446c-8536-c60a18e79ec5 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:10.225780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-86f0516d-7cd8-446c-8536-c60a18e79ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:10.344810 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0516d-7cd8-446c-8536-c60a18e79ec5 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:10.427880 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:10.430087 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d165e9-18ed-4d52-86d7-01e3e4334406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:10.430803 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d165e9-18ed-4d52-86d7-01e3e4334406 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:10.431084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d165e9-18ed-4d52-86d7-01e3e4334406 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:10.431356 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d165e9-18ed-4d52-86d7-01e3e4334406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:10.433117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-14d165e9-18ed-4d52-86d7-01e3e4334406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:10.574732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d165e9-18ed-4d52-86d7-01e3e4334406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:10.576205 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d165e9-18ed-4d52-86d7-01e3e4334406 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:10.605050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 741/1487] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:14:12.869348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef453a-40ce-431e-9a5f-7fbda0424fa4 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:12.870147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef453a-40ce-431e-9a5f-7fbda0424fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:12.870147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef453a-40ce-431e-9a5f-7fbda0424fa4 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:12.871458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 747/1488] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:14:12.877547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08921814-3d19-4805-a213-b44e8aa2a7a4 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:12.878133 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08921814-3d19-4805-a213-b44e8aa2a7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:12.878133 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08921814-3d19-4805-a213-b44e8aa2a7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:12.969550 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-08921814-3d19-4805-a213-b44e8aa2a7a4 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:12.970826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-08921814-3d19-4805-a213-b44e8aa2a7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:13.045730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:13.107469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 742/1489] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:14:13.154220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef453a-40ce-431e-9a5f-7fbda0424fa4 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:13.156225 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5fef453a-40ce-431e-9a5f-7fbda0424fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:13.199395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:13.297014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef453a-40ce-431e-9a5f-7fbda0424fa4 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:13.404408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761304f3-b232-4f58-9b34-dead433de7fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:13.405413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761304f3-b232-4f58-9b34-dead433de7fb service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:13.405909 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761304f3-b232-4f58-9b34-dead433de7fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:13.406441 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761304f3-b232-4f58-9b34-dead433de7fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:13.409328 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-761304f3-b232-4f58-9b34-dead433de7fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:13.555242 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:13.604147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761304f3-b232-4f58-9b34-dead433de7fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:13.605614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761304f3-b232-4f58-9b34-dead433de7fb service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:13.627481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 748/1490] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:14:17.152235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac25d7-2d6f-48dc-b79d-8428261dd476 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:17.152817 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac25d7-2d6f-48dc-b79d-8428261dd476 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:17.152817 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac25d7-2d6f-48dc-b79d-8428261dd476 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:17.154273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 743/1491] 10.222.0.98 () {54 vars in 926 bytes} [Tue Jul 26 15:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:14:17.161186 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c399d1-f668-4df3-8925-185b808a3fca None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:17.161873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c399d1-f668-4df3-8925-185b808a3fca None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:17.162386 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c399d1-f668-4df3-8925-185b808a3fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:17.254466 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-f0c399d1-f668-4df3-8925-185b808a3fca None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:17.256885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f0c399d1-f668-4df3-8925-185b808a3fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:17.369054 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 749/1492] 10.222.0.98 () {58 vars in 1023 bytes} [Tue Jul 26 15:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:14:17.409477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac25d7-2d6f-48dc-b79d-8428261dd476 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:17.411803 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e0ac25d7-2d6f-48dc-b79d-8428261dd476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:17.533743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac25d7-2d6f-48dc-b79d-8428261dd476 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:17.622994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c866c-082e-47f6-baed-a9421bc0b048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:17.623633 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c866c-082e-47f6-baed-a9421bc0b048 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:17.623913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c866c-082e-47f6-baed-a9421bc0b048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:17.624264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c866c-082e-47f6-baed-a9421bc0b048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:17.626095 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c05c866c-082e-47f6-baed-a9421bc0b048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:17.637163 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:17.767405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c866c-082e-47f6-baed-a9421bc0b048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:17.768804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c866c-082e-47f6-baed-a9421bc0b048 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:17.794522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 744/1493] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:14:27.367314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=82 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:27.791831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=50 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:16:06.901128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9cf07-b6d0-4c69-9ae2-e86522da7912 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:06.901958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9cf07-b6d0-4c69-9ae2-e86522da7912 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:06.901958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9cf07-b6d0-4c69-9ae2-e86522da7912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:07.024560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-1bf9cf07-b6d0-4c69-9ae2-e86522da7912 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:16:07.025953 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-1bf9cf07-b6d0-4c69-9ae2-e86522da7912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:16:07.167988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 750/1494] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:16:07.177818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc6875-a319-4ab7-bcf4-dbc4dd3eaa88 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:07.178433 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc6875-a319-4ab7-bcf4-dbc4dd3eaa88 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:07.178433 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc6875-a319-4ab7-bcf4-dbc4dd3eaa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:07.203684 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1bcc6875-a319-4ab7-bcf4-dbc4dd3eaa88 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:16:07.205519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1bcc6875-a319-4ab7-bcf4-dbc4dd3eaa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:16:07.221525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 745/1495] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:16:07.228855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9cf07-b6d0-4c69-9ae2-e86522da7912 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:16:07.241327 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9cf07-b6d0-4c69-9ae2-e86522da7912 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:16:07.247088 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65445e52-b166-47f9-abf8-4f628c317748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:16:07.248409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65445e52-b166-47f9-abf8-4f628c317748 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:07.248409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65445e52-b166-47f9-abf8-4f628c317748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:07.248691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65445e52-b166-47f9-abf8-4f628c317748 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:07.249485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65445e52-b166-47f9-abf8-4f628c317748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:16:07.249797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65445e52-b166-47f9-abf8-4f628c317748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:16:07.250942 dv-cinder-851032-1-smb devstack@keystone.service[80489]: WARNING py.warnings [None req-65445e52-b166-47f9-abf8-4f628c317748 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:16:07.250942 dv-cinder-851032-1-smb devstack@keystone.service[80489]: warnings.warn(msg) Jul 26 15:16:07.250942 dv-cinder-851032-1-smb devstack@keystone.service[80489]: Jul 26 15:16:07.251855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65445e52-b166-47f9-abf8-4f628c317748 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:16:07.266791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 751/1496] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:16:07.276968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc6875-a319-4ab7-bcf4-dbc4dd3eaa88 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:16:07.288130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc6875-a319-4ab7-bcf4-dbc4dd3eaa88 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:16:07.293829 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5e784-fc86-4099-b962-ab02a0a82a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:16:07.295178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5e784-fc86-4099-b962-ab02a0a82a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:07.295692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5e784-fc86-4099-b962-ab02a0a82a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:07.296179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5e784-fc86-4099-b962-ab02a0a82a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:07.296933 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5e784-fc86-4099-b962-ab02a0a82a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:16:07.298842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: WARNING py.warnings [None req-4bb5e784-fc86-4099-b962-ab02a0a82a03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:16:07.298842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: warnings.warn(msg) Jul 26 15:16:07.298842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: Jul 26 15:16:07.300201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5e784-fc86-4099-b962-ab02a0a82a03 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:16:07.664198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 746/1497] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:16:07 2022] POST /identity/v3/projects => generated 379 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:16:07.669693 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65445e52-b166-47f9-abf8-4f628c317748 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:16:07.681444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65445e52-b166-47f9-abf8-4f628c317748 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:16:07.746902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:16:07.755130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288da4c0-0bab-4396-a49b-b75ce5697026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:16:07.755830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288da4c0-0bab-4396-a49b-b75ce5697026 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:07.756159 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288da4c0-0bab-4396-a49b-b75ce5697026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:07.756551 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288da4c0-0bab-4396-a49b-b75ce5697026 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:07.757415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288da4c0-0bab-4396-a49b-b75ce5697026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:16:07.758772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: WARNING py.warnings [None req-288da4c0-0bab-4396-a49b-b75ce5697026 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:16:07.758772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: warnings.warn(msg) Jul 26 15:16:07.758772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: Jul 26 15:16:07.760389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288da4c0-0bab-4396-a49b-b75ce5697026 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:16:07.863851 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 752/1498] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:16:07 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:16:07.868705 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5e784-fc86-4099-b962-ab02a0a82a03 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:16:07.881050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5e784-fc86-4099-b962-ab02a0a82a03 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:16:07.886479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4071f-f5c8-4ba4-ab2b-f2d3b03950ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:16:07.890834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4071f-f5c8-4ba4-ab2b-f2d3b03950ff admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:07.890834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4071f-f5c8-4ba4-ab2b-f2d3b03950ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:07.890834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4071f-f5c8-4ba4-ab2b-f2d3b03950ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:07.890834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4071f-f5c8-4ba4-ab2b-f2d3b03950ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:16:07.890834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: WARNING py.warnings [None req-c2f4071f-f5c8-4ba4-ab2b-f2d3b03950ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:16:07.890834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: warnings.warn(msg) Jul 26 15:16:07.890834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: Jul 26 15:16:07.891723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4071f-f5c8-4ba4-ab2b-f2d3b03950ff admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:16:07.908012 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 747/1499] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:16:07.912640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288da4c0-0bab-4396-a49b-b75ce5697026 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:16:07.924056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288da4c0-0bab-4396-a49b-b75ce5697026 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:16:07.929105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b2164-5ee5-4608-9b00-ec87b7a236b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:16:07.929824 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b2164-5ee5-4608-9b00-ec87b7a236b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:07.930265 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b2164-5ee5-4608-9b00-ec87b7a236b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:07.930738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b2164-5ee5-4608-9b00-ec87b7a236b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:07.931525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b2164-5ee5-4608-9b00-ec87b7a236b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:16:07.932625 dv-cinder-851032-1-smb devstack@keystone.service[80489]: WARNING py.warnings [None req-db2b2164-5ee5-4608-9b00-ec87b7a236b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:16:07.932625 dv-cinder-851032-1-smb devstack@keystone.service[80489]: warnings.warn(msg) Jul 26 15:16:07.932625 dv-cinder-851032-1-smb devstack@keystone.service[80489]: Jul 26 15:16:07.933778 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b2164-5ee5-4608-9b00-ec87b7a236b5 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:16:07.951958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 753/1500] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:16:07.956630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4071f-f5c8-4ba4-ab2b-f2d3b03950ff admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:16:07.967661 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4071f-f5c8-4ba4-ab2b-f2d3b03950ff admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:16:07.972769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adbaca-e5d7-4f0a-a83e-1858c2ebe776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:16:07.973447 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adbaca-e5d7-4f0a-a83e-1858c2ebe776 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:07.973729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adbaca-e5d7-4f0a-a83e-1858c2ebe776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:07.974034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adbaca-e5d7-4f0a-a83e-1858c2ebe776 admin admin] PATH_INFO: `/v3/projects/1b8c8d8728244eeab340b5ab1d4b234c/users/e3367367c89945fcaceaaf7755848606/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:07.992178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adbaca-e5d7-4f0a-a83e-1858c2ebe776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8c8d8728244eeab340b5ab1d4b234c, user_id=e3367367c89945fcaceaaf7755848606, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:16:07.993623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: WARNING py.warnings [None req-a9adbaca-e5d7-4f0a-a83e-1858c2ebe776 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:16:07.993623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: warnings.warn(msg) Jul 26 15:16:07.993623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: Jul 26 15:16:07.995786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adbaca-e5d7-4f0a-a83e-1858c2ebe776 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:16:08.162234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 748/1501] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:16:07 2022] PUT /identity/v3/projects/1b8c8d8728244eeab340b5ab1d4b234c/users/e3367367c89945fcaceaaf7755848606/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:16:08.175305 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0c313-ab5f-41a5-93be-ff9478dadce1 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:08.179114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0c313-ab5f-41a5-93be-ff9478dadce1 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:08.179114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0c313-ab5f-41a5-93be-ff9478dadce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:08.208170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-12a0c313-ab5f-41a5-93be-ff9478dadce1 None None] MFA Rules not processed for user `e3367367c89945fcaceaaf7755848606`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:16:08.209415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-12a0c313-ab5f-41a5-93be-ff9478dadce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:16:08.288732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 754/1502] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:16:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:16:08.303726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473f792-798c-4928-9d48-b8d2c271adfe None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:08.304390 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473f792-798c-4928-9d48-b8d2c271adfe None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:08.304390 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473f792-798c-4928-9d48-b8d2c271adfe None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:08.305709 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 749/1503] 10.222.0.98 () {54 vars in 964 bytes} [Tue Jul 26 15:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:16:08.311978 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1946bf1-7fc7-44ef-b5af-aaeac85cbf65 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:08.312276 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1946bf1-7fc7-44ef-b5af-aaeac85cbf65 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:08.312562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1946bf1-7fc7-44ef-b5af-aaeac85cbf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:08.387832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-e1946bf1-7fc7-44ef-b5af-aaeac85cbf65 None None] MFA Rules not processed for user `96d09fca7f864129ab0dcb90fb5d24e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:16:08.389591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e1946bf1-7fc7-44ef-b5af-aaeac85cbf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:16:08.491446 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 755/1504] 10.222.0.98 () {58 vars in 1061 bytes} [Tue Jul 26 15:16:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:16:08.502521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473f792-798c-4928-9d48-b8d2c271adfe None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:16:08.515887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473f792-798c-4928-9d48-b8d2c271adfe None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:16:08.522842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ffcc0-efb3-4a7c-b25a-7d6a1f6f1a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:16:08.523488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ffcc0-efb3-4a7c-b25a-7d6a1f6f1a48 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:08.523768 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ffcc0-efb3-4a7c-b25a-7d6a1f6f1a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:08.524046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ffcc0-efb3-4a7c-b25a-7d6a1f6f1a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:08.534185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ffcc0-efb3-4a7c-b25a-7d6a1f6f1a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:16:08.536666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ffcc0-efb3-4a7c-b25a-7d6a1f6f1a48 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:16:08.547983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 750/1505] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:16:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:16:08.608980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f38103-ce67-4435-8dd2-d8d17bace336 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:08.609252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f38103-ce67-4435-8dd2-d8d17bace336 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:08.609529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f38103-ce67-4435-8dd2-d8d17bace336 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:08.610914 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 756/1506] 10.222.0.98 () {52 vars in 830 bytes} [Tue Jul 26 15:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:16:08.615206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ffcc0-efb3-4a7c-b25a-7d6a1f6f1a48 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:16:08.691339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ffcc0-efb3-4a7c-b25a-7d6a1f6f1a48 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:16:08.696514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225462e-c040-42d2-b429-34cdbd6eb9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:16:08.697193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225462e-c040-42d2-b429-34cdbd6eb9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:08.697487 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225462e-c040-42d2-b429-34cdbd6eb9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:08.697881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225462e-c040-42d2-b429-34cdbd6eb9dd admin admin] PATH_INFO: `/v3/users/e3367367c89945fcaceaaf7755848606` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:08.699285 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225462e-c040-42d2-b429-34cdbd6eb9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3367367c89945fcaceaaf7755848606)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:16:08.700325 dv-cinder-851032-1-smb devstack@keystone.service[80488]: WARNING py.warnings [None req-d225462e-c040-42d2-b429-34cdbd6eb9dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:16:08.700325 dv-cinder-851032-1-smb devstack@keystone.service[80488]: warnings.warn(msg) Jul 26 15:16:08.700325 dv-cinder-851032-1-smb devstack@keystone.service[80488]: Jul 26 15:16:08.701644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225462e-c040-42d2-b429-34cdbd6eb9dd admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:16:09.006859 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d225462e-c040-42d2-b429-34cdbd6eb9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3367367c89945fcaceaaf7755848606'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:16:09.007551 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d225462e-c040-42d2-b429-34cdbd6eb9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3367367c89945fcaceaaf7755848606'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:16:09.034301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d225462e-c040-42d2-b429-34cdbd6eb9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3367367c89945fcaceaaf7755848606'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:16:09.035199 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d225462e-c040-42d2-b429-34cdbd6eb9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3367367c89945fcaceaaf7755848606'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:16:09.158411 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d225462e-c040-42d2-b429-34cdbd6eb9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3367367c89945fcaceaaf7755848606'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:16:09.170659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:16:09.183132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 751/1507] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:16:08 2022] DELETE /identity/v3/users/e3367367c89945fcaceaaf7755848606 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:16:09.188829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfd725-06c9-4375-8096-5959767ca98d None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:09.189674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfd725-06c9-4375-8096-5959767ca98d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:09.189864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfd725-06c9-4375-8096-5959767ca98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:09.213193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-f2cfd725-06c9-4375-8096-5959767ca98d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:16:09.214498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f2cfd725-06c9-4375-8096-5959767ca98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:16:09.226965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:16:09.289122 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 757/1508] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:16:09.300558 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225462e-c040-42d2-b429-34cdbd6eb9dd admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:16:09.302132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d225462e-c040-42d2-b429-34cdbd6eb9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:16:09.424173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225462e-c040-42d2-b429-34cdbd6eb9dd admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:16:09.430527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a1ea6-c3d7-4bbf-9424-99ee349889b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:16:09.431626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a1ea6-c3d7-4bbf-9424-99ee349889b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:09.432128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a1ea6-c3d7-4bbf-9424-99ee349889b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:09.432597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a1ea6-c3d7-4bbf-9424-99ee349889b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:09.449312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a1ea6-c3d7-4bbf-9424-99ee349889b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:16:09.451310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a1ea6-c3d7-4bbf-9424-99ee349889b7 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:16:09.463249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 752/1509] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:16:10.059331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfd725-06c9-4375-8096-5959767ca98d None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:16:10.062728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f2cfd725-06c9-4375-8096-5959767ca98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:16:10.086143 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfd725-06c9-4375-8096-5959767ca98d None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:16:10.094258 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:16:10.094982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:16:10.095264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:16:10.095548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663 admin admin] PATH_INFO: `/v3/projects/1b8c8d8728244eeab340b5ab1d4b234c` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:16:10.096927 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8c8d8728244eeab340b5ab1d4b234c)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:16:10.097979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: WARNING py.warnings [None req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:16:10.097979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: warnings.warn(msg) Jul 26 15:16:10.097979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: Jul 26 15:16:10.099252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:16:10.291849 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8c8d8728244eeab340b5ab1d4b234c', 'request_id': 'req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:16:10.392736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8c8d8728244eeab340b5ab1d4b234c', 'request_id': 'req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:16:10.409394 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8c8d8728244eeab340b5ab1d4b234c', 'request_id': 'req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:16:10.422329 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663 admin admin] The token cache is being invalidate because project 1b8c8d8728244eeab340b5ab1d4b234c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:16:10.422661 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:16:10.423447 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9a4ab0da-1db3-42c5-8ed8-760ea50d8663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:16:10.425050 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 758/1510] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:16:10 2022] DELETE /identity/v3/projects/1b8c8d8728244eeab340b5ab1d4b234c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:16:19.458192 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=38 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:16:20.419103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:18:05.101400 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef33571-eae9-4e9b-9a5b-5b2fd3608f96 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:05.102100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef33571-eae9-4e9b-9a5b-5b2fd3608f96 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:05.102100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef33571-eae9-4e9b-9a5b-5b2fd3608f96 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:05.103627 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:18:05.110073 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee68a4d-8163-4f52-bdab-dc7ddea359d7 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:05.110826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee68a4d-8163-4f52-bdab-dc7ddea359d7 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:05.110965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee68a4d-8163-4f52-bdab-dc7ddea359d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:05.139914 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-fee68a4d-8163-4f52-bdab-dc7ddea359d7 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:18:05.141682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-fee68a4d-8163-4f52-bdab-dc7ddea359d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:05.243374 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:18:05.418021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef33571-eae9-4e9b-9a5b-5b2fd3608f96 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:18:05.420050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2ef33571-eae9-4e9b-9a5b-5b2fd3608f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:05.597839 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef33571-eae9-4e9b-9a5b-5b2fd3608f96 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:18:05.607763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06ce52-3d9b-45aa-aedb-e6621f9ba505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:18:05.608685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06ce52-3d9b-45aa-aedb-e6621f9ba505 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:05.609116 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06ce52-3d9b-45aa-aedb-e6621f9ba505 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:05.609521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06ce52-3d9b-45aa-aedb-e6621f9ba505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:05.624498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06ce52-3d9b-45aa-aedb-e6621f9ba505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:18:05.627434 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06ce52-3d9b-45aa-aedb-e6621f9ba505 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:18:05.646016 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 754/1513] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:18:06.363651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca686c-56b7-444a-946f-559c6ecf4a90 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:06.364525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca686c-56b7-444a-946f-559c6ecf4a90 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:06.365344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca686c-56b7-444a-946f-559c6ecf4a90 None None] PATH_INFO: `/v3` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:06.367154 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 760/1514] 10.222.0.122 () {54 vars in 926 bytes} [Tue Jul 26 15:18:06 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:18:06.375311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a3c9a-1004-41ce-a477-7de3ff88fd8b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:06.375963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a3c9a-1004-41ce-a477-7de3ff88fd8b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:06.376263 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a3c9a-1004-41ce-a477-7de3ff88fd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:06.471537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-4f4a3c9a-1004-41ce-a477-7de3ff88fd8b None None] MFA Rules not processed for user `448161cd39dc4a6786c8813faa79376a`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:18:06.473743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4f4a3c9a-1004-41ce-a477-7de3ff88fd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:06.582682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 755/1515] 10.222.0.122 () {58 vars in 1016 bytes} [Tue Jul 26 15:18:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:18:06.618586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0b136-6dde-4132-931a-310fc0704a72 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:06.618887 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0b136-6dde-4132-931a-310fc0704a72 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:06.619139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0b136-6dde-4132-931a-310fc0704a72 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:06.620648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 761/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:18:06.626754 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ab8b8-607d-48af-b5a2-360cf628d7ae None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:06.627178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ab8b8-607d-48af-b5a2-360cf628d7ae None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:06.627550 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ab8b8-607d-48af-b5a2-360cf628d7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:06.651013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cc7ab8b8-607d-48af-b5a2-360cf628d7ae None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:18:06.652570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cc7ab8b8-607d-48af-b5a2-360cf628d7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:06.663399 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 756/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:18:06.835568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0b136-6dde-4132-931a-310fc0704a72 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:18:06.852686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0b136-6dde-4132-931a-310fc0704a72 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:18:06.859619 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ee3df-745a-4106-92c3-49d9deb6b508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:18:06.860253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ee3df-745a-4106-92c3-49d9deb6b508 service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:06.860611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ee3df-745a-4106-92c3-49d9deb6b508 service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:06.861010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ee3df-745a-4106-92c3-49d9deb6b508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:06.871516 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ee3df-745a-4106-92c3-49d9deb6b508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:18:06.873484 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ee3df-745a-4106-92c3-49d9deb6b508 service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:18:06.886272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 762/1518] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:18:16.263503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c5d60-9e55-4e69-b7e6-5a88c0a69125 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:16.264075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c5d60-9e55-4e69-b7e6-5a88c0a69125 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:16.264075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c5d60-9e55-4e69-b7e6-5a88c0a69125 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:16.265386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 757/1519] 10.222.0.98 () {54 vars in 961 bytes} [Tue Jul 26 15:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:18:16.272940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485f307-924e-4ae0-ad85-6b3a8c2728be None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:16.273534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485f307-924e-4ae0-ad85-6b3a8c2728be None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:16.273983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485f307-924e-4ae0-ad85-6b3a8c2728be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:16.310251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-8485f307-924e-4ae0-ad85-6b3a8c2728be None None] MFA Rules not processed for user `448161cd39dc4a6786c8813faa79376a`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:18:16.312459 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8485f307-924e-4ae0-ad85-6b3a8c2728be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:16.329064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 763/1520] 10.222.0.98 () {58 vars in 1058 bytes} [Tue Jul 26 15:18:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:18:16.340136 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c5d60-9e55-4e69-b7e6-5a88c0a69125 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:18:16.369193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c5d60-9e55-4e69-b7e6-5a88c0a69125 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:18:16.378555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7e538-1516-4124-8655-213d0e69895c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:18:16.379628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7e538-1516-4124-8655-213d0e69895c service placement] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:16.380130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7e538-1516-4124-8655-213d0e69895c service placement] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:16.380721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7e538-1516-4124-8655-213d0e69895c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:16.395615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7e538-1516-4124-8655-213d0e69895c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:18:16.397487 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7e538-1516-4124-8655-213d0e69895c service placement] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:18:16.409557 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 758/1521] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:18:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:18:18.307429 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfd3f5-9934-4bab-a886-6400c98f5387 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:18.308070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfd3f5-9934-4bab-a886-6400c98f5387 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:18.308070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfd3f5-9934-4bab-a886-6400c98f5387 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:18.309375 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:18:18.315289 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d51c5-7dd8-4ccf-a6e8-c275df1b9b14 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:18.316168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d51c5-7dd8-4ccf-a6e8-c275df1b9b14 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:18.316359 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d51c5-7dd8-4ccf-a6e8-c275df1b9b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:18.325114 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:18:18.340324 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-739d51c5-7dd8-4ccf-a6e8-c275df1b9b14 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:18:18.341749 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-739d51c5-7dd8-4ccf-a6e8-c275df1b9b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:18.351256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:18:18.514816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfd3f5-9934-4bab-a886-6400c98f5387 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:18:18.531570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfd3f5-9934-4bab-a886-6400c98f5387 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:18:18.538073 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4446e-5951-406b-8983-c05a5d183002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:18:18.538756 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4446e-5951-406b-8983-c05a5d183002 service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:18.539040 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4446e-5951-406b-8983-c05a5d183002 service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:18.539314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4446e-5951-406b-8983-c05a5d183002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:18.549940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4446e-5951-406b-8983-c05a5d183002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:18:18.552889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4446e-5951-406b-8983-c05a5d183002 service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:18:18.565258 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 765/1524] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:18:19.493516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d298f7-e23f-4a73-a0bf-a6ef325a2069 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:19.494135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d298f7-e23f-4a73-a0bf-a6ef325a2069 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:19.494534 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d298f7-e23f-4a73-a0bf-a6ef325a2069 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:19.497249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:18:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:18:19.504380 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d0e94-0212-433c-bdf5-5f037e360579 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:19.505480 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d0e94-0212-433c-bdf5-5f037e360579 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:19.505480 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d0e94-0212-433c-bdf5-5f037e360579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:19.528389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-8e4d0e94-0212-433c-bdf5-5f037e360579 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:18:19.529902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8e4d0e94-0212-433c-bdf5-5f037e360579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:19.538873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:18:19.703551 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d298f7-e23f-4a73-a0bf-a6ef325a2069 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:18:19.727767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d298f7-e23f-4a73-a0bf-a6ef325a2069 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:18:19.734826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbca50-9256-4567-8242-24bdd4a48b07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:18:19.735438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbca50-9256-4567-8242-24bdd4a48b07 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:19.735727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbca50-9256-4567-8242-24bdd4a48b07 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:19.736001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbca50-9256-4567-8242-24bdd4a48b07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:19.747634 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbca50-9256-4567-8242-24bdd4a48b07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:18:19.750850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbca50-9256-4567-8242-24bdd4a48b07 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:18:19.772244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 761/1527] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:18:23.841342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860d8fd-629f-4f94-8b10-60f32381016f None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:23.842169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860d8fd-629f-4f94-8b10-60f32381016f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:23.842169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860d8fd-629f-4f94-8b10-60f32381016f None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:23.844490 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:18:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:18:23.852503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91678a9d-b5ac-4545-8de4-2bb9a7cd951c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:23.853089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91678a9d-b5ac-4545-8de4-2bb9a7cd951c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:23.853257 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91678a9d-b5ac-4545-8de4-2bb9a7cd951c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:23.876482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-91678a9d-b5ac-4545-8de4-2bb9a7cd951c None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:18:23.877950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-91678a9d-b5ac-4545-8de4-2bb9a7cd951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:23.886846 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:18:23.973171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860d8fd-629f-4f94-8b10-60f32381016f None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:18:23.975324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b860d8fd-629f-4f94-8b10-60f32381016f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:24.049886 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860d8fd-629f-4f94-8b10-60f32381016f None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:18:24.054196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6821fe-5d30-49c3-94db-8c7f30552f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:18:24.054927 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6821fe-5d30-49c3-94db-8c7f30552f99 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:24.055341 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6821fe-5d30-49c3-94db-8c7f30552f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:24.055666 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6821fe-5d30-49c3-94db-8c7f30552f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:24.067114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6821fe-5d30-49c3-94db-8c7f30552f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:18:24.068844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6821fe-5d30-49c3-94db-8c7f30552f99 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:18:24.080663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 768/1530] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:18:26.251059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1526df-1e79-4587-a0d0-85e6d97915fd None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:26.251800 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1526df-1e79-4587-a0d0-85e6d97915fd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:26.251800 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1526df-1e79-4587-a0d0-85e6d97915fd None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:26.253692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:18:26.261514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8436c48-4f38-4169-b90c-0c44f74c410a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:26.262133 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8436c48-4f38-4169-b90c-0c44f74c410a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:26.262276 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8436c48-4f38-4169-b90c-0c44f74c410a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:26.289043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a8436c48-4f38-4169-b90c-0c44f74c410a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:18:26.290382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a8436c48-4f38-4169-b90c-0c44f74c410a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:26.299213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:18:26.343144 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1526df-1e79-4587-a0d0-85e6d97915fd None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:18:26.357099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1526df-1e79-4587-a0d0-85e6d97915fd None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:18:26.361027 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c810f-7fea-40cf-92f4-bbaea3e903e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:18:26.361712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c810f-7fea-40cf-92f4-bbaea3e903e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:26.362037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c810f-7fea-40cf-92f4-bbaea3e903e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:26.362388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c810f-7fea-40cf-92f4-bbaea3e903e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:26.373545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c810f-7fea-40cf-92f4-bbaea3e903e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:18:26.375266 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c810f-7fea-40cf-92f4-bbaea3e903e9 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:18:26.387662 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 764/1533] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:18:30.627523 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660315d-29e3-434e-9ddd-2aa071ae99b2 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:30.630621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660315d-29e3-434e-9ddd-2aa071ae99b2 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:30.630621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660315d-29e3-434e-9ddd-2aa071ae99b2 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:30.631283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:18:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:18:30.637913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d25841-0c08-4ca9-bac0-e9b91c267e43 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:30.638897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d25841-0c08-4ca9-bac0-e9b91c267e43 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:30.638897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d25841-0c08-4ca9-bac0-e9b91c267e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:30.673405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-56d25841-0c08-4ca9-bac0-e9b91c267e43 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:18:30.675331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-56d25841-0c08-4ca9-bac0-e9b91c267e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:30.686714 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:18:31.070805 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660315d-29e3-434e-9ddd-2aa071ae99b2 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:18:31.073744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2660315d-29e3-434e-9ddd-2aa071ae99b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:31.084638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=75 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:18:31.162142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660315d-29e3-434e-9ddd-2aa071ae99b2 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:18:31.166649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707257b-36be-45b3-b744-024e3d155a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:18:31.167363 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707257b-36be-45b3-b744-024e3d155a24 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:31.167704 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707257b-36be-45b3-b744-024e3d155a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:31.168030 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707257b-36be-45b3-b744-024e3d155a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:31.180269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707257b-36be-45b3-b744-024e3d155a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:18:31.181725 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707257b-36be-45b3-b744-024e3d155a24 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:18:31.195061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 771/1536] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:18:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:18:33.622775 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbbd40-9fdc-44fc-bde0-79fff794bd74 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:33.623642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbbd40-9fdc-44fc-bde0-79fff794bd74 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:33.623811 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbbd40-9fdc-44fc-bde0-79fff794bd74 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:33.626501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:18:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:18:33.632950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92d3c4-5872-409b-b22e-6a74995e4055 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:33.633809 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92d3c4-5872-409b-b22e-6a74995e4055 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:33.633994 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92d3c4-5872-409b-b22e-6a74995e4055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:33.658799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-8b92d3c4-5872-409b-b22e-6a74995e4055 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:18:33.660243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8b92d3c4-5872-409b-b22e-6a74995e4055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:33.669999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:18:34.019715 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbbd40-9fdc-44fc-bde0-79fff794bd74 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:18:34.022397 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b1bbbd40-9fdc-44fc-bde0-79fff794bd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:34.042175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbbd40-9fdc-44fc-bde0-79fff794bd74 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:18:34.046210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050c9b2-a582-436c-b1cc-529459765201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:18:34.047006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050c9b2-a582-436c-b1cc-529459765201 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:34.047325 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050c9b2-a582-436c-b1cc-529459765201 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:34.047627 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050c9b2-a582-436c-b1cc-529459765201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:34.060746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050c9b2-a582-436c-b1cc-529459765201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:18:34.062271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050c9b2-a582-436c-b1cc-529459765201 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:18:34.074583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 767/1539] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:18:43.652598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=28 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:18:44.069668 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=26 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:18.893746 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a97b1-0678-4b5f-aba2-8cb8b87e55ac None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:18.895574 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a97b1-0678-4b5f-aba2-8cb8b87e55ac None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:18.895574 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a97b1-0678-4b5f-aba2-8cb8b87e55ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:18.923802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-004a97b1-0678-4b5f-aba2-8cb8b87e55ac None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:18.925137 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-004a97b1-0678-4b5f-aba2-8cb8b87e55ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:18.944392 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 773/1540] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:18.955725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8010b3-497d-4dbe-9c65-fdf178d620a4 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:18.957983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8010b3-497d-4dbe-9c65-fdf178d620a4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:18.958783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8010b3-497d-4dbe-9c65-fdf178d620a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:19.022417 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-bc8010b3-497d-4dbe-9c65-fdf178d620a4 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:19.025277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bc8010b3-497d-4dbe-9c65-fdf178d620a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:19.044446 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 768/1541] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:19.051243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a97b1-0678-4b5f-aba2-8cb8b87e55ac None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:19.087275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a97b1-0678-4b5f-aba2-8cb8b87e55ac None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:19.102659 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879204ac-1242-4e1a-a8a8-2d37bceefbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:19.104552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879204ac-1242-4e1a-a8a8-2d37bceefbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:19.105350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879204ac-1242-4e1a-a8a8-2d37bceefbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:19.106144 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879204ac-1242-4e1a-a8a8-2d37bceefbf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:19.108180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879204ac-1242-4e1a-a8a8-2d37bceefbf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:20:19.109321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879204ac-1242-4e1a-a8a8-2d37bceefbf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:19.112984 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879204ac-1242-4e1a-a8a8-2d37bceefbf4 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:19.145072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 774/1542] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:20:19.167670 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8010b3-497d-4dbe-9c65-fdf178d620a4 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:19.190991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8010b3-497d-4dbe-9c65-fdf178d620a4 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:19.210818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13024168-1380-4d1a-ab6a-097703395ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:19.211933 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13024168-1380-4d1a-ab6a-097703395ddb admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:19.212442 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13024168-1380-4d1a-ab6a-097703395ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:19.212901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13024168-1380-4d1a-ab6a-097703395ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:19.214190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13024168-1380-4d1a-ab6a-097703395ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:19.218789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13024168-1380-4d1a-ab6a-097703395ddb admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:19.371149 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 769/1543] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:19 2022] POST /identity/v3/projects => generated 363 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:19.378325 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879204ac-1242-4e1a-a8a8-2d37bceefbf4 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:19.403822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879204ac-1242-4e1a-a8a8-2d37bceefbf4 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:19.492427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d16cd-f3eb-4457-8832-5e9f80b2a094 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:19.492968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d16cd-f3eb-4457-8832-5e9f80b2a094 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:19.493395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d16cd-f3eb-4457-8832-5e9f80b2a094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:19.559357 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-817d16cd-f3eb-4457-8832-5e9f80b2a094 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:19.563134 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-817d16cd-f3eb-4457-8832-5e9f80b2a094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:19.623584 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f49201-7954-4e7f-9799-75e769f0f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:19.624312 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f49201-7954-4e7f-9799-75e769f0f548 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:19.624707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f49201-7954-4e7f-9799-75e769f0f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:19.625194 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f49201-7954-4e7f-9799-75e769f0f548 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:19.626458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f49201-7954-4e7f-9799-75e769f0f548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:19.630881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f49201-7954-4e7f-9799-75e769f0f548 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:19.757721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 770/1544] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:20:19.760099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc686a-13ba-4763-92a3-ddff6c6b2c72 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:19.760670 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc686a-13ba-4763-92a3-ddff6c6b2c72 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:19.761182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc686a-13ba-4763-92a3-ddff6c6b2c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:19.803593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 775/1545] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:19 2022] POST /identity/v3/users => generated 282 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:19.806173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7b158-262a-4a47-976d-56c463805e5b None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:19.806717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7b158-262a-4a47-976d-56c463805e5b None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:19.807198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7b158-262a-4a47-976d-56c463805e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:19.866807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9dcc686a-13ba-4763-92a3-ddff6c6b2c72 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:19.878349 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9dcc686a-13ba-4763-92a3-ddff6c6b2c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:19.903825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-e6e7b158-262a-4a47-976d-56c463805e5b None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:19.906892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e6e7b158-262a-4a47-976d-56c463805e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:19.913221 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 771/1546] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:19.922837 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72ff5b-096f-455b-a326-b55801f50a36 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:19.923309 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72ff5b-096f-455b-a326-b55801f50a36 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:19.923765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72ff5b-096f-455b-a326-b55801f50a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:19.946236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 776/1547] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:19.947312 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7b158-262a-4a47-976d-56c463805e5b None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:19.966994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3d72ff5b-096f-455b-a326-b55801f50a36 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:19.969132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3d72ff5b-096f-455b-a326-b55801f50a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:19.974601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7b158-262a-4a47-976d-56c463805e5b None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:19.987004 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a55f3-3f02-4a7f-ba72-820551c9af42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:19.990710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a55f3-3f02-4a7f-ba72-820551c9af42 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:19.990710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a55f3-3f02-4a7f-ba72-820551c9af42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:19.990710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a55f3-3f02-4a7f-ba72-820551c9af42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:19.990710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a55f3-3f02-4a7f-ba72-820551c9af42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:19.991807 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a55f3-3f02-4a7f-ba72-820551c9af42 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:20.008755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 772/1548] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:20.010020 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b528b-a775-4994-a5f8-8d2c8f27712e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.010784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b528b-a775-4994-a5f8-8d2c8f27712e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.011044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b528b-a775-4994-a5f8-8d2c8f27712e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.019493 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 777/1549] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:20.025093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ad3e5-0005-46c7-a205-13e19932bfb8 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.025093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ad3e5-0005-46c7-a205-13e19932bfb8 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.025093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ad3e5-0005-46c7-a205-13e19932bfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.064216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-487b528b-a775-4994-a5f8-8d2c8f27712e None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:20.066775 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-487b528b-a775-4994-a5f8-8d2c8f27712e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:20.070126 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b73ad3e5-0005-46c7-a205-13e19932bfb8 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:20.074878 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b73ad3e5-0005-46c7-a205-13e19932bfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:20.093184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 773/1550] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:20.095490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337da38-149c-4d39-8873-6ca7a06a43ed None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.095974 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337da38-149c-4d39-8873-6ca7a06a43ed None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.096450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337da38-149c-4d39-8873-6ca7a06a43ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.115040 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 778/1551] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:20.116299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ad3e5-0005-46c7-a205-13e19932bfb8 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:20.150301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7337da38-149c-4d39-8873-6ca7a06a43ed None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:20.152387 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7337da38-149c-4d39-8873-6ca7a06a43ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:20.154569 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ad3e5-0005-46c7-a205-13e19932bfb8 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:20.172468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f96ce-9425-43e6-8e76-76449114f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:20.173543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f96ce-9425-43e6-8e76-76449114f949 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.174038 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f96ce-9425-43e6-8e76-76449114f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.174559 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f96ce-9425-43e6-8e76-76449114f949 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.175856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f96ce-9425-43e6-8e76-76449114f949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:20:20.176394 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f96ce-9425-43e6-8e76-76449114f949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:20.184980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 774/1552] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:20.186554 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337da38-149c-4d39-8873-6ca7a06a43ed None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:20.188118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f96ce-9425-43e6-8e76-76449114f949 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:20.206983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 779/1553] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:20:20.208416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337da38-149c-4d39-8873-6ca7a06a43ed None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:20.208641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d772942-dca5-4069-88b6-16c889263560 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.208788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d772942-dca5-4069-88b6-16c889263560 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.209073 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d772942-dca5-4069-88b6-16c889263560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.230998 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874d32f-2949-433c-9e24-cdd896faa330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:20.232064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874d32f-2949-433c-9e24-cdd896faa330 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.232689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874d32f-2949-433c-9e24-cdd896faa330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.233554 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874d32f-2949-433c-9e24-cdd896faa330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.238667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874d32f-2949-433c-9e24-cdd896faa330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:20.241842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874d32f-2949-433c-9e24-cdd896faa330 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:20.260292 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-2d772942-dca5-4069-88b6-16c889263560 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:20.261453 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2d772942-dca5-4069-88b6-16c889263560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:20.274957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 775/1554] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:20.276492 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874d32f-2949-433c-9e24-cdd896faa330 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:20.288937 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 780/1555] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:20.291128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d772942-dca5-4069-88b6-16c889263560 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:20.301479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874d32f-2949-433c-9e24-cdd896faa330 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:20.309741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d772942-dca5-4069-88b6-16c889263560 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:20.310295 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d541ecc-7de4-4ef6-8749-21b29a271bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:20.311172 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d541ecc-7de4-4ef6-8749-21b29a271bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.311551 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d541ecc-7de4-4ef6-8749-21b29a271bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.311916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d541ecc-7de4-4ef6-8749-21b29a271bb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.312734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d541ecc-7de4-4ef6-8749-21b29a271bb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:20:20.313139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d541ecc-7de4-4ef6-8749-21b29a271bb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:20.314667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: WARNING py.warnings [None req-9d541ecc-7de4-4ef6-8749-21b29a271bb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:20:20.314667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: warnings.warn(msg) Jul 26 15:20:20.314667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: Jul 26 15:20:20.315197 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e11c5-c90d-45a4-9041-1b6f4c14a47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:20.315880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e11c5-c90d-45a4-9041-1b6f4c14a47f admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.316118 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d541ecc-7de4-4ef6-8749-21b29a271bb9 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:20.316241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e11c5-c90d-45a4-9041-1b6f4c14a47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.316438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e11c5-c90d-45a4-9041-1b6f4c14a47f admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.317161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e11c5-c90d-45a4-9041-1b6f4c14a47f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:20:20.317474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e11c5-c90d-45a4-9041-1b6f4c14a47f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:20.319435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e11c5-c90d-45a4-9041-1b6f4c14a47f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:20.331879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 776/1556] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:20:20.332743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d541ecc-7de4-4ef6-8749-21b29a271bb9 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:20.339279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 781/1557] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:20:20.339279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ead119-4b87-4eeb-b1ca-f6bbc5afefc7 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.339279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ead119-4b87-4eeb-b1ca-f6bbc5afefc7 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.339279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ead119-4b87-4eeb-b1ca-f6bbc5afefc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.345834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d541ecc-7de4-4ef6-8749-21b29a271bb9 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:20.351367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded67214-62d8-403b-a733-95f3fdda59d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:20.352014 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded67214-62d8-403b-a733-95f3fdda59d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.352541 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded67214-62d8-403b-a733-95f3fdda59d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.352814 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded67214-62d8-403b-a733-95f3fdda59d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.353495 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded67214-62d8-403b-a733-95f3fdda59d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:20.356585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded67214-62d8-403b-a733-95f3fdda59d3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:20.363142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-e3ead119-4b87-4eeb-b1ca-f6bbc5afefc7 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:20.364431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e3ead119-4b87-4eeb-b1ca-f6bbc5afefc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:20.374568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 782/1558] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:20.375418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ead119-4b87-4eeb-b1ca-f6bbc5afefc7 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:20.386505 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ead119-4b87-4eeb-b1ca-f6bbc5afefc7 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:20.391686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e48165-42dd-40e8-9b7e-399c30c4e3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:20.392392 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e48165-42dd-40e8-9b7e-399c30c4e3a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.392679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e48165-42dd-40e8-9b7e-399c30c4e3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.392956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e48165-42dd-40e8-9b7e-399c30c4e3a9 admin admin] PATH_INFO: `/v3/projects/b4750008bca641b2b48b50588284103f/users/ea47a17e6e5f44c49a7ee7a98f889ac3/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.414290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e48165-42dd-40e8-9b7e-399c30c4e3a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4750008bca641b2b48b50588284103f, user_id=ea47a17e6e5f44c49a7ee7a98f889ac3, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:20.415385 dv-cinder-851032-1-smb devstack@keystone.service[80489]: WARNING py.warnings [None req-36e48165-42dd-40e8-9b7e-399c30c4e3a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:20:20.415385 dv-cinder-851032-1-smb devstack@keystone.service[80489]: warnings.warn(msg) Jul 26 15:20:20.415385 dv-cinder-851032-1-smb devstack@keystone.service[80489]: Jul 26 15:20:20.417389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e48165-42dd-40e8-9b7e-399c30c4e3a9 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:20.473119 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 777/1559] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:20 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:20.474736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46278179-e71b-4760-b554-13eff2e7509d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.475210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46278179-e71b-4760-b554-13eff2e7509d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.475699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46278179-e71b-4760-b554-13eff2e7509d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.503161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 783/1560] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:20 2022] PUT /identity/v3/projects/b4750008bca641b2b48b50588284103f/users/ea47a17e6e5f44c49a7ee7a98f889ac3/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:20.504149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e48165-42dd-40e8-9b7e-399c30c4e3a9 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:20.508826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-46278179-e71b-4760-b554-13eff2e7509d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:20.511793 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-46278179-e71b-4760-b554-13eff2e7509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:20.607388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:20.610626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:20.635393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 778/1561] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:20.635393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6a744-e656-48b1-8120-ee0f3700d87c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.635393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6a744-e656-48b1-8120-ee0f3700d87c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.635393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6a744-e656-48b1-8120-ee0f3700d87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.636184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e48165-42dd-40e8-9b7e-399c30c4e3a9 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:20.641925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35150e-a099-41c0-8504-2980319bd191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:20.642655 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35150e-a099-41c0-8504-2980319bd191 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.642969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35150e-a099-41c0-8504-2980319bd191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.643251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35150e-a099-41c0-8504-2980319bd191 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.643990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35150e-a099-41c0-8504-2980319bd191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:20:20.644336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35150e-a099-41c0-8504-2980319bd191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:20.646033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35150e-a099-41c0-8504-2980319bd191 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:20.662599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-44b6a744-e656-48b1-8120-ee0f3700d87c None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:20.662878 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 784/1562] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:20:20.664477 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35150e-a099-41c0-8504-2980319bd191 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:20.665020 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-44b6a744-e656-48b1-8120-ee0f3700d87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:20.677738 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 779/1563] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:20.679288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6a744-e656-48b1-8120-ee0f3700d87c None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:20.682826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35150e-a099-41c0-8504-2980319bd191 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:20.692435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e115e65-fcc1-41b9-b56a-462d65b1d404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:20.693525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115e65-fcc1-41b9-b56a-462d65b1d404 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.694025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115e65-fcc1-41b9-b56a-462d65b1d404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.694526 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115e65-fcc1-41b9-b56a-462d65b1d404 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.695742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e115e65-fcc1-41b9-b56a-462d65b1d404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:20.697686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: WARNING py.warnings [None req-3e115e65-fcc1-41b9-b56a-462d65b1d404 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:20:20.697686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: warnings.warn(msg) Jul 26 15:20:20.697686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: Jul 26 15:20:20.700932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6a744-e656-48b1-8120-ee0f3700d87c None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:20.701226 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e115e65-fcc1-41b9-b56a-462d65b1d404 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:20.709092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28cdb-3c04-45ad-9346-f0079291fd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:20.710152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28cdb-3c04-45ad-9346-f0079291fd29 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.710684 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28cdb-3c04-45ad-9346-f0079291fd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.711141 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28cdb-3c04-45ad-9346-f0079291fd29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.712362 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e28cdb-3c04-45ad-9346-f0079291fd29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:20.717375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e28cdb-3c04-45ad-9346-f0079291fd29 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:20.875992 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 785/1564] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:20 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:20.877775 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a32b0-0f67-4af3-b4f3-9afad60c0cf0 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.878076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a32b0-0f67-4af3-b4f3-9afad60c0cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.878335 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a32b0-0f67-4af3-b4f3-9afad60c0cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:20.901414 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 780/1565] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:20 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:20.901920 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-521a32b0-0f67-4af3-b4f3-9afad60c0cf0 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:20.904173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-521a32b0-0f67-4af3-b4f3-9afad60c0cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:20.907282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28cdb-3c04-45ad-9346-f0079291fd29 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:20.979173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 786/1566] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:20.980712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0eed8-f412-4c39-bcc9-840b856804d8 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:20.981004 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0eed8-f412-4c39-bcc9-840b856804d8 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:20.981982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0eed8-f412-4c39-bcc9-840b856804d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.001532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28cdb-3c04-45ad-9346-f0079291fd29 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:21.007720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba1064-d883-4775-9bdc-f78c0a30f0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:21.008763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba1064-d883-4775-9bdc-f78c0a30f0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.009180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba1064-d883-4775-9bdc-f78c0a30f0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:21.009653 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba1064-d883-4775-9bdc-f78c0a30f0d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.011696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba1064-d883-4775-9bdc-f78c0a30f0d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:21.013791 dv-cinder-851032-1-smb devstack@keystone.service[80488]: WARNING py.warnings [None req-d0ba1064-d883-4775-9bdc-f78c0a30f0d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:20:21.013791 dv-cinder-851032-1-smb devstack@keystone.service[80488]: warnings.warn(msg) Jul 26 15:20:21.013791 dv-cinder-851032-1-smb devstack@keystone.service[80488]: Jul 26 15:20:21.015482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba1064-d883-4775-9bdc-f78c0a30f0d5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:21.017760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-7ca0eed8-f412-4c39-bcc9-840b856804d8 None None] MFA Rules not processed for user `ea47a17e6e5f44c49a7ee7a98f889ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:21.019093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7ca0eed8-f412-4c39-bcc9-840b856804d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:21.096086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 787/1567] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:21.098461 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3254ac-7458-4fd4-822a-6fdfc75c9eda None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.099050 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3254ac-7458-4fd4-822a-6fdfc75c9eda None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:21.099543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3254ac-7458-4fd4-822a-6fdfc75c9eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.135255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-3d3254ac-7458-4fd4-822a-6fdfc75c9eda None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:21.137708 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3d3254ac-7458-4fd4-822a-6fdfc75c9eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:21.148581 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 781/1568] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:20 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:21.149552 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba1064-d883-4775-9bdc-f78c0a30f0d5 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:21.154063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 788/1569] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:21.155782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129551ae-cf37-42dd-b20d-cd2bf5deb7b5 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.156065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129551ae-cf37-42dd-b20d-cd2bf5deb7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:21.156341 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129551ae-cf37-42dd-b20d-cd2bf5deb7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.165590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba1064-d883-4775-9bdc-f78c0a30f0d5 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:21.171755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbeb15-795b-4624-8f77-7c8ef490deb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:21.172451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbeb15-795b-4624-8f77-7c8ef490deb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.172708 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbeb15-795b-4624-8f77-7c8ef490deb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:21.172962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbeb15-795b-4624-8f77-7c8ef490deb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.173658 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbeb15-795b-4624-8f77-7c8ef490deb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:21.175777 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbeb15-795b-4624-8f77-7c8ef490deb2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:21.181119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-129551ae-cf37-42dd-b20d-cd2bf5deb7b5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:21.182527 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-129551ae-cf37-42dd-b20d-cd2bf5deb7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:21.200373 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 789/1570] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:21.202227 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129551ae-cf37-42dd-b20d-cd2bf5deb7b5 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:21.220622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129551ae-cf37-42dd-b20d-cd2bf5deb7b5 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:21.229359 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea4abd-82fb-4db1-ad1b-c98928e0bb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:21.231031 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea4abd-82fb-4db1-ad1b-c98928e0bb32 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.231541 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea4abd-82fb-4db1-ad1b-c98928e0bb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:21.232027 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea4abd-82fb-4db1-ad1b-c98928e0bb32 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.233237 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea4abd-82fb-4db1-ad1b-c98928e0bb32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:21.236965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea4abd-82fb-4db1-ad1b-c98928e0bb32 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:21.289403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 782/1571] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:21 2022] POST /identity/v3/projects => generated 391 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:21.290608 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbeb15-795b-4624-8f77-7c8ef490deb2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:21.370276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbeb15-795b-4624-8f77-7c8ef490deb2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:21.374552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 790/1572] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:21 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:21.376183 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea4abd-82fb-4db1-ad1b-c98928e0bb32 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:21.379608 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3b960-bcad-4c3e-956d-641a8ec2518a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:21.380256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3b960-bcad-4c3e-956d-641a8ec2518a admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.380539 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3b960-bcad-4c3e-956d-641a8ec2518a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:21.380874 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3b960-bcad-4c3e-956d-641a8ec2518a admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.381768 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3b960-bcad-4c3e-956d-641a8ec2518a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:21.384115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3b960-bcad-4c3e-956d-641a8ec2518a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:21.396352 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea4abd-82fb-4db1-ad1b-c98928e0bb32 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:21.405926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d825c-f9bf-4e06-bc7f-61fd6e6b8af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:21.408113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d825c-f9bf-4e06-bc7f-61fd6e6b8af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.408113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d825c-f9bf-4e06-bc7f-61fd6e6b8af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:21.408367 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d825c-f9bf-4e06-bc7f-61fd6e6b8af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.409552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d825c-f9bf-4e06-bc7f-61fd6e6b8af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:20:21.410196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d825c-f9bf-4e06-bc7f-61fd6e6b8af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:21.413528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d825c-f9bf-4e06-bc7f-61fd6e6b8af6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:21.430879 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:21.435458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 791/1573] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:20:21.442535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d825c-f9bf-4e06-bc7f-61fd6e6b8af6 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:21.508133 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d825c-f9bf-4e06-bc7f-61fd6e6b8af6 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:21.516625 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b39161-2631-4e94-8c5e-fce0cf0a3e8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:21.517378 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b39161-2631-4e94-8c5e-fce0cf0a3e8e service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.517663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b39161-2631-4e94-8c5e-fce0cf0a3e8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:21.517941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b39161-2631-4e94-8c5e-fce0cf0a3e8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.529427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 783/1574] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:21 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:21.530810 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3b960-bcad-4c3e-956d-641a8ec2518a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:21.552555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3b960-bcad-4c3e-956d-641a8ec2518a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:21.557922 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea2b80-79a3-42a1-b8f1-93f995ed92f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:21.559009 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea2b80-79a3-42a1-b8f1-93f995ed92f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.559009 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea2b80-79a3-42a1-b8f1-93f995ed92f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:21.559328 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea2b80-79a3-42a1-b8f1-93f995ed92f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.560043 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea2b80-79a3-42a1-b8f1-93f995ed92f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:20:21.560382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea2b80-79a3-42a1-b8f1-93f995ed92f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:21.562074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea2b80-79a3-42a1-b8f1-93f995ed92f5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:21.579504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 784/1575] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:20:21.581285 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea2b80-79a3-42a1-b8f1-93f995ed92f5 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:21.597571 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea2b80-79a3-42a1-b8f1-93f995ed92f5 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:21.603669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a389926-03d8-424b-9ef0-566b7e949551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:21.604538 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a389926-03d8-424b-9ef0-566b7e949551 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.605143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a389926-03d8-424b-9ef0-566b7e949551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:21.605593 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a389926-03d8-424b-9ef0-566b7e949551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.609516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a389926-03d8-424b-9ef0-566b7e949551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:21.609952 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a389926-03d8-424b-9ef0-566b7e949551 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:21.618384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b39161-2631-4e94-8c5e-fce0cf0a3e8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:21.619954 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b39161-2631-4e94-8c5e-fce0cf0a3e8e service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:21.631592 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 792/1576] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:21 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:21.632383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 785/1577] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:21.632805 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b39161-2631-4e94-8c5e-fce0cf0a3e8e service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:21.633897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a389926-03d8-424b-9ef0-566b7e949551 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:21.645658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b39161-2631-4e94-8c5e-fce0cf0a3e8e service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:21.646639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:21.653565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cf80a-abd9-4dc5-ac3e-b5f4ca0de526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:21.654173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cf80a-abd9-4dc5-ac3e-b5f4ca0de526 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.654623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cf80a-abd9-4dc5-ac3e-b5f4ca0de526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:21.654870 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cf80a-abd9-4dc5-ac3e-b5f4ca0de526 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.660199 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a389926-03d8-424b-9ef0-566b7e949551 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:21.660453 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cf80a-abd9-4dc5-ac3e-b5f4ca0de526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:20:21.660453 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cf80a-abd9-4dc5-ac3e-b5f4ca0de526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:21.660453 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cf80a-abd9-4dc5-ac3e-b5f4ca0de526 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:21.665798 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd0400-bdfe-40c7-b2e5-b598f70f0eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:21.666973 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd0400-bdfe-40c7-b2e5-b598f70f0eac admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.667469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd0400-bdfe-40c7-b2e5-b598f70f0eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:21.667961 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd0400-bdfe-40c7-b2e5-b598f70f0eac admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.670218 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd0400-bdfe-40c7-b2e5-b598f70f0eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:21.674074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd0400-bdfe-40c7-b2e5-b598f70f0eac admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:21.685609 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 793/1578] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:20:21.685609 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cf80a-abd9-4dc5-ac3e-b5f4ca0de526 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:21.698895 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cf80a-abd9-4dc5-ac3e-b5f4ca0de526 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:21.707805 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2445a5-a478-44fb-bfcb-83f293204bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:21.708950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2445a5-a478-44fb-bfcb-83f293204bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.709457 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2445a5-a478-44fb-bfcb-83f293204bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:21.709964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2445a5-a478-44fb-bfcb-83f293204bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.711332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2445a5-a478-44fb-bfcb-83f293204bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:21.714589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2445a5-a478-44fb-bfcb-83f293204bfd admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:21.736532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 794/1579] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:21.738159 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2445a5-a478-44fb-bfcb-83f293204bfd admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:21.757793 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2445a5-a478-44fb-bfcb-83f293204bfd admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:21.767300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f2a0a-f613-4812-963f-9034f07f860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:21.768396 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f2a0a-f613-4812-963f-9034f07f860a admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.768912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f2a0a-f613-4812-963f-9034f07f860a admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:21.769415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f2a0a-f613-4812-963f-9034f07f860a admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.770752 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f2a0a-f613-4812-963f-9034f07f860a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:21.774693 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f2a0a-f613-4812-963f-9034f07f860a admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:21.827033 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 786/1580] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:21 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:21.827033 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd0400-bdfe-40c7-b2e5-b598f70f0eac admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:21.845897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd0400-bdfe-40c7-b2e5-b598f70f0eac admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:21.854435 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d0a1b-7419-47e2-9f99-9a4a7baa7543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:21.856372 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d0a1b-7419-47e2-9f99-9a4a7baa7543 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.856891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d0a1b-7419-47e2-9f99-9a4a7baa7543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:21.857389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d0a1b-7419-47e2-9f99-9a4a7baa7543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:21.858764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d0a1b-7419-47e2-9f99-9a4a7baa7543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:21.862104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d0a1b-7419-47e2-9f99-9a4a7baa7543 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:21.884936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 787/1581] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:21.886305 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d0a1b-7419-47e2-9f99-9a4a7baa7543 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:21.907665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 795/1582] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:21 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:21.907665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f2a0a-f613-4812-963f-9034f07f860a admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:21.913157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d0a1b-7419-47e2-9f99-9a4a7baa7543 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:21.992819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f2a0a-f613-4812-963f-9034f07f860a admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:21.998695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70530636-1de9-4c40-b799-9756f48fb921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:21.999463 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70530636-1de9-4c40-b799-9756f48fb921 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:21.999842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70530636-1de9-4c40-b799-9756f48fb921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:22.000191 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70530636-1de9-4c40-b799-9756f48fb921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:22.000993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70530636-1de9-4c40-b799-9756f48fb921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:22.002773 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70530636-1de9-4c40-b799-9756f48fb921 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:22.015094 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 796/1583] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:22.015525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75620789-28f7-4c80-a5ac-825edf2f0967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:22.016278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70530636-1de9-4c40-b799-9756f48fb921 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:22.016856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620789-28f7-4c80-a5ac-825edf2f0967 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:22.017369 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620789-28f7-4c80-a5ac-825edf2f0967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:22.018815 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620789-28f7-4c80-a5ac-825edf2f0967 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:22.021598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75620789-28f7-4c80-a5ac-825edf2f0967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:22.023122 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75620789-28f7-4c80-a5ac-825edf2f0967 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:22.025328 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:22.035481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70530636-1de9-4c40-b799-9756f48fb921 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:22.043772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99d31f-f233-47a1-9bbe-406d8fe0cc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:22.043772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99d31f-f233-47a1-9bbe-406d8fe0cc4b admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:22.043772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99d31f-f233-47a1-9bbe-406d8fe0cc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:22.043772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99d31f-f233-47a1-9bbe-406d8fe0cc4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:22.044938 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99d31f-f233-47a1-9bbe-406d8fe0cc4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:22.047320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99d31f-f233-47a1-9bbe-406d8fe0cc4b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:22.212217 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 788/1584] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:21 2022] POST /identity/v3/projects => generated 365 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:22.213339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75620789-28f7-4c80-a5ac-825edf2f0967 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:22.216802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 797/1585] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:22 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:22.221303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99d31f-f233-47a1-9bbe-406d8fe0cc4b admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:22.323512 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75620789-28f7-4c80-a5ac-825edf2f0967 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:22.332422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab274a-d7b2-4a2a-93d2-fcf2014a9fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:22.333496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab274a-d7b2-4a2a-93d2-fcf2014a9fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:22.334003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab274a-d7b2-4a2a-93d2-fcf2014a9fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:22.334561 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab274a-d7b2-4a2a-93d2-fcf2014a9fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:22.336045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab274a-d7b2-4a2a-93d2-fcf2014a9fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:22.337128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99d31f-f233-47a1-9bbe-406d8fe0cc4b admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:22.339415 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab274a-d7b2-4a2a-93d2-fcf2014a9fa5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:22.345108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25229dd7-dde1-4f0e-b42c-d0a6884ec9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:22.346152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25229dd7-dde1-4f0e-b42c-d0a6884ec9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:22.346681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25229dd7-dde1-4f0e-b42c-d0a6884ec9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:22.347292 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25229dd7-dde1-4f0e-b42c-d0a6884ec9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:22.348583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25229dd7-dde1-4f0e-b42c-d0a6884ec9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:22.350911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25229dd7-dde1-4f0e-b42c-d0a6884ec9d6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:22.362285 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 789/1586] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:22.364182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab274a-d7b2-4a2a-93d2-fcf2014a9fa5 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:22.372352 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 798/1587] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:22.372352 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25229dd7-dde1-4f0e-b42c-d0a6884ec9d6 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:22.383764 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25229dd7-dde1-4f0e-b42c-d0a6884ec9d6 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:22.384470 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab274a-d7b2-4a2a-93d2-fcf2014a9fa5 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:22.390720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a339f-86ba-4c7d-a7eb-d4e9cfa534c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:22.391685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a339f-86ba-4c7d-a7eb-d4e9cfa534c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:22.392116 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a339f-86ba-4c7d-a7eb-d4e9cfa534c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:22.392541 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a339f-86ba-4c7d-a7eb-d4e9cfa534c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:22.393629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a339f-86ba-4c7d-a7eb-d4e9cfa534c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:22.393839 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33870a-2564-4dce-bd3f-f7eed428382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:22.394805 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33870a-2564-4dce-bd3f-f7eed428382e admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:22.395319 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33870a-2564-4dce-bd3f-f7eed428382e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:22.395815 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33870a-2564-4dce-bd3f-f7eed428382e admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:22.396759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a339f-86ba-4c7d-a7eb-d4e9cfa534c2 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:22.397150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33870a-2564-4dce-bd3f-f7eed428382e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:22.400354 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33870a-2564-4dce-bd3f-f7eed428382e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:22.421395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 790/1588] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:22.422867 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33870a-2564-4dce-bd3f-f7eed428382e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:22.441878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33870a-2564-4dce-bd3f-f7eed428382e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:22.451289 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a0517-9a76-4857-8f1d-4a1d89090ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:22.452471 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a0517-9a76-4857-8f1d-4a1d89090ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:22.452970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a0517-9a76-4857-8f1d-4a1d89090ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:22.453467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a0517-9a76-4857-8f1d-4a1d89090ceb admin admin] PATH_INFO: `/v3/projects/84de6d3b4bd44651ae72165d8a22525d/users/196c524e1a964cffb7e5a3b425d2b020/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:22.487082 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a0517-9a76-4857-8f1d-4a1d89090ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=84de6d3b4bd44651ae72165d8a22525d, user_id=196c524e1a964cffb7e5a3b425d2b020, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:22.494092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a0517-9a76-4857-8f1d-4a1d89090ceb admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:22.533316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 799/1589] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:22 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:22.534453 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a339f-86ba-4c7d-a7eb-d4e9cfa534c2 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:22.545837 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a339f-86ba-4c7d-a7eb-d4e9cfa534c2 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:22.551009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6730a9c-efa8-4b03-a8a7-87b3e3e048ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:22.551651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6730a9c-efa8-4b03-a8a7-87b3e3e048ea admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:22.551934 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6730a9c-efa8-4b03-a8a7-87b3e3e048ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:22.552210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6730a9c-efa8-4b03-a8a7-87b3e3e048ea admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:22.552896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6730a9c-efa8-4b03-a8a7-87b3e3e048ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:22.555198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6730a9c-efa8-4b03-a8a7-87b3e3e048ea admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:22.619658 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 791/1590] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:22 2022] PUT /identity/v3/projects/84de6d3b4bd44651ae72165d8a22525d/users/196c524e1a964cffb7e5a3b425d2b020/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:22.620866 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a0517-9a76-4857-8f1d-4a1d89090ceb admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:22.656590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:22.683412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 800/1591] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:22 2022] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:22.685918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6730a9c-efa8-4b03-a8a7-87b3e3e048ea admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:22.701874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6730a9c-efa8-4b03-a8a7-87b3e3e048ea admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:22.713889 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a0517-9a76-4857-8f1d-4a1d89090ceb admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:22.719518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e9dbc-364a-44ce-8b1e-f1689dd25a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:22.720168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e9dbc-364a-44ce-8b1e-f1689dd25a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:22.720557 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e9dbc-364a-44ce-8b1e-f1689dd25a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:22.720838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e9dbc-364a-44ce-8b1e-f1689dd25a03 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:22.721534 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e9dbc-364a-44ce-8b1e-f1689dd25a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:22.723683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e9dbc-364a-44ce-8b1e-f1689dd25a03 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:22.804784 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a11471-8c62-42c6-8954-6f2fe861403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:22.805422 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a11471-8c62-42c6-8954-6f2fe861403a admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:22.805703 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a11471-8c62-42c6-8954-6f2fe861403a admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:22.805979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a11471-8c62-42c6-8954-6f2fe861403a admin admin] PATH_INFO: `/v3/projects/92fc5462238946f29c92ea50b243d4f6/users/1a89102e82bf400880ffb0b28b7e9aa3/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:22.823737 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a11471-8c62-42c6-8954-6f2fe861403a admin admin] RBAC: Authorizing `identity:create_grant(project_id=92fc5462238946f29c92ea50b243d4f6, user_id=1a89102e82bf400880ffb0b28b7e9aa3, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:22.826736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a11471-8c62-42c6-8954-6f2fe861403a admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:22.859792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 792/1592] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:22 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:22.861034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e9dbc-364a-44ce-8b1e-f1689dd25a03 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:22.872685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e9dbc-364a-44ce-8b1e-f1689dd25a03 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:22.877685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54755171-e901-4412-a04e-f2837ef32d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:22.878327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54755171-e901-4412-a04e-f2837ef32d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:22.878645 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54755171-e901-4412-a04e-f2837ef32d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:22.878926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54755171-e901-4412-a04e-f2837ef32d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:22.879663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54755171-e901-4412-a04e-f2837ef32d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:22.881336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54755171-e901-4412-a04e-f2837ef32d57 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:22.895985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 793/1593] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:22.896954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54755171-e901-4412-a04e-f2837ef32d57 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:22.919034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54755171-e901-4412-a04e-f2837ef32d57 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:22.924322 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd525937-6b54-445a-9f81-bc2826bd5f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:22.925647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd525937-6b54-445a-9f81-bc2826bd5f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:22.928276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd525937-6b54-445a-9f81-bc2826bd5f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:22.928276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd525937-6b54-445a-9f81-bc2826bd5f6d admin admin] PATH_INFO: `/v3/projects/5e4c2fa08af64077ae3abbe52a551157/users/95fa83a24bee4ea3880749b32d30319f/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:22.952340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd525937-6b54-445a-9f81-bc2826bd5f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4c2fa08af64077ae3abbe52a551157, user_id=95fa83a24bee4ea3880749b32d30319f, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:22.955390 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd525937-6b54-445a-9f81-bc2826bd5f6d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:22.974049 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 801/1594] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:22 2022] PUT /identity/v3/projects/92fc5462238946f29c92ea50b243d4f6/users/1a89102e82bf400880ffb0b28b7e9aa3/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:22.977453 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a11471-8c62-42c6-8954-6f2fe861403a admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:23.032067 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:23.078476 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a11471-8c62-42c6-8954-6f2fe861403a admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:23.089328 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 794/1595] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:22 2022] PUT /identity/v3/projects/5e4c2fa08af64077ae3abbe52a551157/users/95fa83a24bee4ea3880749b32d30319f/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:23.089328 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f02e-5a52-4892-9fd5-5e10ae35e96b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.089328 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f02e-5a52-4892-9fd5-5e10ae35e96b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.089328 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f02e-5a52-4892-9fd5-5e10ae35e96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.129256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3224f02e-5a52-4892-9fd5-5e10ae35e96b None None] MFA Rules not processed for user `196c524e1a964cffb7e5a3b425d2b020`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:23.130567 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3224f02e-5a52-4892-9fd5-5e10ae35e96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:23.176611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6bf77-36dc-4796-9f13-ceb693e4d28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:23.177804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6bf77-36dc-4796-9f13-ceb693e4d28b admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.178324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6bf77-36dc-4796-9f13-ceb693e4d28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.178853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6bf77-36dc-4796-9f13-ceb693e4d28b admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.180169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6bf77-36dc-4796-9f13-ceb693e4d28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:23.183279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6bf77-36dc-4796-9f13-ceb693e4d28b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:23.196647 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 802/1596] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:23.197634 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6bf77-36dc-4796-9f13-ceb693e4d28b admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:23.209445 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6bf77-36dc-4796-9f13-ceb693e4d28b admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:23.216087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ec7e3-20da-4110-bd04-2c63e0e5a69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:23.217000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ec7e3-20da-4110-bd04-2c63e0e5a69b admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.219749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ec7e3-20da-4110-bd04-2c63e0e5a69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.219749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ec7e3-20da-4110-bd04-2c63e0e5a69b admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.219749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ec7e3-20da-4110-bd04-2c63e0e5a69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:23.220965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ec7e3-20da-4110-bd04-2c63e0e5a69b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:23.234790 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 803/1597] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:23.236134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ec7e3-20da-4110-bd04-2c63e0e5a69b admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:23.242471 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 795/1598] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:23.244108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224f02e-5a52-4892-9fd5-5e10ae35e96b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:23.249748 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ec7e3-20da-4110-bd04-2c63e0e5a69b admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:23.258461 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266a288-136a-4a27-8677-29b1973f6357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:23.259276 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266a288-136a-4a27-8677-29b1973f6357 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.259736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266a288-136a-4a27-8677-29b1973f6357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.260290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266a288-136a-4a27-8677-29b1973f6357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.260494 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224f02e-5a52-4892-9fd5-5e10ae35e96b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:23.261312 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266a288-136a-4a27-8677-29b1973f6357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:23.264421 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266a288-136a-4a27-8677-29b1973f6357 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:23.268022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c98341-1fb2-4162-a11c-e925377b6509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:23.271267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98341-1fb2-4162-a11c-e925377b6509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.271267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98341-1fb2-4162-a11c-e925377b6509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.271267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98341-1fb2-4162-a11c-e925377b6509 admin admin] PATH_INFO: `/v3/projects/bba684def2874171a706fa80ad3b52f8/users/5182476e94ea4f0c8049001bebd351bc/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.287885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 804/1599] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:23.290706 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d258f6-3cfe-4de2-a3a9-6e85ac9ef89a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.291483 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d258f6-3cfe-4de2-a3a9-6e85ac9ef89a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.291969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d258f6-3cfe-4de2-a3a9-6e85ac9ef89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.298549 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c98341-1fb2-4162-a11c-e925377b6509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba684def2874171a706fa80ad3b52f8, user_id=5182476e94ea4f0c8049001bebd351bc, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:23.301968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c98341-1fb2-4162-a11c-e925377b6509 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:23.321190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b3d258f6-3cfe-4de2-a3a9-6e85ac9ef89a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:23.322481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b3d258f6-3cfe-4de2-a3a9-6e85ac9ef89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:23.332503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 805/1600] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:23.334071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfcb4b-754f-4667-af62-61f6e18d97c3 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.334410 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfcb4b-754f-4667-af62-61f6e18d97c3 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.334698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfcb4b-754f-4667-af62-61f6e18d97c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.358249 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-2dcfcb4b-754f-4667-af62-61f6e18d97c3 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:23.359577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2dcfcb4b-754f-4667-af62-61f6e18d97c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:23.367757 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 806/1601] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:23.369380 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfcb4b-754f-4667-af62-61f6e18d97c3 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:23.382546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfcb4b-754f-4667-af62-61f6e18d97c3 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:23.390492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c880711-16e9-44b3-84d6-b68c76a28983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:23.390492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c880711-16e9-44b3-84d6-b68c76a28983 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.390492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c880711-16e9-44b3-84d6-b68c76a28983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.390492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c880711-16e9-44b3-84d6-b68c76a28983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.391078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c880711-16e9-44b3-84d6-b68c76a28983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:23.392309 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c880711-16e9-44b3-84d6-b68c76a28983 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:23.404102 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 807/1602] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:23.405011 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c880711-16e9-44b3-84d6-b68c76a28983 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:23.415525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c880711-16e9-44b3-84d6-b68c76a28983 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:23.420888 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee0ab3-7608-4933-8729-5e4f797da08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:23.421534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee0ab3-7608-4933-8729-5e4f797da08a admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.421823 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee0ab3-7608-4933-8729-5e4f797da08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.422105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee0ab3-7608-4933-8729-5e4f797da08a admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.422855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee0ab3-7608-4933-8729-5e4f797da08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:23.424593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee0ab3-7608-4933-8729-5e4f797da08a admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:23.436799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 808/1603] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:23.438685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0790df-214e-4297-a50e-5bd4bd8f3ed2 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.439063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0790df-214e-4297-a50e-5bd4bd8f3ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.444950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0790df-214e-4297-a50e-5bd4bd8f3ed2 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.444950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 809/1604] 10.222.0.98 () {54 vars in 962 bytes} [Tue Jul 26 15:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:20:23.444950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0790df-214e-4297-a50e-5bd4bd8f3ed2 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:23.460016 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0790df-214e-4297-a50e-5bd4bd8f3ed2 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:23.465727 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e007ce-03b4-4da3-9ed2-a3d9cee4eb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:23.476598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e007ce-03b4-4da3-9ed2-a3d9cee4eb11 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.476598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e007ce-03b4-4da3-9ed2-a3d9cee4eb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.476598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e007ce-03b4-4da3-9ed2-a3d9cee4eb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.476598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e007ce-03b4-4da3-9ed2-a3d9cee4eb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:23.476598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e007ce-03b4-4da3-9ed2-a3d9cee4eb11 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:23.477331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 796/1605] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:23 2022] PUT /identity/v3/projects/bba684def2874171a706fa80ad3b52f8/users/5182476e94ea4f0c8049001bebd351bc/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:23.477331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c98341-1fb2-4162-a11c-e925377b6509 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:23.488686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 810/1606] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:23.488686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e007ce-03b4-4da3-9ed2-a3d9cee4eb11 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:23.541245 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:23.559422 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e007ce-03b4-4da3-9ed2-a3d9cee4eb11 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:23.560765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c98341-1fb2-4162-a11c-e925377b6509 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:23.563563 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c408e-541f-40db-9c64-d2c131a13318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:23.564216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c408e-541f-40db-9c64-d2c131a13318 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.564708 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c408e-541f-40db-9c64-d2c131a13318 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.564993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c408e-541f-40db-9c64-d2c131a13318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.566089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbb899-9a3b-4827-8f3d-c75ce86d007b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:23.566985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbb899-9a3b-4827-8f3d-c75ce86d007b service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.567470 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbb899-9a3b-4827-8f3d-c75ce86d007b service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.568825 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbb899-9a3b-4827-8f3d-c75ce86d007b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.582467 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:23.655722 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c408e-541f-40db-9c64-d2c131a13318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:23.657211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c408e-541f-40db-9c64-d2c131a13318 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:23.660692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbb899-9a3b-4827-8f3d-c75ce86d007b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:23.663935 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbb899-9a3b-4827-8f3d-c75ce86d007b service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:23.669200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 811/1607] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:23.670551 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c408e-541f-40db-9c64-d2c131a13318 service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:23.676466 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 797/1608] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:23.677669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbb899-9a3b-4827-8f3d-c75ce86d007b service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:23.681714 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c408e-541f-40db-9c64-d2c131a13318 service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:23.688387 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbb899-9a3b-4827-8f3d-c75ce86d007b service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:23.690057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d99fd6-7fb6-402b-b319-2e3c969e599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:23.691679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d99fd6-7fb6-402b-b319-2e3c969e599a admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.692067 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d99fd6-7fb6-402b-b319-2e3c969e599a admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.692416 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d99fd6-7fb6-402b-b319-2e3c969e599a admin admin] PATH_INFO: `/v3/projects/457a947c451149409b6d28cc349e1928/users/01f2143454964b14991ef51271375b10/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.694626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ce3cb-dd0e-44cd-bf8b-5e317a9af773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:23.695325 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ce3cb-dd0e-44cd-bf8b-5e317a9af773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.695626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ce3cb-dd0e-44cd-bf8b-5e317a9af773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.696072 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ce3cb-dd0e-44cd-bf8b-5e317a9af773 admin admin] PATH_INFO: `/v3/projects/28566e439360405b96f80be3bc924353/users/f5962a90408e4b17b8aa38c6b1036841/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.717743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ce3cb-dd0e-44cd-bf8b-5e317a9af773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28566e439360405b96f80be3bc924353, user_id=f5962a90408e4b17b8aa38c6b1036841, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:23.718000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d99fd6-7fb6-402b-b319-2e3c969e599a admin admin] RBAC: Authorizing `identity:create_grant(project_id=457a947c451149409b6d28cc349e1928, user_id=01f2143454964b14991ef51271375b10, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:23.721326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ce3cb-dd0e-44cd-bf8b-5e317a9af773 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:23.723701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d99fd6-7fb6-402b-b319-2e3c969e599a admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:23.813742 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 798/1609] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:23 2022] PUT /identity/v3/projects/28566e439360405b96f80be3bc924353/users/f5962a90408e4b17b8aa38c6b1036841/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:23.815005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4433a-a713-4492-94c0-57a384c5c467 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.815311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4433a-a713-4492-94c0-57a384c5c467 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.815591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4433a-a713-4492-94c0-57a384c5c467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.845059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 812/1610] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:23 2022] PUT /identity/v3/projects/457a947c451149409b6d28cc349e1928/users/01f2143454964b14991ef51271375b10/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:23.859482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ad4cd-3941-49c6-a5ac-33425a48b7d5 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:23.860739 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ad4cd-3941-49c6-a5ac-33425a48b7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:23.861339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ad4cd-3941-49c6-a5ac-33425a48b7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:23.865894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c0e4433a-a713-4492-94c0-57a384c5c467 None None] MFA Rules not processed for user `a4a6c0e7ca434010980d7cac1800dbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:23.867618 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c0e4433a-a713-4492-94c0-57a384c5c467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:23.889457 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-ea9ad4cd-3941-49c6-a5ac-33425a48b7d5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:23.891779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ea9ad4cd-3941-49c6-a5ac-33425a48b7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:24.036141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 813/1611] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:24.039955 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ad4cd-3941-49c6-a5ac-33425a48b7d5 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:24.042283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 799/1612] 10.222.0.98 () {58 vars in 1059 bytes} [Tue Jul 26 15:20:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:24.045852 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409d4f4-3011-4f23-941c-b3b1c3e43e8e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:24.047071 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409d4f4-3011-4f23-941c-b3b1c3e43e8e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:24.047706 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409d4f4-3011-4f23-941c-b3b1c3e43e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:24.052383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ad4cd-3941-49c6-a5ac-33425a48b7d5 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:24.061397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1cde1-405c-4663-9976-c65bb1722766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:24.062638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1cde1-405c-4663-9976-c65bb1722766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:24.062834 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1cde1-405c-4663-9976-c65bb1722766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:24.063035 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1cde1-405c-4663-9976-c65bb1722766 admin admin] PATH_INFO: `/v3/projects/09053ec68a2845408bb7d2aa7969bc78/users/8baaa3895c7445cdae12de3298155b58/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:24.127137 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1cde1-405c-4663-9976-c65bb1722766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09053ec68a2845408bb7d2aa7969bc78, user_id=8baaa3895c7445cdae12de3298155b58, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:24.130047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1cde1-405c-4663-9976-c65bb1722766 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:24.151021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2409d4f4-3011-4f23-941c-b3b1c3e43e8e None None] MFA Rules not processed for user `f5962a90408e4b17b8aa38c6b1036841`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:24.152384 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2409d4f4-3011-4f23-941c-b3b1c3e43e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:24.249564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 800/1613] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:24.249564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82487ba8-07c5-4617-947a-e45ee41398d8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:24.249564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82487ba8-07c5-4617-947a-e45ee41398d8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:24.249564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82487ba8-07c5-4617-947a-e45ee41398d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:24.280873 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-82487ba8-07c5-4617-947a-e45ee41398d8 None None] MFA Rules not processed for user `01f2143454964b14991ef51271375b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:24.282171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-82487ba8-07c5-4617-947a-e45ee41398d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:24.312585 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 814/1614] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:24 2022] PUT /identity/v3/projects/09053ec68a2845408bb7d2aa7969bc78/users/8baaa3895c7445cdae12de3298155b58/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:24.314156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1cde1-405c-4663-9976-c65bb1722766 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:24.316162 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-46e1cde1-405c-4663-9976-c65bb1722766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:24.753692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:24.753692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 801/1615] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:24.753692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82487ba8-07c5-4617-947a-e45ee41398d8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:24.756926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1cde1-405c-4663-9976-c65bb1722766 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:24.757615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82487ba8-07c5-4617-947a-e45ee41398d8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:24.763281 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f7346-2160-48fc-9cf3-709f1d5c3265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:24.763281 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f7346-2160-48fc-9cf3-709f1d5c3265 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:24.763281 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f7346-2160-48fc-9cf3-709f1d5c3265 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:24.763281 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f7346-2160-48fc-9cf3-709f1d5c3265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:24.765621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:24.765621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f7346-2160-48fc-9cf3-709f1d5c3265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:24.765621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f7346-2160-48fc-9cf3-709f1d5c3265 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:24.766707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79da4a-c9a1-4976-8600-7c12fc367140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:24.766707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79da4a-c9a1-4976-8600-7c12fc367140 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:24.766707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79da4a-c9a1-4976-8600-7c12fc367140 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:24.766707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79da4a-c9a1-4976-8600-7c12fc367140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:24.767688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 815/1616] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:24.767688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f7346-2160-48fc-9cf3-709f1d5c3265 service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:24.767688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f7346-2160-48fc-9cf3-709f1d5c3265 service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:24.767688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb13972-ed5d-4b94-8f4e-ecb6fed6624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:24.768473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb13972-ed5d-4b94-8f4e-ecb6fed6624f admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:24.768473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb13972-ed5d-4b94-8f4e-ecb6fed6624f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:24.768473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb13972-ed5d-4b94-8f4e-ecb6fed6624f admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:24.768473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb13972-ed5d-4b94-8f4e-ecb6fed6624f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:24.768473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb13972-ed5d-4b94-8f4e-ecb6fed6624f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:24.769443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79da4a-c9a1-4976-8600-7c12fc367140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:24.769443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79da4a-c9a1-4976-8600-7c12fc367140 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:24.769443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 802/1617] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:24.769443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329e1b9-3034-4ca4-9f3c-f582574c9a2a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:24.769443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329e1b9-3034-4ca4-9f3c-f582574c9a2a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:24.769443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329e1b9-3034-4ca4-9f3c-f582574c9a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:24.770685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f329e1b9-3034-4ca4-9f3c-f582574c9a2a None None] MFA Rules not processed for user `8baaa3895c7445cdae12de3298155b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:24.770685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f329e1b9-3034-4ca4-9f3c-f582574c9a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:24.876910 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 803/1618] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:24.878186 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329e1b9-3034-4ca4-9f3c-f582574c9a2a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:24.900770 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329e1b9-3034-4ca4-9f3c-f582574c9a2a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:24.909976 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfe4d9-ef14-488d-bba2-27abd2621510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:24.911130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfe4d9-ef14-488d-bba2-27abd2621510 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:24.911640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfe4d9-ef14-488d-bba2-27abd2621510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:24.912184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfe4d9-ef14-488d-bba2-27abd2621510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:24.913698 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfe4d9-ef14-488d-bba2-27abd2621510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:24.917667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfe4d9-ef14-488d-bba2-27abd2621510 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:24.952002 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:24.975178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 816/1619] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:24 2022] POST /identity/v3/projects => generated 365 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:24.975178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb13972-ed5d-4b94-8f4e-ecb6fed6624f admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:25.078716 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb13972-ed5d-4b94-8f4e-ecb6fed6624f admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:25.083892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b624527-5426-4769-95f7-6cf90fa409a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:25.084568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b624527-5426-4769-95f7-6cf90fa409a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:25.084849 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b624527-5426-4769-95f7-6cf90fa409a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:25.085122 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b624527-5426-4769-95f7-6cf90fa409a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:25.085811 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b624527-5426-4769-95f7-6cf90fa409a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:25.087868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b624527-5426-4769-95f7-6cf90fa409a5 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:25.119646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 804/1620] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:24 2022] POST /identity/v3/projects => generated 371 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:25.123194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be84bc-601e-46a2-8d66-70ff5a74c410 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:25.124772 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be84bc-601e-46a2-8d66-70ff5a74c410 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:25.125421 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be84bc-601e-46a2-8d66-70ff5a74c410 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:25.128378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 805/1621] 10.222.0.98 () {54 vars in 912 bytes} [Tue Jul 26 15:20:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:20:25.130121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be84bc-601e-46a2-8d66-70ff5a74c410 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:25.235791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 817/1622] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:24 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:25.237112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b624527-5426-4769-95f7-6cf90fa409a5 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:25.272002 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be84bc-601e-46a2-8d66-70ff5a74c410 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:25.369731 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b624527-5426-4769-95f7-6cf90fa409a5 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:25.378411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcee39e-c1a3-45fa-a841-926574b6400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:25.381029 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee39e-c1a3-45fa-a841-926574b6400f admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:25.381413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee39e-c1a3-45fa-a841-926574b6400f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:25.381527 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee39e-c1a3-45fa-a841-926574b6400f admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:25.382407 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcee39e-c1a3-45fa-a841-926574b6400f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:25.384739 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcee39e-c1a3-45fa-a841-926574b6400f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:25.438201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdeb7bb-5f9f-4032-a6a6-9ae928336e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:25.440282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeb7bb-5f9f-4032-a6a6-9ae928336e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:25.440776 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeb7bb-5f9f-4032-a6a6-9ae928336e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:25.441588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeb7bb-5f9f-4032-a6a6-9ae928336e51 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:25.443225 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdeb7bb-5f9f-4032-a6a6-9ae928336e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:25.448479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdeb7bb-5f9f-4032-a6a6-9ae928336e51 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:25.504254 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 818/1623] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:25 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:25.515899 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3c708-0af0-469c-bdba-b29e0313dbae None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:25.516300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3c708-0af0-469c-bdba-b29e0313dbae None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:25.516587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3c708-0af0-469c-bdba-b29e0313dbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:25.534869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:25.542468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a1b3c708-0af0-469c-bdba-b29e0313dbae None None] MFA Rules not processed for user `a4a6c0e7ca434010980d7cac1800dbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:25.552452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a1b3c708-0af0-469c-bdba-b29e0313dbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:25.633701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 806/1624] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:25 2022] POST /identity/v3/users => generated 289 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:25.635194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdeb7bb-5f9f-4032-a6a6-9ae928336e51 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:25.650421 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdeb7bb-5f9f-4032-a6a6-9ae928336e51 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:25.658196 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0babe-fba2-4763-af2f-e109ef8df792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:25.659156 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0babe-fba2-4763-af2f-e109ef8df792 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:25.659440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0babe-fba2-4763-af2f-e109ef8df792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:25.659714 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0babe-fba2-4763-af2f-e109ef8df792 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:25.660402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0babe-fba2-4763-af2f-e109ef8df792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:25.663158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0babe-fba2-4763-af2f-e109ef8df792 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:25.675587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:25.720571 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 819/1625] 10.222.0.98 () {58 vars in 1009 bytes} [Tue Jul 26 15:20:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:25.722147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3c708-0af0-469c-bdba-b29e0313dbae None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:25.740646 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3c708-0af0-469c-bdba-b29e0313dbae None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:25.749755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cb115-662d-4256-a45b-3e7312388ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:25.750802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cb115-662d-4256-a45b-3e7312388ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:25.751197 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cb115-662d-4256-a45b-3e7312388ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:25.751590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cb115-662d-4256-a45b-3e7312388ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:25.752708 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cb115-662d-4256-a45b-3e7312388ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:25.755294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cb115-662d-4256-a45b-3e7312388ec2 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:25.772556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 820/1626] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:25.774842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1a2e2-7f29-46fc-bd2d-5bdcf2ccd622 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:25.775292 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1a2e2-7f29-46fc-bd2d-5bdcf2ccd622 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:25.776276 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1a2e2-7f29-46fc-bd2d-5bdcf2ccd622 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:25.779546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 821/1627] 10.222.0.98 () {54 vars in 962 bytes} [Tue Jul 26 15:20:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:20:25.780918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1a2e2-7f29-46fc-bd2d-5bdcf2ccd622 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:25.805744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1a2e2-7f29-46fc-bd2d-5bdcf2ccd622 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:25.814011 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc2264-c0fe-4c02-b998-757f986ddea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:25.815158 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2264-c0fe-4c02-b998-757f986ddea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:25.815675 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2264-c0fe-4c02-b998-757f986ddea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:25.816159 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2264-c0fe-4c02-b998-757f986ddea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:25.817603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc2264-c0fe-4c02-b998-757f986ddea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:25.820916 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc2264-c0fe-4c02-b998-757f986ddea6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:25.844934 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 822/1628] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:25.847042 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc2264-c0fe-4c02-b998-757f986ddea6 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:25.856326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 807/1629] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:25 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:25.859453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0babe-fba2-4763-af2f-e109ef8df792 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:25.877659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0babe-fba2-4763-af2f-e109ef8df792 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:25.885579 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc8882-8310-4686-8999-4a8b956ef6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:25.887676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc8882-8310-4686-8999-4a8b956ef6d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:25.888585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc8882-8310-4686-8999-4a8b956ef6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:25.888943 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc8882-8310-4686-8999-4a8b956ef6d4 admin admin] PATH_INFO: `/v3/projects/9233038461624a8184183a75692d5f8a/users/6fd811e436be4793837a545f8171d4e9/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:25.925831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc8882-8310-4686-8999-4a8b956ef6d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9233038461624a8184183a75692d5f8a, user_id=6fd811e436be4793837a545f8171d4e9, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:25.928771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc8882-8310-4686-8999-4a8b956ef6d4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:25.973076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc2264-c0fe-4c02-b998-757f986ddea6 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:25.983745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ca172-9da5-453d-910c-d97cf626bf80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:25.984884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca172-9da5-453d-910c-d97cf626bf80 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:25.984884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca172-9da5-453d-910c-d97cf626bf80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:25.985105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca172-9da5-453d-910c-d97cf626bf80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:25.999469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ca172-9da5-453d-910c-d97cf626bf80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:26.002533 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ca172-9da5-453d-910c-d97cf626bf80 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:26.026782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 823/1630] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:26.029523 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d14b5-6342-4186-a0b3-5a49cf93c531 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:26.030089 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d14b5-6342-4186-a0b3-5a49cf93c531 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:26.030939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d14b5-6342-4186-a0b3-5a49cf93c531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:26.062322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-7b7d14b5-6342-4186-a0b3-5a49cf93c531 None None] MFA Rules not processed for user `a4a6c0e7ca434010980d7cac1800dbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:26.063659 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7b7d14b5-6342-4186-a0b3-5a49cf93c531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:26.084938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 808/1631] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:25 2022] PUT /identity/v3/projects/9233038461624a8184183a75692d5f8a/users/6fd811e436be4793837a545f8171d4e9/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:26.085978 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc8882-8310-4686-8999-4a8b956ef6d4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:26.227608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 824/1632] 10.222.0.98 () {58 vars in 1059 bytes} [Tue Jul 26 15:20:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:26.229169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d14b5-6342-4186-a0b3-5a49cf93c531 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:26.230504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc8882-8310-4686-8999-4a8b956ef6d4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:26.239210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddf631-3e3e-4b5e-b3ba-c38db106c11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:26.240245 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddf631-3e3e-4b5e-b3ba-c38db106c11e admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:26.240806 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddf631-3e3e-4b5e-b3ba-c38db106c11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:26.241382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddf631-3e3e-4b5e-b3ba-c38db106c11e admin admin] PATH_INFO: `/v3/projects/f9dcac8547b14b2493ec5a839b255bcc/users/6085e08071ee45fba805ecb03bbf697c/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:26.249229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d14b5-6342-4186-a0b3-5a49cf93c531 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:26.259077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc4188-0cc9-4576-a492-613ce73de638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:26.260074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc4188-0cc9-4576-a492-613ce73de638 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:26.260542 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc4188-0cc9-4576-a492-613ce73de638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:26.260995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc4188-0cc9-4576-a492-613ce73de638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:26.263365 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc4188-0cc9-4576-a492-613ce73de638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:26.266240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc4188-0cc9-4576-a492-613ce73de638 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:26.283903 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddf631-3e3e-4b5e-b3ba-c38db106c11e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9dcac8547b14b2493ec5a839b255bcc, user_id=6085e08071ee45fba805ecb03bbf697c, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:26.283903 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddf631-3e3e-4b5e-b3ba-c38db106c11e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:26.289715 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 825/1633] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:26.289715 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc4188-0cc9-4576-a492-613ce73de638 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:26.304577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc4188-0cc9-4576-a492-613ce73de638 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:26.315522 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e8894-200d-4109-8ff2-03e46c7416db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:26.316319 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e8894-200d-4109-8ff2-03e46c7416db admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:26.316762 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e8894-200d-4109-8ff2-03e46c7416db admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:26.317187 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e8894-200d-4109-8ff2-03e46c7416db admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:26.318020 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e8894-200d-4109-8ff2-03e46c7416db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:26.320852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e8894-200d-4109-8ff2-03e46c7416db admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:26.346195 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 826/1634] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:26.351497 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38d484-01a2-49f4-8046-9842febe0f52 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:26.351497 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38d484-01a2-49f4-8046-9842febe0f52 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:26.351497 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38d484-01a2-49f4-8046-9842febe0f52 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:26.360346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 827/1635] 10.222.0.98 () {54 vars in 912 bytes} [Tue Jul 26 15:20:26 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:20:26.362918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38d484-01a2-49f4-8046-9842febe0f52 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:26.387587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38d484-01a2-49f4-8046-9842febe0f52 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:26.395853 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 809/1636] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:26 2022] PUT /identity/v3/projects/f9dcac8547b14b2493ec5a839b255bcc/users/6085e08071ee45fba805ecb03bbf697c/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:26.399671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddf631-3e3e-4b5e-b3ba-c38db106c11e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:26.516123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:26.551074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddf631-3e3e-4b5e-b3ba-c38db106c11e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:26.552885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300e970-e929-4e8c-b8b7-cb05c5693dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:26.554205 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300e970-e929-4e8c-b8b7-cb05c5693dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:26.554760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300e970-e929-4e8c-b8b7-cb05c5693dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:26.555249 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300e970-e929-4e8c-b8b7-cb05c5693dcc admin admin] PATH_INFO: `/v3/projects/4973c7bf777a49ec9308293719aa2138/users/b9d439345e02404d96783a7b768d1c3c/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:26.583659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c803222-fae2-462c-b452-72e8bfcfe65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:26.584834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c803222-fae2-462c-b452-72e8bfcfe65d admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:26.585837 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c803222-fae2-462c-b452-72e8bfcfe65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:26.585837 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c803222-fae2-462c-b452-72e8bfcfe65d admin admin] PATH_INFO: `/v3/projects/9233038461624a8184183a75692d5f8a/users/6fd811e436be4793837a545f8171d4e9/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:26.593671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c803222-fae2-462c-b452-72e8bfcfe65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9233038461624a8184183a75692d5f8a, user_id=6fd811e436be4793837a545f8171d4e9, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:26.596369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300e970-e929-4e8c-b8b7-cb05c5693dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4973c7bf777a49ec9308293719aa2138, user_id=b9d439345e02404d96783a7b768d1c3c, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:26.602793 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300e970-e929-4e8c-b8b7-cb05c5693dcc admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:26.604154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c803222-fae2-462c-b452-72e8bfcfe65d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:26.631379 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 810/1637] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:26 2022] PUT /identity/v3/projects/9233038461624a8184183a75692d5f8a/users/6fd811e436be4793837a545f8171d4e9/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:26.637884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a56324-3882-4691-b79d-32ed10ec621d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:26.639904 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a56324-3882-4691-b79d-32ed10ec621d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:26.639904 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a56324-3882-4691-b79d-32ed10ec621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:26.681800 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d5a56324-3882-4691-b79d-32ed10ec621d None None] MFA Rules not processed for user `a4a6c0e7ca434010980d7cac1800dbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:26.684180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d5a56324-3882-4691-b79d-32ed10ec621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:26.749171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 828/1638] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:26 2022] PUT /identity/v3/projects/4973c7bf777a49ec9308293719aa2138/users/b9d439345e02404d96783a7b768d1c3c/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:26.751843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300e970-e929-4e8c-b8b7-cb05c5693dcc admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:26.868884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:26.967265 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 811/1639] 10.222.0.98 () {58 vars in 1009 bytes} [Tue Jul 26 15:20:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:26.972467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a37f8-57d4-45a1-afc6-4dd4af47ea50 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:26.972467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a37f8-57d4-45a1-afc6-4dd4af47ea50 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:26.972467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a37f8-57d4-45a1-afc6-4dd4af47ea50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:27.044520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300e970-e929-4e8c-b8b7-cb05c5693dcc admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:27.056219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4090a3-28f7-4676-b44b-1e061c8e3119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:27.057274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4090a3-28f7-4676-b44b-1e061c8e3119 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:27.057791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4090a3-28f7-4676-b44b-1e061c8e3119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:27.059774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4090a3-28f7-4676-b44b-1e061c8e3119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:27.060333 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4090a3-28f7-4676-b44b-1e061c8e3119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:27.063618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4090a3-28f7-4676-b44b-1e061c8e3119 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:27.071145 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ca8a37f8-57d4-45a1-afc6-4dd4af47ea50 None None] MFA Rules not processed for user `6fd811e436be4793837a545f8171d4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:27.074400 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ca8a37f8-57d4-45a1-afc6-4dd4af47ea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:27.094747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 829/1640] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:27.096696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4090a3-28f7-4676-b44b-1e061c8e3119 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:27.125992 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4090a3-28f7-4676-b44b-1e061c8e3119 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:27.136402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10dd11-db24-4d17-ab50-2b0fc0150b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:27.137608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10dd11-db24-4d17-ab50-2b0fc0150b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:27.138113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10dd11-db24-4d17-ab50-2b0fc0150b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:27.139780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10dd11-db24-4d17-ab50-2b0fc0150b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:27.141303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10dd11-db24-4d17-ab50-2b0fc0150b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:27.146110 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10dd11-db24-4d17-ab50-2b0fc0150b38 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:27.177625 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 830/1641] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:27.177625 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10dd11-db24-4d17-ab50-2b0fc0150b38 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:27.267050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 812/1642] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:27.267050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a37f8-57d4-45a1-afc6-4dd4af47ea50 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:27.311665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10dd11-db24-4d17-ab50-2b0fc0150b38 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:27.314338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a37f8-57d4-45a1-afc6-4dd4af47ea50 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:27.320376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbb911-35ba-42c3-8a9c-8be1baa6d798 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:27.322031 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbb911-35ba-42c3-8a9c-8be1baa6d798 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:27.325367 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbb911-35ba-42c3-8a9c-8be1baa6d798 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:27.326179 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbb911-35ba-42c3-8a9c-8be1baa6d798 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:27.338939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15c451-bb5d-442a-9c2a-a6204ab4941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:27.340814 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15c451-bb5d-442a-9c2a-a6204ab4941d admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:27.341363 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15c451-bb5d-442a-9c2a-a6204ab4941d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:27.341844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15c451-bb5d-442a-9c2a-a6204ab4941d admin admin] PATH_INFO: `/v3/projects/f9dcac8547b14b2493ec5a839b255bcc/users/6085e08071ee45fba805ecb03bbf697c/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:27.350410 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:27.352267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15c451-bb5d-442a-9c2a-a6204ab4941d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9dcac8547b14b2493ec5a839b255bcc, user_id=6085e08071ee45fba805ecb03bbf697c, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:27.372264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15c451-bb5d-442a-9c2a-a6204ab4941d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:27.394850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 813/1643] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:27 2022] PUT /identity/v3/projects/f9dcac8547b14b2493ec5a839b255bcc/users/6085e08071ee45fba805ecb03bbf697c/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:27.397705 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15c451-bb5d-442a-9c2a-a6204ab4941d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:27.592516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15c451-bb5d-442a-9c2a-a6204ab4941d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:27.600647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b4821-4bea-456d-bf66-e802edb1148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:27.601784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b4821-4bea-456d-bf66-e802edb1148b admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:27.602841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b4821-4bea-456d-bf66-e802edb1148b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:27.603343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b4821-4bea-456d-bf66-e802edb1148b admin admin] PATH_INFO: `/v3/projects/4973c7bf777a49ec9308293719aa2138/users/b9d439345e02404d96783a7b768d1c3c/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:27.606715 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b4821-4bea-456d-bf66-e802edb1148b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4973c7bf777a49ec9308293719aa2138, user_id=b9d439345e02404d96783a7b768d1c3c, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:27.611813 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b4821-4bea-456d-bf66-e802edb1148b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:27.612096 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbb911-35ba-42c3-8a9c-8be1baa6d798 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:27.614876 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbb911-35ba-42c3-8a9c-8be1baa6d798 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:27.633748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 814/1644] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:27 2022] PUT /identity/v3/projects/4973c7bf777a49ec9308293719aa2138/users/b9d439345e02404d96783a7b768d1c3c/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:27.639752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e942e-96e5-425c-a579-e1e3720d5dab None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:27.642702 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e942e-96e5-425c-a579-e1e3720d5dab None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:27.644418 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e942e-96e5-425c-a579-e1e3720d5dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:27.675932 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 831/1645] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:27.680951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbb911-35ba-42c3-8a9c-8be1baa6d798 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:27.727827 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbb911-35ba-42c3-8a9c-8be1baa6d798 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:27.776004 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5b4e942e-96e5-425c-a579-e1e3720d5dab None None] MFA Rules not processed for user `6085e08071ee45fba805ecb03bbf697c`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:27.778747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5b4e942e-96e5-425c-a579-e1e3720d5dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:27.896330 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e45ece-4551-47dc-b61c-4bff06fc8a69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:27.900563 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e45ece-4551-47dc-b61c-4bff06fc8a69 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:27.900998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e45ece-4551-47dc-b61c-4bff06fc8a69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:27.901389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e45ece-4551-47dc-b61c-4bff06fc8a69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:27.913186 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:28.040560 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 815/1646] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:28.047620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb1832-7045-441f-ad17-4e694ad377ba None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:28.047620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb1832-7045-441f-ad17-4e694ad377ba None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:28.048080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb1832-7045-441f-ad17-4e694ad377ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:28.120080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e45ece-4551-47dc-b61c-4bff06fc8a69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:28.123949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e45ece-4551-47dc-b61c-4bff06fc8a69 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:28.129322 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-85cb1832-7045-441f-ad17-4e694ad377ba None None] MFA Rules not processed for user `b9d439345e02404d96783a7b768d1c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:28.133266 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-85cb1832-7045-441f-ad17-4e694ad377ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:28.158743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 832/1647] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:27 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:28.278949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 816/1648] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:28.666386 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e45ece-4551-47dc-b61c-4bff06fc8a69 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:28.696195 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e45ece-4551-47dc-b61c-4bff06fc8a69 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:28.705858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad694d-91ed-4bfe-bb0a-cc9539466161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:28.706912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad694d-91ed-4bfe-bb0a-cc9539466161 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:28.707366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad694d-91ed-4bfe-bb0a-cc9539466161 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:28.707804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad694d-91ed-4bfe-bb0a-cc9539466161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:28.728719 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad694d-91ed-4bfe-bb0a-cc9539466161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:28.734294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad694d-91ed-4bfe-bb0a-cc9539466161 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:28.760227 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 833/1649] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:29.070604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb1832-7045-441f-ad17-4e694ad377ba None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:29.095322 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb1832-7045-441f-ad17-4e694ad377ba None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:29.107322 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b681f8-9ef2-469a-bc11-078b01b14126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:29.109213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b681f8-9ef2-469a-bc11-078b01b14126 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:29.109916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b681f8-9ef2-469a-bc11-078b01b14126 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:29.110477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b681f8-9ef2-469a-bc11-078b01b14126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:29.131023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b681f8-9ef2-469a-bc11-078b01b14126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:29.133899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b681f8-9ef2-469a-bc11-078b01b14126 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:29.160724 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 817/1650] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:20:29.216165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad694d-91ed-4bfe-bb0a-cc9539466161 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:29.279993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:29.318846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad694d-91ed-4bfe-bb0a-cc9539466161 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:29.325259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393ebc0-901e-4854-bc02-67b7a3ea1a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:29.326333 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393ebc0-901e-4854-bc02-67b7a3ea1a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:29.330688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393ebc0-901e-4854-bc02-67b7a3ea1a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:29.331546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393ebc0-901e-4854-bc02-67b7a3ea1a30 admin admin] PATH_INFO: `/v3/users/8baaa3895c7445cdae12de3298155b58` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:29.333266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393ebc0-901e-4854-bc02-67b7a3ea1a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8baaa3895c7445cdae12de3298155b58)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:29.338344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: WARNING py.warnings [None req-d393ebc0-901e-4854-bc02-67b7a3ea1a30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:20:29.338344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: warnings.warn(msg) Jul 26 15:20:29.338344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: Jul 26 15:20:29.338344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393ebc0-901e-4854-bc02-67b7a3ea1a30 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:29.506832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b681f8-9ef2-469a-bc11-078b01b14126 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:29.526764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b681f8-9ef2-469a-bc11-078b01b14126 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:29.532557 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648bdd3-00fc-4899-9f92-93411c25f7ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:29.533514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648bdd3-00fc-4899-9f92-93411c25f7ab service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:29.533989 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648bdd3-00fc-4899-9f92-93411c25f7ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:29.534280 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648bdd3-00fc-4899-9f92-93411c25f7ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:29.675961 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648bdd3-00fc-4899-9f92-93411c25f7ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:29.687487 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648bdd3-00fc-4899-9f92-93411c25f7ab service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:29.689370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d393ebc0-901e-4854-bc02-67b7a3ea1a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8baaa3895c7445cdae12de3298155b58'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:29.690915 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d393ebc0-901e-4854-bc02-67b7a3ea1a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8baaa3895c7445cdae12de3298155b58'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:29.748479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 818/1651] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:20:29.797958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d393ebc0-901e-4854-bc02-67b7a3ea1a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8baaa3895c7445cdae12de3298155b58'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:29.898721 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d393ebc0-901e-4854-bc02-67b7a3ea1a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8baaa3895c7445cdae12de3298155b58'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:29.900226 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d393ebc0-901e-4854-bc02-67b7a3ea1a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8baaa3895c7445cdae12de3298155b58'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:29.975191 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e883-a7e2-440d-b4b8-45b3909bb772 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:29.975536 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e883-a7e2-440d-b4b8-45b3909bb772 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:29.975822 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e883-a7e2-440d-b4b8-45b3909bb772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:29.979276 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 834/1652] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:20:29 2022] DELETE /identity/v3/users/8baaa3895c7445cdae12de3298155b58 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:30.030121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5088e883-a7e2-440d-b4b8-45b3909bb772 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:30.031905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5088e883-a7e2-440d-b4b8-45b3909bb772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:30.174536 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:30.325450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 819/1653] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:30.380345 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393ebc0-901e-4854-bc02-67b7a3ea1a30 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:30.382912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d393ebc0-901e-4854-bc02-67b7a3ea1a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:30.540867 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393ebc0-901e-4854-bc02-67b7a3ea1a30 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:30.564621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28e97e-25f9-4301-b38f-fac58b167a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:30.565998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28e97e-25f9-4301-b38f-fac58b167a1a service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:30.566673 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28e97e-25f9-4301-b38f-fac58b167a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:30.567166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28e97e-25f9-4301-b38f-fac58b167a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:30.605416 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28e97e-25f9-4301-b38f-fac58b167a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:30.608481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28e97e-25f9-4301-b38f-fac58b167a1a service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:30.643923 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 835/1654] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:33.975714 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088e883-a7e2-440d-b4b8-45b3909bb772 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:33.978792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5088e883-a7e2-440d-b4b8-45b3909bb772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:34.020828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088e883-a7e2-440d-b4b8-45b3909bb772 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:34.047651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:34.048787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:34.049107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:34.049384 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] PATH_INFO: `/v3/projects/09053ec68a2845408bb7d2aa7969bc78` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:34.050812 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=09053ec68a2845408bb7d2aa7969bc78)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:34.051876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: WARNING py.warnings [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:20:34.051876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: warnings.warn(msg) Jul 26 15:20:34.051876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: Jul 26 15:20:34.053391 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:34.375721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09053ec68a2845408bb7d2aa7969bc78', 'request_id': 'req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:34.406332 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09053ec68a2845408bb7d2aa7969bc78', 'request_id': 'req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:34.482175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09053ec68a2845408bb7d2aa7969bc78', 'request_id': 'req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:34.653727 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28e97e-25f9-4301-b38f-fac58b167a1a service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:34.656285 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8d28e97e-25f9-4301-b38f-fac58b167a1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:34.686404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] The token cache is being invalidate because project 09053ec68a2845408bb7d2aa7969bc78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:20:34.686872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:34.704596 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:34.711361 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 820/1655] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:20:33 2022] DELETE /identity/v3/projects/09053ec68a2845408bb7d2aa7969bc78 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:34.717267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:34.722560 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:34.745073 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28e97e-25f9-4301-b38f-fac58b167a1a service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:35.041505 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:35.087776 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38674e0c-6247-4fcf-bb74-10117d869111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:35.088909 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38674e0c-6247-4fcf-bb74-10117d869111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:35.090001 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38674e0c-6247-4fcf-bb74-10117d869111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:35.090431 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3709aa5-3b86-4bc7-babf-d1ce7c288f4c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:35.091168 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38674e0c-6247-4fcf-bb74-10117d869111 admin admin] PATH_INFO: `/v3/users/f5962a90408e4b17b8aa38c6b1036841` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:35.110704 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38674e0c-6247-4fcf-bb74-10117d869111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5962a90408e4b17b8aa38c6b1036841)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:35.115883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9201b07-5394-4484-af44-3b3697e8c055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:35.119035 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9201b07-5394-4484-af44-3b3697e8c055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:35.119035 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9201b07-5394-4484-af44-3b3697e8c055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:35.119035 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9201b07-5394-4484-af44-3b3697e8c055 admin admin] PATH_INFO: `/v3/users/b9d439345e02404d96783a7b768d1c3c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:35.121192 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9201b07-5394-4484-af44-3b3697e8c055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d439345e02404d96783a7b768d1c3c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:35.124853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38674e0c-6247-4fcf-bb74-10117d869111 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:35.133018 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9201b07-5394-4484-af44-3b3697e8c055 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:35.556884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d9201b07-5394-4484-af44-3b3697e8c055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d439345e02404d96783a7b768d1c3c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:35.560765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d9201b07-5394-4484-af44-3b3697e8c055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d439345e02404d96783a7b768d1c3c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:35.607567 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-38674e0c-6247-4fcf-bb74-10117d869111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5962a90408e4b17b8aa38c6b1036841'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:35.610867 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-38674e0c-6247-4fcf-bb74-10117d869111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5962a90408e4b17b8aa38c6b1036841'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:35.614476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:35.619175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d9201b07-5394-4484-af44-3b3697e8c055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d439345e02404d96783a7b768d1c3c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:35.620800 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d9201b07-5394-4484-af44-3b3697e8c055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d439345e02404d96783a7b768d1c3c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:35.699184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-38674e0c-6247-4fcf-bb74-10117d869111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5962a90408e4b17b8aa38c6b1036841'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:35.784196 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d9201b07-5394-4484-af44-3b3697e8c055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d439345e02404d96783a7b768d1c3c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:35.832411 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 821/1656] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:20:34 2022] DELETE /identity/v3/users/b9d439345e02404d96783a7b768d1c3c => generated 0 bytes in 1116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:35.841155 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-38674e0c-6247-4fcf-bb74-10117d869111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5962a90408e4b17b8aa38c6b1036841'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:35.842353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-38674e0c-6247-4fcf-bb74-10117d869111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5962a90408e4b17b8aa38c6b1036841'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:35.887370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 836/1657] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:20:34 2022] DELETE /identity/v3/users/f5962a90408e4b17b8aa38c6b1036841 => generated 0 bytes in 1235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:35.894093 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221afd8-ee53-4577-b796-c27f46f60b39 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:35.894282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221afd8-ee53-4577-b796-c27f46f60b39 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:35.894602 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221afd8-ee53-4577-b796-c27f46f60b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:35.941756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1221afd8-ee53-4577-b796-c27f46f60b39 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:35.949093 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1221afd8-ee53-4577-b796-c27f46f60b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:36.148453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 822/1658] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:36.267044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38674e0c-6247-4fcf-bb74-10117d869111 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:36.275150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-38674e0c-6247-4fcf-bb74-10117d869111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:36.554864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38674e0c-6247-4fcf-bb74-10117d869111 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:36.583729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb317cd-f6f6-4692-9720-5d2f3a94fe65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:36.584887 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb317cd-f6f6-4692-9720-5d2f3a94fe65 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:36.586946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb317cd-f6f6-4692-9720-5d2f3a94fe65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:36.590295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb317cd-f6f6-4692-9720-5d2f3a94fe65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:36.650394 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb317cd-f6f6-4692-9720-5d2f3a94fe65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:36.657187 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb317cd-f6f6-4692-9720-5d2f3a94fe65 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:36.703519 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 837/1659] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:37.187377 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221afd8-ee53-4577-b796-c27f46f60b39 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:37.190073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1221afd8-ee53-4577-b796-c27f46f60b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:37.241119 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221afd8-ee53-4577-b796-c27f46f60b39 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:37.269255 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcba57-f980-441f-923c-7c4e83b35be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:37.269255 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcba57-f980-441f-923c-7c4e83b35be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:37.286252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcba57-f980-441f-923c-7c4e83b35be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:37.286726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcba57-f980-441f-923c-7c4e83b35be6 admin admin] PATH_INFO: `/v3/users/196c524e1a964cffb7e5a3b425d2b020` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:37.301978 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcba57-f980-441f-923c-7c4e83b35be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=196c524e1a964cffb7e5a3b425d2b020)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:37.329852 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcba57-f980-441f-923c-7c4e83b35be6 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:37.803288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c6fcba57-f980-441f-923c-7c4e83b35be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196c524e1a964cffb7e5a3b425d2b020'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:37.806651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c6fcba57-f980-441f-923c-7c4e83b35be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196c524e1a964cffb7e5a3b425d2b020'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:37.895059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c6fcba57-f980-441f-923c-7c4e83b35be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196c524e1a964cffb7e5a3b425d2b020'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:37.903377 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c6fcba57-f980-441f-923c-7c4e83b35be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196c524e1a964cffb7e5a3b425d2b020'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:38.006939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c6fcba57-f980-441f-923c-7c4e83b35be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196c524e1a964cffb7e5a3b425d2b020'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:38.082308 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 823/1660] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:20:37 2022] DELETE /identity/v3/users/196c524e1a964cffb7e5a3b425d2b020 => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:38.090817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e9197-5f61-476d-848d-b28e4e77769d None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:38.092283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e9197-5f61-476d-848d-b28e4e77769d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:38.093135 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e9197-5f61-476d-848d-b28e4e77769d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:38.155321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-bc6e9197-5f61-476d-848d-b28e4e77769d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:38.161188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-bc6e9197-5f61-476d-848d-b28e4e77769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:38.404530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 838/1661] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:38.523995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcba57-f980-441f-923c-7c4e83b35be6 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:38.528759 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c6fcba57-f980-441f-923c-7c4e83b35be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:38.716637 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcba57-f980-441f-923c-7c4e83b35be6 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:38.736468 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c086e-9885-4116-a1fe-b74f9ccd73fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:38.738503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c086e-9885-4116-a1fe-b74f9ccd73fc service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:38.739523 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c086e-9885-4116-a1fe-b74f9ccd73fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:38.744854 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c086e-9885-4116-a1fe-b74f9ccd73fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:38.761739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:38.772959 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c086e-9885-4116-a1fe-b74f9ccd73fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:38.777824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c086e-9885-4116-a1fe-b74f9ccd73fc service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:38.805168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 824/1662] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:38.825816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e9197-5f61-476d-848d-b28e4e77769d None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:38.833126 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-bc6e9197-5f61-476d-848d-b28e4e77769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:38.896562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e9197-5f61-476d-848d-b28e4e77769d None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:38.914147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577d74f-7400-456f-adaf-25386dbeecf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:38.915210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577d74f-7400-456f-adaf-25386dbeecf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:38.915691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577d74f-7400-456f-adaf-25386dbeecf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:38.917908 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577d74f-7400-456f-adaf-25386dbeecf6 admin admin] PATH_INFO: `/v3/projects/4973c7bf777a49ec9308293719aa2138` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:38.923181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577d74f-7400-456f-adaf-25386dbeecf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4973c7bf777a49ec9308293719aa2138)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:38.925724 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577d74f-7400-456f-adaf-25386dbeecf6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:38.989462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:39.253207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b577d74f-7400-456f-adaf-25386dbeecf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4973c7bf777a49ec9308293719aa2138', 'request_id': 'req-b577d74f-7400-456f-adaf-25386dbeecf6'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:39.336928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b577d74f-7400-456f-adaf-25386dbeecf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4973c7bf777a49ec9308293719aa2138', 'request_id': 'req-b577d74f-7400-456f-adaf-25386dbeecf6'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:39.348036 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b577d74f-7400-456f-adaf-25386dbeecf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4973c7bf777a49ec9308293719aa2138', 'request_id': 'req-b577d74f-7400-456f-adaf-25386dbeecf6'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:39.391008 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b577d74f-7400-456f-adaf-25386dbeecf6 admin admin] The token cache is being invalidate because project 4973c7bf777a49ec9308293719aa2138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:20:39.394896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b577d74f-7400-456f-adaf-25386dbeecf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:39.396482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b577d74f-7400-456f-adaf-25386dbeecf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:39.408389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 839/1663] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:20:38 2022] DELETE /identity/v3/projects/4973c7bf777a49ec9308293719aa2138 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:39.410714 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec4492-7280-4808-bdb6-d6ea097dede6 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:39.411530 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec4492-7280-4808-bdb6-d6ea097dede6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:39.412050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec4492-7280-4808-bdb6-d6ea097dede6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:39.507628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-bbec4492-7280-4808-bdb6-d6ea097dede6 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:39.513147 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bbec4492-7280-4808-bdb6-d6ea097dede6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:39.737877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 825/1664] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:39.749726 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711a98b-faeb-4812-a096-48adf06abb9f None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:39.750007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711a98b-faeb-4812-a096-48adf06abb9f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:39.750919 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711a98b-faeb-4812-a096-48adf06abb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:39.812614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-3711a98b-faeb-4812-a096-48adf06abb9f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:39.814648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3711a98b-faeb-4812-a096-48adf06abb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:39.840037 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 840/1665] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:39.845160 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec4492-7280-4808-bdb6-d6ea097dede6 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:39.883496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec4492-7280-4808-bdb6-d6ea097dede6 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:39.902934 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b7446-30fe-4885-9d5e-4e2d6e848114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:39.902934 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b7446-30fe-4885-9d5e-4e2d6e848114 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:39.902934 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b7446-30fe-4885-9d5e-4e2d6e848114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:39.902934 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b7446-30fe-4885-9d5e-4e2d6e848114 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:39.911640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b7446-30fe-4885-9d5e-4e2d6e848114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:20:39.912271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b7446-30fe-4885-9d5e-4e2d6e848114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:39.919863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b7446-30fe-4885-9d5e-4e2d6e848114 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:39.925273 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711a98b-faeb-4812-a096-48adf06abb9f None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:39.927441 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3711a98b-faeb-4812-a096-48adf06abb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:39.985793 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711a98b-faeb-4812-a096-48adf06abb9f None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:40.012127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 826/1666] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:20:40.012127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b7446-30fe-4885-9d5e-4e2d6e848114 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:40.028225 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d51c5-4c89-4067-ac98-c30ce05eb493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:40.039148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d51c5-4c89-4067-ac98-c30ce05eb493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:40.040331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d51c5-4c89-4067-ac98-c30ce05eb493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:40.044738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d51c5-4c89-4067-ac98-c30ce05eb493 admin admin] PATH_INFO: `/v3/projects/28566e439360405b96f80be3bc924353` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:40.048310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d51c5-4c89-4067-ac98-c30ce05eb493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28566e439360405b96f80be3bc924353)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:40.062879 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d51c5-4c89-4067-ac98-c30ce05eb493 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:40.086564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b7446-30fe-4885-9d5e-4e2d6e848114 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:40.097783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd51ee-eb73-49e7-b4af-6ee9175d9d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:40.099392 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd51ee-eb73-49e7-b4af-6ee9175d9d29 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:40.099922 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd51ee-eb73-49e7-b4af-6ee9175d9d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:40.100428 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd51ee-eb73-49e7-b4af-6ee9175d9d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:40.103256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd51ee-eb73-49e7-b4af-6ee9175d9d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:40.116688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd51ee-eb73-49e7-b4af-6ee9175d9d29 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:40.320796 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-474d51c5-4c89-4067-ac98-c30ce05eb493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28566e439360405b96f80be3bc924353', 'request_id': 'req-474d51c5-4c89-4067-ac98-c30ce05eb493'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:40.390403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 827/1667] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:40 2022] POST /identity/v3/projects => generated 387 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:40.395202 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd51ee-eb73-49e7-b4af-6ee9175d9d29 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:40.428570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-474d51c5-4c89-4067-ac98-c30ce05eb493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28566e439360405b96f80be3bc924353', 'request_id': 'req-474d51c5-4c89-4067-ac98-c30ce05eb493'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:40.438442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-474d51c5-4c89-4067-ac98-c30ce05eb493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28566e439360405b96f80be3bc924353', 'request_id': 'req-474d51c5-4c89-4067-ac98-c30ce05eb493'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:40.482408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-474d51c5-4c89-4067-ac98-c30ce05eb493 admin admin] The token cache is being invalidate because project 28566e439360405b96f80be3bc924353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:20:40.482811 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-474d51c5-4c89-4067-ac98-c30ce05eb493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:40.485258 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-474d51c5-4c89-4067-ac98-c30ce05eb493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:40.492565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 841/1668] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:20:39 2022] DELETE /identity/v3/projects/28566e439360405b96f80be3bc924353 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:20:40.500714 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d51c5-4c89-4067-ac98-c30ce05eb493 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:40.502234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-474d51c5-4c89-4067-ac98-c30ce05eb493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:40.622654 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd51ee-eb73-49e7-b4af-6ee9175d9d29 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:40.640655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ae4fe-2439-49b5-8fdd-2dc094c61d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:40.641698 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae4fe-2439-49b5-8fdd-2dc094c61d86 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:40.642172 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae4fe-2439-49b5-8fdd-2dc094c61d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:40.647149 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae4fe-2439-49b5-8fdd-2dc094c61d86 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:40.650227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ae4fe-2439-49b5-8fdd-2dc094c61d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:40.660637 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ae4fe-2439-49b5-8fdd-2dc094c61d86 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:40.721225 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d51c5-4c89-4067-ac98-c30ce05eb493 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:40.734770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea7822-ecc4-4f70-b206-4d6207ac71f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:40.737536 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea7822-ecc4-4f70-b206-4d6207ac71f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:40.738401 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea7822-ecc4-4f70-b206-4d6207ac71f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:40.739425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea7822-ecc4-4f70-b206-4d6207ac71f7 admin admin] PATH_INFO: `/v3/users/6085e08071ee45fba805ecb03bbf697c` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:40.742314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea7822-ecc4-4f70-b206-4d6207ac71f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6085e08071ee45fba805ecb03bbf697c)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:40.749414 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea7822-ecc4-4f70-b206-4d6207ac71f7 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:40.789452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:40.833204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 828/1669] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:40 2022] POST /identity/v3/users => generated 294 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:40.834971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ae4fe-2439-49b5-8fdd-2dc094c61d86 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:40.841166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5b6ae4fe-2439-49b5-8fdd-2dc094c61d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:40.955195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ae4fe-2439-49b5-8fdd-2dc094c61d86 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:41.008577 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1874e0c-35c9-4993-8c59-f88568be4ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:41.009723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1874e0c-35c9-4993-8c59-f88568be4ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:41.010222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1874e0c-35c9-4993-8c59-f88568be4ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:41.016476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1874e0c-35c9-4993-8c59-f88568be4ac8 admin admin] PATH_INFO: `/v3/projects/84de6d3b4bd44651ae72165d8a22525d` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:41.031526 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1874e0c-35c9-4993-8c59-f88568be4ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84de6d3b4bd44651ae72165d8a22525d)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:41.035471 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1874e0c-35c9-4993-8c59-f88568be4ac8 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:41.103572 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-98ea7822-ecc4-4f70-b206-4d6207ac71f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6085e08071ee45fba805ecb03bbf697c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:41.103572 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-98ea7822-ecc4-4f70-b206-4d6207ac71f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6085e08071ee45fba805ecb03bbf697c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:41.133781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-98ea7822-ecc4-4f70-b206-4d6207ac71f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6085e08071ee45fba805ecb03bbf697c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:41.263592 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-98ea7822-ecc4-4f70-b206-4d6207ac71f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6085e08071ee45fba805ecb03bbf697c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:41.264311 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-98ea7822-ecc4-4f70-b206-4d6207ac71f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6085e08071ee45fba805ecb03bbf697c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:41.312240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 842/1670] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:20:40 2022] DELETE /identity/v3/users/6085e08071ee45fba805ecb03bbf697c => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:41.313637 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea7822-ecc4-4f70-b206-4d6207ac71f7 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:41.320604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-98ea7822-ecc4-4f70-b206-4d6207ac71f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:41.389492 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:41.407441 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d1874e0c-35c9-4993-8c59-f88568be4ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84de6d3b4bd44651ae72165d8a22525d', 'request_id': 'req-d1874e0c-35c9-4993-8c59-f88568be4ac8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:41.459607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d1874e0c-35c9-4993-8c59-f88568be4ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84de6d3b4bd44651ae72165d8a22525d', 'request_id': 'req-d1874e0c-35c9-4993-8c59-f88568be4ac8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:41.479215 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d1874e0c-35c9-4993-8c59-f88568be4ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84de6d3b4bd44651ae72165d8a22525d', 'request_id': 'req-d1874e0c-35c9-4993-8c59-f88568be4ac8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:41.612810 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d1874e0c-35c9-4993-8c59-f88568be4ac8 admin admin] The token cache is being invalidate because project 84de6d3b4bd44651ae72165d8a22525d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:20:41.613376 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d1874e0c-35c9-4993-8c59-f88568be4ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:41.615525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d1874e0c-35c9-4993-8c59-f88568be4ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:41.633426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 829/1671] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:20:40 2022] DELETE /identity/v3/projects/84de6d3b4bd44651ae72165d8a22525d => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:41.635082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea7822-ecc4-4f70-b206-4d6207ac71f7 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:41.640208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baa661-a6e7-474e-a132-a0d56085c997 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:41.641183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baa661-a6e7-474e-a132-a0d56085c997 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:41.641487 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baa661-a6e7-474e-a132-a0d56085c997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:41.732521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-10baa661-a6e7-474e-a132-a0d56085c997 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:41.740757 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-10baa661-a6e7-474e-a132-a0d56085c997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:41.902200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a7767-d71d-49de-a0d2-aa6d601cabca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:41.902200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a7767-d71d-49de-a0d2-aa6d601cabca admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:41.902200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a7767-d71d-49de-a0d2-aa6d601cabca admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:41.902200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a7767-d71d-49de-a0d2-aa6d601cabca admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:41.903774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a7767-d71d-49de-a0d2-aa6d601cabca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:41.912752 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a7767-d71d-49de-a0d2-aa6d601cabca admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:41.961604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 843/1672] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 648 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:41.968299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a7767-d71d-49de-a0d2-aa6d601cabca admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:41.973785 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ca5a7767-d71d-49de-a0d2-aa6d601cabca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:42.028684 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a7767-d71d-49de-a0d2-aa6d601cabca admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:42.041115 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45144e4f-13ca-4838-a40b-0fec10eff818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:42.041881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45144e4f-13ca-4838-a40b-0fec10eff818 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:42.042169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45144e4f-13ca-4838-a40b-0fec10eff818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:42.042465 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45144e4f-13ca-4838-a40b-0fec10eff818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:42.043229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45144e4f-13ca-4838-a40b-0fec10eff818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:42.060551 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45144e4f-13ca-4838-a40b-0fec10eff818 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:42.061132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 830/1673] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:42.062628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174eff63-ce67-4ac9-8a53-f42cd1fc8550 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:42.062908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174eff63-ce67-4ac9-8a53-f42cd1fc8550 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:42.063191 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174eff63-ce67-4ac9-8a53-f42cd1fc8550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:42.082662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 844/1674] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:42.090459 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45144e4f-13ca-4838-a40b-0fec10eff818 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:42.115949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-174eff63-ce67-4ac9-8a53-f42cd1fc8550 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:42.119180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-174eff63-ce67-4ac9-8a53-f42cd1fc8550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:42.121128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45144e4f-13ca-4838-a40b-0fec10eff818 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:42.131248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c8709-3e2d-4c2f-bf35-28206b8f23b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:42.131953 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c8709-3e2d-4c2f-bf35-28206b8f23b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:42.132237 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c8709-3e2d-4c2f-bf35-28206b8f23b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:42.132514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c8709-3e2d-4c2f-bf35-28206b8f23b3 admin admin] PATH_INFO: `/v3/projects/18702931ec5f4ca3a5f6b2efb4d5c296/users/6a6ff94fbb48456299748838b7c93626/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:42.144599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 831/1675] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:42.145879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174eff63-ce67-4ac9-8a53-f42cd1fc8550 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:42.164677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174eff63-ce67-4ac9-8a53-f42cd1fc8550 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:42.175869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c8709-3e2d-4c2f-bf35-28206b8f23b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18702931ec5f4ca3a5f6b2efb4d5c296, user_id=6a6ff94fbb48456299748838b7c93626, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:42.180969 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96981e-32b9-4a91-88cf-3ac20291aaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:42.181917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96981e-32b9-4a91-88cf-3ac20291aaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:42.183447 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c8709-3e2d-4c2f-bf35-28206b8f23b3 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:42.184464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96981e-32b9-4a91-88cf-3ac20291aaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:42.184859 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96981e-32b9-4a91-88cf-3ac20291aaf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:42.185678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96981e-32b9-4a91-88cf-3ac20291aaf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:20:42.185985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96981e-32b9-4a91-88cf-3ac20291aaf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:42.191958 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96981e-32b9-4a91-88cf-3ac20291aaf8 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:42.223895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 832/1676] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:20:42.238641 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96981e-32b9-4a91-88cf-3ac20291aaf8 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:42.287530 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96981e-32b9-4a91-88cf-3ac20291aaf8 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:42.318837 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 845/1677] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:42 2022] PUT /identity/v3/projects/18702931ec5f4ca3a5f6b2efb4d5c296/users/6a6ff94fbb48456299748838b7c93626/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:42.319464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3f53a-62dc-49bd-ae9d-80eefd406767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:42.320746 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08e2e6-03fb-40eb-8f8d-34500c5f79fb None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:42.320936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3f53a-62dc-49bd-ae9d-80eefd406767 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:42.321279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08e2e6-03fb-40eb-8f8d-34500c5f79fb None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:42.321666 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08e2e6-03fb-40eb-8f8d-34500c5f79fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:42.322272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3f53a-62dc-49bd-ae9d-80eefd406767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:42.323532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3f53a-62dc-49bd-ae9d-80eefd406767 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:42.324991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3f53a-62dc-49bd-ae9d-80eefd406767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:42.332786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3f53a-62dc-49bd-ae9d-80eefd406767 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:42.362205 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:42.444822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-1e08e2e6-03fb-40eb-8f8d-34500c5f79fb None None] MFA Rules not processed for user `1a89102e82bf400880ffb0b28b7e9aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:42.452474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-1e08e2e6-03fb-40eb-8f8d-34500c5f79fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:42.567020 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 833/1678] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:42 2022] POST /identity/v3/projects => generated 403 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:42.569762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7f9f8-aca4-40a9-8deb-85b92754fd28 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:42.570836 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7f9f8-aca4-40a9-8deb-85b92754fd28 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:42.571873 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7f9f8-aca4-40a9-8deb-85b92754fd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:42.722500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 846/1679] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:42.722500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08e2e6-03fb-40eb-8f8d-34500c5f79fb None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:42.761099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-42c7f9f8-aca4-40a9-8deb-85b92754fd28 None None] MFA Rules not processed for user `6a6ff94fbb48456299748838b7c93626`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:42.787896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-42c7f9f8-aca4-40a9-8deb-85b92754fd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:42.900562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08e2e6-03fb-40eb-8f8d-34500c5f79fb None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:43.107477 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1f8b7-2d53-4d02-b29f-18b16982351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:43.110124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1f8b7-2d53-4d02-b29f-18b16982351d admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:43.110484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 834/1680] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 542 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:43.111451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7f9f8-aca4-40a9-8deb-85b92754fd28 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:43.113794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-42c7f9f8-aca4-40a9-8deb-85b92754fd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:43.116016 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1f8b7-2d53-4d02-b29f-18b16982351d admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:43.118733 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1f8b7-2d53-4d02-b29f-18b16982351d admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:43.120744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1f8b7-2d53-4d02-b29f-18b16982351d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:43.126552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1f8b7-2d53-4d02-b29f-18b16982351d admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:43.166876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:43.274610 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 847/1681] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:42 2022] POST /identity/v3/users => generated 302 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:43.279217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1f8b7-2d53-4d02-b29f-18b16982351d admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:43.296915 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-def1f8b7-2d53-4d02-b29f-18b16982351d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:43.379086 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7f9f8-aca4-40a9-8deb-85b92754fd28 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:43.383022 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1f8b7-2d53-4d02-b29f-18b16982351d admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:43.399866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee8f18-ded3-48fe-b3f1-283fdb437078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:43.401120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee8f18-ded3-48fe-b3f1-283fdb437078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:43.401640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee8f18-ded3-48fe-b3f1-283fdb437078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:43.402170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee8f18-ded3-48fe-b3f1-283fdb437078 admin admin] PATH_INFO: `/v3/users/ea47a17e6e5f44c49a7ee7a98f889ac3` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:43.404497 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b8dbf-628e-4541-8754-67f28c144f48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:43.405608 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b8dbf-628e-4541-8754-67f28c144f48 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:43.406264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b8dbf-628e-4541-8754-67f28c144f48 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:43.406624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b8dbf-628e-4541-8754-67f28c144f48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:43.409406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee8f18-ded3-48fe-b3f1-283fdb437078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea47a17e6e5f44c49a7ee7a98f889ac3)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:43.425690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee8f18-ded3-48fe-b3f1-283fdb437078 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:43.806007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b8dbf-628e-4541-8754-67f28c144f48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:43.822476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b8dbf-628e-4541-8754-67f28c144f48 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:43.859848 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 835/1682] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 749 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:43.873778 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b8dbf-628e-4541-8754-67f28c144f48 service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:43.925006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b8dbf-628e-4541-8754-67f28c144f48 service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:43.943030 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a2b52-3938-4815-96c4-a85fadfe5cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:43.946225 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a2b52-3938-4815-96c4-a85fadfe5cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:43.947466 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a2b52-3938-4815-96c4-a85fadfe5cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:43.949628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a2b52-3938-4815-96c4-a85fadfe5cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:43.950543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a2b52-3938-4815-96c4-a85fadfe5cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:43.960910 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a2b52-3938-4815-96c4-a85fadfe5cf0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:44.014820 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d6ee8f18-ded3-48fe-b3f1-283fdb437078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea47a17e6e5f44c49a7ee7a98f889ac3'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:44.025358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d6ee8f18-ded3-48fe-b3f1-283fdb437078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea47a17e6e5f44c49a7ee7a98f889ac3'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:44.115519 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d6ee8f18-ded3-48fe-b3f1-283fdb437078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea47a17e6e5f44c49a7ee7a98f889ac3'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:44.235792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 836/1683] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:43 2022] POST /identity/v3/projects => generated 385 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:44.237442 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a2b52-3938-4815-96c4-a85fadfe5cf0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:44.245517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d6ee8f18-ded3-48fe-b3f1-283fdb437078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea47a17e6e5f44c49a7ee7a98f889ac3'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:44.246276 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d6ee8f18-ded3-48fe-b3f1-283fdb437078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea47a17e6e5f44c49a7ee7a98f889ac3'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:44.264078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-181a2b52-3938-4815-96c4-a85fadfe5cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:44.291095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 848/1684] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:20:43 2022] DELETE /identity/v3/users/ea47a17e6e5f44c49a7ee7a98f889ac3 => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:44.295468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee8f18-ded3-48fe-b3f1-283fdb437078 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:44.298904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d6ee8f18-ded3-48fe-b3f1-283fdb437078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:44.351410 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:44.560990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a2b52-3938-4815-96c4-a85fadfe5cf0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:44.585383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224b07b-f35a-4979-b65c-c2f0434e10e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:44.593223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224b07b-f35a-4979-b65c-c2f0434e10e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:44.596107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224b07b-f35a-4979-b65c-c2f0434e10e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:44.598100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224b07b-f35a-4979-b65c-c2f0434e10e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:44.602545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224b07b-f35a-4979-b65c-c2f0434e10e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:44.605878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224b07b-f35a-4979-b65c-c2f0434e10e1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:44.606319 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee8f18-ded3-48fe-b3f1-283fdb437078 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:44.628915 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed13aa-3566-4dbf-95f6-b3181011165f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:44.631090 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed13aa-3566-4dbf-95f6-b3181011165f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:44.631090 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed13aa-3566-4dbf-95f6-b3181011165f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:44.632240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed13aa-3566-4dbf-95f6-b3181011165f admin admin] PATH_INFO: `/v3/projects/f9dcac8547b14b2493ec5a839b255bcc` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:44.639295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed13aa-3566-4dbf-95f6-b3181011165f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9dcac8547b14b2493ec5a839b255bcc)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:44.643698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed13aa-3566-4dbf-95f6-b3181011165f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:44.685591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 837/1685] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:44.692305 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7c331-0ef2-49f8-9bd2-66dfe9060e0e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:44.692810 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7c331-0ef2-49f8-9bd2-66dfe9060e0e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:44.693329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7c331-0ef2-49f8-9bd2-66dfe9060e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:44.783045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-bdb7c331-0ef2-49f8-9bd2-66dfe9060e0e None None] MFA Rules not processed for user `5182476e94ea4f0c8049001bebd351bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:44.785641 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bdb7c331-0ef2-49f8-9bd2-66dfe9060e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:44.885697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ffed13aa-3566-4dbf-95f6-b3181011165f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9dcac8547b14b2493ec5a839b255bcc', 'request_id': 'req-ffed13aa-3566-4dbf-95f6-b3181011165f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:44.957711 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 838/1686] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:44.958635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7c331-0ef2-49f8-9bd2-66dfe9060e0e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:44.960118 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bdb7c331-0ef2-49f8-9bd2-66dfe9060e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:44.984797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7c331-0ef2-49f8-9bd2-66dfe9060e0e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:45.011664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ffed13aa-3566-4dbf-95f6-b3181011165f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9dcac8547b14b2493ec5a839b255bcc', 'request_id': 'req-ffed13aa-3566-4dbf-95f6-b3181011165f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:45.023560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ffed13aa-3566-4dbf-95f6-b3181011165f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9dcac8547b14b2493ec5a839b255bcc', 'request_id': 'req-ffed13aa-3566-4dbf-95f6-b3181011165f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:45.050012 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ffed13aa-3566-4dbf-95f6-b3181011165f admin admin] The token cache is being invalidate because project f9dcac8547b14b2493ec5a839b255bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:20:45.050748 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ffed13aa-3566-4dbf-95f6-b3181011165f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:45.051928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ffed13aa-3566-4dbf-95f6-b3181011165f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:45.054217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 849/1687] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:20:44 2022] DELETE /identity/v3/projects/f9dcac8547b14b2493ec5a839b255bcc => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:45.056579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ef69d-6de6-4bd7-93d7-7e5f4873d122 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:45.057271 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ef69d-6de6-4bd7-93d7-7e5f4873d122 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:45.057788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ef69d-6de6-4bd7-93d7-7e5f4873d122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:45.119020 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-e02ef69d-6de6-4bd7-93d7-7e5f4873d122 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:45.136388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e02ef69d-6de6-4bd7-93d7-7e5f4873d122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:45.139992 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c66ae-358c-4275-a5b2-6504489bebce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:45.142745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c66ae-358c-4275-a5b2-6504489bebce admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:45.142745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c66ae-358c-4275-a5b2-6504489bebce admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:45.142745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c66ae-358c-4275-a5b2-6504489bebce admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:45.144437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c66ae-358c-4275-a5b2-6504489bebce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:45.154440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c66ae-358c-4275-a5b2-6504489bebce admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:45.161758 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 850/1688] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:45.164190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ef69d-6de6-4bd7-93d7-7e5f4873d122 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:45.167253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e02ef69d-6de6-4bd7-93d7-7e5f4873d122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:45.209884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ef69d-6de6-4bd7-93d7-7e5f4873d122 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:45.219438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a3e9c-f6f4-4694-9df5-85220d5ef4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:45.234511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a3e9c-f6f4-4694-9df5-85220d5ef4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:45.234511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a3e9c-f6f4-4694-9df5-85220d5ef4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:45.234511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a3e9c-f6f4-4694-9df5-85220d5ef4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:45.234511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a3e9c-f6f4-4694-9df5-85220d5ef4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:45.234511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a3e9c-f6f4-4694-9df5-85220d5ef4c9 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:45.259195 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 851/1689] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:45.265005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8db5d9-6a22-4368-96c6-039803f4204e None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:45.265005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8db5d9-6a22-4368-96c6-039803f4204e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:45.265555 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8db5d9-6a22-4368-96c6-039803f4204e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:45.294174 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 839/1690] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:44 2022] POST /identity/v3/users => generated 293 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:45.306617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f4a01-3175-4067-9392-9474a42d2ce3 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:45.307146 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f4a01-3175-4067-9392-9474a42d2ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:45.328624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f4a01-3175-4067-9392-9474a42d2ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:45.352174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-9b8db5d9-6a22-4368-96c6-039803f4204e None None] MFA Rules not processed for user `95fa83a24bee4ea3880749b32d30319f`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:45.359844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-9b8db5d9-6a22-4368-96c6-039803f4204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:45.362790 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:45.401632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-369f4a01-3175-4067-9392-9474a42d2ce3 None None] MFA Rules not processed for user `5182476e94ea4f0c8049001bebd351bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:45.404114 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-369f4a01-3175-4067-9392-9474a42d2ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:45.562846 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 840/1691] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:45.565273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231b1de-9b14-47c8-9822-f14a880af560 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:45.565787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231b1de-9b14-47c8-9822-f14a880af560 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:45.566185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231b1de-9b14-47c8-9822-f14a880af560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:45.608865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5231b1de-9b14-47c8-9822-f14a880af560 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:45.610141 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5231b1de-9b14-47c8-9822-f14a880af560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:45.633470 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 841/1692] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:45.634793 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231b1de-9b14-47c8-9822-f14a880af560 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:45.636768 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5231b1de-9b14-47c8-9822-f14a880af560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:45.701400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 852/1693] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:45.738303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8db5d9-6a22-4368-96c6-039803f4204e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:45.743427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231b1de-9b14-47c8-9822-f14a880af560 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:45.749312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c062db-3d70-4c9e-aea4-f66ece2f5b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:45.749971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c062db-3d70-4c9e-aea4-f66ece2f5b7b service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:45.750244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c062db-3d70-4c9e-aea4-f66ece2f5b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:45.750732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c062db-3d70-4c9e-aea4-f66ece2f5b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:45.768062 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c062db-3d70-4c9e-aea4-f66ece2f5b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:45.770579 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c062db-3d70-4c9e-aea4-f66ece2f5b7b service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:45.780132 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8db5d9-6a22-4368-96c6-039803f4204e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:45.786294 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 842/1694] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:45.787776 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c062db-3d70-4c9e-aea4-f66ece2f5b7b service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:45.789437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b1c062db-3d70-4c9e-aea4-f66ece2f5b7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:45.798763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5874b-146a-45c8-9ae6-a8bab79c6366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:45.799995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5874b-146a-45c8-9ae6-a8bab79c6366 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:45.800435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5874b-146a-45c8-9ae6-a8bab79c6366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:45.800929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5874b-146a-45c8-9ae6-a8bab79c6366 admin admin] PATH_INFO: `/v3/projects/35088fe10eb844229324f512b685c6bc/users/8c2443bed4524175ada322cff385a15a/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:45.815222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c062db-3d70-4c9e-aea4-f66ece2f5b7b service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:45.831017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a840c6-e854-4e03-8417-7091f2aed2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:45.832098 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a840c6-e854-4e03-8417-7091f2aed2da admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:45.834123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a840c6-e854-4e03-8417-7091f2aed2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:45.835232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a840c6-e854-4e03-8417-7091f2aed2da admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:45.836970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a840c6-e854-4e03-8417-7091f2aed2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:45.844255 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a840c6-e854-4e03-8417-7091f2aed2da admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:45.853598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5874b-146a-45c8-9ae6-a8bab79c6366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35088fe10eb844229324f512b685c6bc, user_id=8c2443bed4524175ada322cff385a15a, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:45.858160 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5874b-146a-45c8-9ae6-a8bab79c6366 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:45.870008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 843/1695] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:45.872057 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a840c6-e854-4e03-8417-7091f2aed2da admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:45.876206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-42a840c6-e854-4e03-8417-7091f2aed2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:46.030650 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 853/1696] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:45 2022] PUT /identity/v3/projects/35088fe10eb844229324f512b685c6bc/users/8c2443bed4524175ada322cff385a15a/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:46.030650 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0129350-b2e5-4ecc-857f-ce6602726170 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:46.030650 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0129350-b2e5-4ecc-857f-ce6602726170 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:46.030650 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0129350-b2e5-4ecc-857f-ce6602726170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:46.053439 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:46.114957 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d0129350-b2e5-4ecc-857f-ce6602726170 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:46.117948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d0129350-b2e5-4ecc-857f-ce6602726170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:46.128874 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a840c6-e854-4e03-8417-7091f2aed2da admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:46.231986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:46.276635 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 854/1697] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:46.278840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327efcfb-16b1-423b-b6bf-c9512becdb54 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:46.279367 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327efcfb-16b1-423b-b6bf-c9512becdb54 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:46.279804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327efcfb-16b1-423b-b6bf-c9512becdb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:46.315214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-327efcfb-16b1-423b-b6bf-c9512becdb54 None None] MFA Rules not processed for user `95fa83a24bee4ea3880749b32d30319f`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:46.317560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-327efcfb-16b1-423b-b6bf-c9512becdb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:46.349327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784d498-42b5-4c45-9b3f-a6b04b6945a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:46.349943 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784d498-42b5-4c45-9b3f-a6b04b6945a4 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:46.350219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784d498-42b5-4c45-9b3f-a6b04b6945a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:46.350595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784d498-42b5-4c45-9b3f-a6b04b6945a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:46.356588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e784d498-42b5-4c45-9b3f-a6b04b6945a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:46.491008 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 855/1698] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:46.491008 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327efcfb-16b1-423b-b6bf-c9512becdb54 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:46.516366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327efcfb-16b1-423b-b6bf-c9512becdb54 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:46.536935 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784d498-42b5-4c45-9b3f-a6b04b6945a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:46.540312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784d498-42b5-4c45-9b3f-a6b04b6945a4 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:46.548703 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5e225-e219-4912-b798-c9cef6f65961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:46.550257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5e225-e219-4912-b798-c9cef6f65961 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:46.550993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5e225-e219-4912-b798-c9cef6f65961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:46.551677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5e225-e219-4912-b798-c9cef6f65961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:46.555817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5e225-e219-4912-b798-c9cef6f65961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:46.559718 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5e225-e219-4912-b798-c9cef6f65961 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:46.584167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 844/1699] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:46.589158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f014f9-8d94-4032-8657-71c8b1529ed1 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:46.589463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f014f9-8d94-4032-8657-71c8b1529ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:46.589749 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f014f9-8d94-4032-8657-71c8b1529ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:46.612310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 856/1700] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:46.616773 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5e225-e219-4912-b798-c9cef6f65961 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:46.642484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-50f014f9-8d94-4032-8657-71c8b1529ed1 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:46.647711 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-50f014f9-8d94-4032-8657-71c8b1529ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:46.672956 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 845/1701] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:46.674375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f014f9-8d94-4032-8657-71c8b1529ed1 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:46.678663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-50f014f9-8d94-4032-8657-71c8b1529ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:46.683948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5e225-e219-4912-b798-c9cef6f65961 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:46.709155 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561aac9-09d6-40f7-8e73-dc46b592f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:46.713748 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561aac9-09d6-40f7-8e73-dc46b592f93b admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:46.714245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561aac9-09d6-40f7-8e73-dc46b592f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:46.714783 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561aac9-09d6-40f7-8e73-dc46b592f93b admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:46.716479 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561aac9-09d6-40f7-8e73-dc46b592f93b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:20:46.717108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561aac9-09d6-40f7-8e73-dc46b592f93b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:46.720385 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561aac9-09d6-40f7-8e73-dc46b592f93b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:46.724630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f014f9-8d94-4032-8657-71c8b1529ed1 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:46.744810 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f39b8-0b0e-4bc0-8351-95fc19f37c7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:46.746045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f39b8-0b0e-4bc0-8351-95fc19f37c7e service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:46.746558 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f39b8-0b0e-4bc0-8351-95fc19f37c7e service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:46.747026 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f39b8-0b0e-4bc0-8351-95fc19f37c7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:46.769953 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f39b8-0b0e-4bc0-8351-95fc19f37c7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:46.771862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f39b8-0b0e-4bc0-8351-95fc19f37c7e service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:46.802502 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 857/1702] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:20:46.802502 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561aac9-09d6-40f7-8e73-dc46b592f93b admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:46.806407 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 846/1703] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:46.806696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f39b8-0b0e-4bc0-8351-95fc19f37c7e service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:46.814646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-171f39b8-0b0e-4bc0-8351-95fc19f37c7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:46.834742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561aac9-09d6-40f7-8e73-dc46b592f93b admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:46.859723 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7fee5-51ba-4891-8e8d-68f62eed2a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:46.861152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7fee5-51ba-4891-8e8d-68f62eed2a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:46.861438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7fee5-51ba-4891-8e8d-68f62eed2a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:46.863746 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7fee5-51ba-4891-8e8d-68f62eed2a86 admin admin] PATH_INFO: `/v3/projects/4b73e331787646f0b1e5324ec3bf473b/users/69adf25dc4a046dd936023f6b22f3c87/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:46.933508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7fee5-51ba-4891-8e8d-68f62eed2a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b73e331787646f0b1e5324ec3bf473b, user_id=69adf25dc4a046dd936023f6b22f3c87, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:46.943165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7fee5-51ba-4891-8e8d-68f62eed2a86 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:47.019947 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:47.025125 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f39b8-0b0e-4bc0-8351-95fc19f37c7e service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:47.037115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955b9d4-51ec-4fe9-ab11-226065409b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:47.038572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955b9d4-51ec-4fe9-ab11-226065409b4f service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:47.045077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955b9d4-51ec-4fe9-ab11-226065409b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:47.045641 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955b9d4-51ec-4fe9-ab11-226065409b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:47.068828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955b9d4-51ec-4fe9-ab11-226065409b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:47.070533 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955b9d4-51ec-4fe9-ab11-226065409b4f service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:47.091990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 847/1704] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:47.107261 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 858/1705] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:46 2022] PUT /identity/v3/projects/4b73e331787646f0b1e5324ec3bf473b/users/69adf25dc4a046dd936023f6b22f3c87/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:47.109968 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4977181-9289-4ec1-bc1d-92385b4dde1e None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:47.110279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4977181-9289-4ec1-bc1d-92385b4dde1e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:47.110614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4977181-9289-4ec1-bc1d-92385b4dde1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:47.111183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955b9d4-51ec-4fe9-ab11-226065409b4f service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:47.133326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955b9d4-51ec-4fe9-ab11-226065409b4f service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:47.184634 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d4977181-9289-4ec1-bc1d-92385b4dde1e None None] MFA Rules not processed for user `69adf25dc4a046dd936023f6b22f3c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:47.187659 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d4977181-9289-4ec1-bc1d-92385b4dde1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:47.305396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20471449-5db1-4193-becf-ea552dbdc955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:47.308609 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20471449-5db1-4193-becf-ea552dbdc955 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:47.309373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20471449-5db1-4193-becf-ea552dbdc955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:47.311017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20471449-5db1-4193-becf-ea552dbdc955 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:47.312236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20471449-5db1-4193-becf-ea552dbdc955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:47.315554 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20471449-5db1-4193-becf-ea552dbdc955 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:47.376637 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 859/1706] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:47.383454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4977181-9289-4ec1-bc1d-92385b4dde1e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:47.385065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d4977181-9289-4ec1-bc1d-92385b4dde1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:47.408726 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4977181-9289-4ec1-bc1d-92385b4dde1e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:47.416080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:47.419445 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:47.419445 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:47.419445 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf admin admin] PATH_INFO: `/v3/projects/b4750008bca641b2b48b50588284103f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:47.421098 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4750008bca641b2b48b50588284103f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:47.424247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:47.593600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 848/1707] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:47 2022] POST /identity/v3/projects => generated 369 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:47.594961 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20471449-5db1-4193-becf-ea552dbdc955 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:47.700730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20471449-5db1-4193-becf-ea552dbdc955 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:47.703471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4750008bca641b2b48b50588284103f', 'request_id': 'req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:47.798090 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd60981-e845-4bbc-9068-caf8509454f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:47.799563 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd60981-e845-4bbc-9068-caf8509454f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:47.800161 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd60981-e845-4bbc-9068-caf8509454f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:47.800316 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd60981-e845-4bbc-9068-caf8509454f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:47.801086 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd60981-e845-4bbc-9068-caf8509454f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:47.804250 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd60981-e845-4bbc-9068-caf8509454f5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:47.847751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:47.904037 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4750008bca641b2b48b50588284103f', 'request_id': 'req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:47.912156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4750008bca641b2b48b50588284103f', 'request_id': 'req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:47.945731 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf admin admin] The token cache is being invalidate because project b4750008bca641b2b48b50588284103f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:20:47.946034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:47.949294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:20:47.959083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 860/1708] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:20:47 2022] DELETE /identity/v3/projects/b4750008bca641b2b48b50588284103f => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:47.959083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:47.961677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:47.969813 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:48.017351 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 849/1709] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:47 2022] POST /identity/v3/projects => generated 387 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:48.029027 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10c5ef-7bc5-49da-b7a7-10a97fc82abf admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:48.042779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d31b-3ff2-4586-ac5c-637b1c610657 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:48.046453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d31b-3ff2-4586-ac5c-637b1c610657 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:48.048447 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d31b-3ff2-4586-ac5c-637b1c610657 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:48.061537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 850/1710] 10.222.0.98 () {54 vars in 912 bytes} [Tue Jul 26 15:20:48 2022] GET /identity => generated 270 bytes in 31 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:20:48.079941 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e31e3-94d6-42c0-90c9-876231e5f0dc None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:48.084879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e31e3-94d6-42c0-90c9-876231e5f0dc None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:48.087472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e31e3-94d6-42c0-90c9-876231e5f0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:48.166666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c52e31e3-94d6-42c0-90c9-876231e5f0dc None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:48.169442 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c52e31e3-94d6-42c0-90c9-876231e5f0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:48.211074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adb21d-8b52-4a88-94f9-17c8b05d47e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:48.212440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adb21d-8b52-4a88-94f9-17c8b05d47e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:48.215055 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adb21d-8b52-4a88-94f9-17c8b05d47e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:48.216015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adb21d-8b52-4a88-94f9-17c8b05d47e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:48.216557 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adb21d-8b52-4a88-94f9-17c8b05d47e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:48.223669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adb21d-8b52-4a88-94f9-17c8b05d47e4 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:48.384704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 851/1711] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:48.385930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e31e3-94d6-42c0-90c9-876231e5f0dc None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:48.390995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 861/1712] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:47 2022] POST /identity/v3/users => generated 285 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:48.392953 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888751d3-a81f-4e8c-8430-2504691c12c3 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:48.393259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888751d3-a81f-4e8c-8430-2504691c12c3 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:48.393539 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888751d3-a81f-4e8c-8430-2504691c12c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:48.398209 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c52e31e3-94d6-42c0-90c9-876231e5f0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:48.432802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e31e3-94d6-42c0-90c9-876231e5f0dc None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:48.445944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee616b5c-f714-409e-b606-decf6451b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:48.447123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee616b5c-f714-409e-b606-decf6451b816 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:48.447123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee616b5c-f714-409e-b606-decf6451b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:48.449927 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee616b5c-f714-409e-b606-decf6451b816 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:48.450727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee616b5c-f714-409e-b606-decf6451b816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:48.456081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee616b5c-f714-409e-b606-decf6451b816 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:48.503987 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-888751d3-a81f-4e8c-8430-2504691c12c3 None None] MFA Rules not processed for user `e44d2d2b50484fb89b0688ff28615d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:48.505493 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-888751d3-a81f-4e8c-8430-2504691c12c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:48.590622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 862/1713] 10.222.0.98 () {58 vars in 1009 bytes} [Tue Jul 26 15:20:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:48.592354 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb36ad-c69d-415f-afd4-fe822dc97b9e None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:48.593262 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb36ad-c69d-415f-afd4-fe822dc97b9e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:48.593654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb36ad-c69d-415f-afd4-fe822dc97b9e None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:48.595885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 863/1714] 10.222.0.98 () {54 vars in 912 bytes} [Tue Jul 26 15:20:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:20:48.597737 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb36ad-c69d-415f-afd4-fe822dc97b9e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:48.616160 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb36ad-c69d-415f-afd4-fe822dc97b9e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:48.623864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cdf30-f0ae-48c0-b7f2-36b73e59084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:48.624986 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cdf30-f0ae-48c0-b7f2-36b73e59084e admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:48.625390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cdf30-f0ae-48c0-b7f2-36b73e59084e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:48.625774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cdf30-f0ae-48c0-b7f2-36b73e59084e admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:48.626862 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100cdf30-f0ae-48c0-b7f2-36b73e59084e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:48.637675 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100cdf30-f0ae-48c0-b7f2-36b73e59084e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:48.649367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 852/1715] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:48 2022] POST /identity/v3/users => generated 300 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:48.651869 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67101ce-4283-4e44-842c-54aabc7cd3f2 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:48.652534 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67101ce-4283-4e44-842c-54aabc7cd3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:48.652926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67101ce-4283-4e44-842c-54aabc7cd3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:48.681078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 864/1716] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:48.685746 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b005d9f-bc4a-4f52-a97f-4ef3ca13e38a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:48.686089 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b005d9f-bc4a-4f52-a97f-4ef3ca13e38a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:48.686402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b005d9f-bc4a-4f52-a97f-4ef3ca13e38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:48.695534 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f67101ce-4283-4e44-842c-54aabc7cd3f2 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:48.702001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f67101ce-4283-4e44-842c-54aabc7cd3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:48.722025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 853/1717] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:48.722025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67101ce-4283-4e44-842c-54aabc7cd3f2 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:48.723552 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f67101ce-4283-4e44-842c-54aabc7cd3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:48.742262 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-6b005d9f-bc4a-4f52-a97f-4ef3ca13e38a None None] MFA Rules not processed for user `e44d2d2b50484fb89b0688ff28615d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:48.744891 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6b005d9f-bc4a-4f52-a97f-4ef3ca13e38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:48.757016 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67101ce-4283-4e44-842c-54aabc7cd3f2 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:48.768799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad080b12-4b69-465f-8310-a08f8837d858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:48.773951 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad080b12-4b69-465f-8310-a08f8837d858 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:48.774926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad080b12-4b69-465f-8310-a08f8837d858 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:48.776537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad080b12-4b69-465f-8310-a08f8837d858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:48.778804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 865/1718] 10.222.0.98 () {58 vars in 1009 bytes} [Tue Jul 26 15:20:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:48.780120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b005d9f-bc4a-4f52-a97f-4ef3ca13e38a None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:48.831222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad080b12-4b69-465f-8310-a08f8837d858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:48.854807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad080b12-4b69-465f-8310-a08f8837d858 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:48.887889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b005d9f-bc4a-4f52-a97f-4ef3ca13e38a None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:48.941481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205d8c8-bb37-48ee-98ac-85d5523cf1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:48.947701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 854/1719] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:48.950003 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205d8c8-bb37-48ee-98ac-85d5523cf1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:48.950561 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205d8c8-bb37-48ee-98ac-85d5523cf1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:48.951870 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad080b12-4b69-465f-8310-a08f8837d858 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:48.952706 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205d8c8-bb37-48ee-98ac-85d5523cf1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:48.954982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205d8c8-bb37-48ee-98ac-85d5523cf1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:48.958688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205d8c8-bb37-48ee-98ac-85d5523cf1c8 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:49.019510 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad080b12-4b69-465f-8310-a08f8837d858 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:49.030871 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 866/1720] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:49.032920 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205d8c8-bb37-48ee-98ac-85d5523cf1c8 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:49.052120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:49.060304 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dedbe-7523-4258-9638-9e274c486961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:49.066424 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dedbe-7523-4258-9638-9e274c486961 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:49.067282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dedbe-7523-4258-9638-9e274c486961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:49.068829 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dedbe-7523-4258-9638-9e274c486961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:49.086104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dedbe-7523-4258-9638-9e274c486961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:49.095246 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dedbe-7523-4258-9638-9e274c486961 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:49.106118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205d8c8-bb37-48ee-98ac-85d5523cf1c8 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:49.141268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a718ab-2251-43b1-8f6a-e813be9496e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:49.142631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a718ab-2251-43b1-8f6a-e813be9496e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:49.143082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a718ab-2251-43b1-8f6a-e813be9496e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:49.143576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a718ab-2251-43b1-8f6a-e813be9496e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:49.152419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a718ab-2251-43b1-8f6a-e813be9496e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:20:49.152897 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a718ab-2251-43b1-8f6a-e813be9496e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:49.161533 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 855/1721] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:49.163280 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dedbe-7523-4258-9638-9e274c486961 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:49.165930 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a718ab-2251-43b1-8f6a-e813be9496e3 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:49.204204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dedbe-7523-4258-9638-9e274c486961 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:49.242753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c36f08-8738-4427-a054-8fda00db13c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:49.245336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 867/1722] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:20:49.251577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a718ab-2251-43b1-8f6a-e813be9496e3 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:49.252159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c36f08-8738-4427-a054-8fda00db13c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:49.253723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c36f08-8738-4427-a054-8fda00db13c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:49.254233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c36f08-8738-4427-a054-8fda00db13c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:49.285620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c36f08-8738-4427-a054-8fda00db13c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:49.288697 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c36f08-8738-4427-a054-8fda00db13c2 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:49.299204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a718ab-2251-43b1-8f6a-e813be9496e3 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:49.314092 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a11947-034a-40a6-9df3-335882784970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:49.315340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a11947-034a-40a6-9df3-335882784970 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:49.315863 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a11947-034a-40a6-9df3-335882784970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:49.316369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a11947-034a-40a6-9df3-335882784970 admin admin] PATH_INFO: `/v3/projects/4a767e3bc5524e68bdcc21e2c21a6611/users/6451ebba43e147669256e9ef8a27b0be/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:49.354995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 856/1723] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:49.354995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c36f08-8738-4427-a054-8fda00db13c2 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:49.433326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c36f08-8738-4427-a054-8fda00db13c2 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:49.435300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a11947-034a-40a6-9df3-335882784970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a767e3bc5524e68bdcc21e2c21a6611, user_id=6451ebba43e147669256e9ef8a27b0be, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:49.440798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a11947-034a-40a6-9df3-335882784970 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:49.457949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88870f-17b3-4e35-ac05-27507102a16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:49.458938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88870f-17b3-4e35-ac05-27507102a16f admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:49.459438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88870f-17b3-4e35-ac05-27507102a16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:49.460767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88870f-17b3-4e35-ac05-27507102a16f admin admin] PATH_INFO: `/v3/projects/68c3176c2e284b2db425e4731acad803/users/308c1d7aec6b4acaa3fa233a9e954404/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:49.555764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88870f-17b3-4e35-ac05-27507102a16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c3176c2e284b2db425e4731acad803, user_id=308c1d7aec6b4acaa3fa233a9e954404, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:49.560270 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88870f-17b3-4e35-ac05-27507102a16f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:49.581730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 868/1724] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:49 2022] PUT /identity/v3/projects/4a767e3bc5524e68bdcc21e2c21a6611/users/6451ebba43e147669256e9ef8a27b0be/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:49.587016 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a11947-034a-40a6-9df3-335882784970 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:49.681610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 857/1725] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:49 2022] PUT /identity/v3/projects/68c3176c2e284b2db425e4731acad803/users/308c1d7aec6b4acaa3fa233a9e954404/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:49.685096 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88870f-17b3-4e35-ac05-27507102a16f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:49.834131 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:49.868465 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a11947-034a-40a6-9df3-335882784970 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:49.950862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88870f-17b3-4e35-ac05-27507102a16f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:49.981731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0e234-8d32-48ec-a62b-867f5ed7fbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:49.982666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0e234-8d32-48ec-a62b-867f5ed7fbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:49.985179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0e234-8d32-48ec-a62b-867f5ed7fbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:49.985471 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0e234-8d32-48ec-a62b-867f5ed7fbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:49.986312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0e234-8d32-48ec-a62b-867f5ed7fbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:49.988039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0e234-8d32-48ec-a62b-867f5ed7fbb2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:50.011325 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:50.022840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 858/1726] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:50.024413 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9d62e-3751-4d00-a33d-c7d8ccc85308 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:50.024711 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9d62e-3751-4d00-a33d-c7d8ccc85308 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:50.024997 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9d62e-3751-4d00-a33d-c7d8ccc85308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:50.106497 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-40b9d62e-3751-4d00-a33d-c7d8ccc85308 None None] MFA Rules not processed for user `308c1d7aec6b4acaa3fa233a9e954404`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:50.108128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-40b9d62e-3751-4d00-a33d-c7d8ccc85308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:50.156116 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacc600-33f3-4206-9ab2-b385056b6707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:50.160791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacc600-33f3-4206-9ab2-b385056b6707 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:50.161079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacc600-33f3-4206-9ab2-b385056b6707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:50.166171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacc600-33f3-4206-9ab2-b385056b6707 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:50.168324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacc600-33f3-4206-9ab2-b385056b6707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:50.188633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacc600-33f3-4206-9ab2-b385056b6707 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:50.376145 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 869/1727] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:49 2022] POST /identity/v3/projects => generated 381 bytes in 794 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:50.380765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacc600-33f3-4206-9ab2-b385056b6707 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:50.397848 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 859/1728] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:50.401109 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9d62e-3751-4d00-a33d-c7d8ccc85308 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:50.450027 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9d62e-3751-4d00-a33d-c7d8ccc85308 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:50.669130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacc600-33f3-4206-9ab2-b385056b6707 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:50.692121 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35583f28-ad1d-457d-89c8-cae2ab2df3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:50.693155 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35583f28-ad1d-457d-89c8-cae2ab2df3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:50.693818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35583f28-ad1d-457d-89c8-cae2ab2df3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:50.694314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35583f28-ad1d-457d-89c8-cae2ab2df3f6 admin admin] PATH_INFO: `/v3/projects/4a767e3bc5524e68bdcc21e2c21a6611/users/6451ebba43e147669256e9ef8a27b0be/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:50.704214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35583f28-ad1d-457d-89c8-cae2ab2df3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a767e3bc5524e68bdcc21e2c21a6611, user_id=6451ebba43e147669256e9ef8a27b0be, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:50.716925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35583f28-ad1d-457d-89c8-cae2ab2df3f6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:50.727496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c15b0-9722-45e2-ba03-c659787e4ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:50.734111 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c15b0-9722-45e2-ba03-c659787e4ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:50.734816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c15b0-9722-45e2-ba03-c659787e4ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:50.735200 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c15b0-9722-45e2-ba03-c659787e4ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:50.736334 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c15b0-9722-45e2-ba03-c659787e4ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:50.738811 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c15b0-9722-45e2-ba03-c659787e4ad1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:50.742765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 870/1729] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:50 2022] PUT /identity/v3/projects/4a767e3bc5524e68bdcc21e2c21a6611/users/6451ebba43e147669256e9ef8a27b0be/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:50.742765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35583f28-ad1d-457d-89c8-cae2ab2df3f6 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:50.865883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 860/1730] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:50 2022] POST /identity/v3/users => generated 291 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:50.868125 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eed3a-f035-4230-83b9-fd69c58121e4 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:50.870653 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eed3a-f035-4230-83b9-fd69c58121e4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:50.870943 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eed3a-f035-4230-83b9-fd69c58121e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:50.886046 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35583f28-ad1d-457d-89c8-cae2ab2df3f6 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:50.893409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b61a7-0a9a-464d-b2fb-141db32549ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:50.894221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b61a7-0a9a-464d-b2fb-141db32549ed admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:50.894692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b61a7-0a9a-464d-b2fb-141db32549ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:50.895070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b61a7-0a9a-464d-b2fb-141db32549ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:50.895878 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b61a7-0a9a-464d-b2fb-141db32549ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:50.898513 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b61a7-0a9a-464d-b2fb-141db32549ed admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:50.974852 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-961eed3a-f035-4230-83b9-fd69c58121e4 None None] MFA Rules not processed for user `6451ebba43e147669256e9ef8a27b0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:50.982676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-961eed3a-f035-4230-83b9-fd69c58121e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:51.019215 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 871/1731] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:50 2022] POST /identity/v3/projects => generated 367 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:51.020307 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b61a7-0a9a-464d-b2fb-141db32549ed admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:51.100995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:51.106088 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:51.192608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b61a7-0a9a-464d-b2fb-141db32549ed admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:51.208473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab80081-e5e7-480a-a403-17f8bd8efbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:51.210629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab80081-e5e7-480a-a403-17f8bd8efbea admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:51.211367 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab80081-e5e7-480a-a403-17f8bd8efbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:51.212124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab80081-e5e7-480a-a403-17f8bd8efbea admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:51.214111 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 861/1732] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:51.215108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab80081-e5e7-480a-a403-17f8bd8efbea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:51.215816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eed3a-f035-4230-83b9-fd69c58121e4 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:51.218233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab80081-e5e7-480a-a403-17f8bd8efbea admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:51.248092 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 872/1733] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:51.249296 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab80081-e5e7-480a-a403-17f8bd8efbea admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:51.251767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-bab80081-e5e7-480a-a403-17f8bd8efbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:51.266212 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eed3a-f035-4230-83b9-fd69c58121e4 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:51.280125 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bbf6a-52f0-445f-9cfc-90d259e6262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:51.281872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bbf6a-52f0-445f-9cfc-90d259e6262b admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:51.282649 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bbf6a-52f0-445f-9cfc-90d259e6262b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:51.283477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bbf6a-52f0-445f-9cfc-90d259e6262b admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:51.285024 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bbf6a-52f0-445f-9cfc-90d259e6262b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:51.289913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bbf6a-52f0-445f-9cfc-90d259e6262b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:51.427877 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab80081-e5e7-480a-a403-17f8bd8efbea admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:51.435954 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55132cf8-f85a-4474-825c-96d15396fbbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:51.437121 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55132cf8-f85a-4474-825c-96d15396fbbd service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:51.437515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55132cf8-f85a-4474-825c-96d15396fbbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:51.437896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55132cf8-f85a-4474-825c-96d15396fbbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:51.524613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 862/1734] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:51 2022] POST /identity/v3/users => generated 290 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:51.524613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bbf6a-52f0-445f-9cfc-90d259e6262b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:51.595611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bbf6a-52f0-445f-9cfc-90d259e6262b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:51.606051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55132cf8-f85a-4474-825c-96d15396fbbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:51.607646 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55132cf8-f85a-4474-825c-96d15396fbbd service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:51.627046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18064e7d-a66a-4bb5-ac53-b2dfdbcdd284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:51.628551 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18064e7d-a66a-4bb5-ac53-b2dfdbcdd284 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:51.628715 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18064e7d-a66a-4bb5-ac53-b2dfdbcdd284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:51.647836 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18064e7d-a66a-4bb5-ac53-b2dfdbcdd284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:51.649388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18064e7d-a66a-4bb5-ac53-b2dfdbcdd284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:51.650078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 873/1735] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:51.655313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48acbdc-58c6-4184-901a-a40a4682839d None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:51.656230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48acbdc-58c6-4184-901a-a40a4682839d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:51.656230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48acbdc-58c6-4184-901a-a40a4682839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:51.669901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18064e7d-a66a-4bb5-ac53-b2dfdbcdd284 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:51.767274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 863/1736] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:51.770158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18064e7d-a66a-4bb5-ac53-b2dfdbcdd284 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:51.772553 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d48acbdc-58c6-4184-901a-a40a4682839d None None] MFA Rules not processed for user `8c2443bed4524175ada322cff385a15a`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:51.778928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d48acbdc-58c6-4184-901a-a40a4682839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:51.832683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18064e7d-a66a-4bb5-ac53-b2dfdbcdd284 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:51.866786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c22a3-690b-461c-be13-50a3e4682ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:51.878253 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c22a3-690b-461c-be13-50a3e4682ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:51.878253 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c22a3-690b-461c-be13-50a3e4682ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:51.878253 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c22a3-690b-461c-be13-50a3e4682ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:51.882242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c22a3-690b-461c-be13-50a3e4682ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:51.891489 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c22a3-690b-461c-be13-50a3e4682ec4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:51.962631 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 864/1737] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:51.964487 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c22a3-690b-461c-be13-50a3e4682ec4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:51.981532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:51.985320 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c22a3-690b-461c-be13-50a3e4682ec4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:51.993829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 874/1738] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:51.998912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6384f7c-87fc-4455-a638-f1b734b53c01 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:51.999184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6384f7c-87fc-4455-a638-f1b734b53c01 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:51.999487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6384f7c-87fc-4455-a638-f1b734b53c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:52.003892 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514f7ee-5a50-4c2d-8f4a-470dad179cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:52.005015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f7ee-5a50-4c2d-8f4a-470dad179cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:52.005377 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f7ee-5a50-4c2d-8f4a-470dad179cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:52.005719 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f7ee-5a50-4c2d-8f4a-470dad179cf9 admin admin] PATH_INFO: `/v3/projects/32098043f909473db847df9896329764/users/ae434617b92b463fbbe923aca84e74f9/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:52.068906 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514f7ee-5a50-4c2d-8f4a-470dad179cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32098043f909473db847df9896329764, user_id=ae434617b92b463fbbe923aca84e74f9, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:52.079794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d6384f7c-87fc-4455-a638-f1b734b53c01 None None] MFA Rules not processed for user `1a89102e82bf400880ffb0b28b7e9aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:52.081980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d6384f7c-87fc-4455-a638-f1b734b53c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:52.084620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514f7ee-5a50-4c2d-8f4a-470dad179cf9 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:52.272426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 865/1739] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:51 2022] PUT /identity/v3/projects/32098043f909473db847df9896329764/users/ae434617b92b463fbbe923aca84e74f9/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:52.273746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514f7ee-5a50-4c2d-8f4a-470dad179cf9 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:52.364203 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 875/1740] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:52.370653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6384f7c-87fc-4455-a638-f1b734b53c01 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:52.392760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d6384f7c-87fc-4455-a638-f1b734b53c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:52.475460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6384f7c-87fc-4455-a638-f1b734b53c01 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:52.483546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccc07c-1297-4292-8c70-b04fd4df9170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:52.484289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccc07c-1297-4292-8c70-b04fd4df9170 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:52.484628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccc07c-1297-4292-8c70-b04fd4df9170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:52.484947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccc07c-1297-4292-8c70-b04fd4df9170 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:52.485607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccc07c-1297-4292-8c70-b04fd4df9170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:52.488253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccc07c-1297-4292-8c70-b04fd4df9170 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:52.507236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514f7ee-5a50-4c2d-8f4a-470dad179cf9 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:52.528483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9e664-0f3c-47dc-9c50-555c5c223889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:52.529315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9e664-0f3c-47dc-9c50-555c5c223889 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:52.529755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9e664-0f3c-47dc-9c50-555c5c223889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:52.530133 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9e664-0f3c-47dc-9c50-555c5c223889 admin admin] PATH_INFO: `/v3/projects/380f83b0ea434d01bed35c4bfeca0833/users/c3da758acdf64057bf0e20c3b79d38b8/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:52.570139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9e664-0f3c-47dc-9c50-555c5c223889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380f83b0ea434d01bed35c4bfeca0833, user_id=c3da758acdf64057bf0e20c3b79d38b8, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:52.578669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9e664-0f3c-47dc-9c50-555c5c223889 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:52.675805 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 866/1741] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:52 2022] PUT /identity/v3/projects/380f83b0ea434d01bed35c4bfeca0833/users/c3da758acdf64057bf0e20c3b79d38b8/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:52.680037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f5cc7-cbb2-423a-acd9-c460912ff5fb None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:52.680736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f5cc7-cbb2-423a-acd9-c460912ff5fb None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:52.681417 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f5cc7-cbb2-423a-acd9-c460912ff5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:52.714991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 876/1742] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:52 2022] POST /identity/v3/projects => generated 403 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:52.716933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec093c-cfcd-4e42-b3ba-0e5f1d0c6c44 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:52.717734 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec093c-cfcd-4e42-b3ba-0e5f1d0c6c44 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:52.718450 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec093c-cfcd-4e42-b3ba-0e5f1d0c6c44 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:52.727125 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 877/1743] 10.222.0.98 () {54 vars in 961 bytes} [Tue Jul 26 15:20:52 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:20:52.729524 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec093c-cfcd-4e42-b3ba-0e5f1d0c6c44 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:52.732126 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-12ec093c-cfcd-4e42-b3ba-0e5f1d0c6c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:52.824046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-496f5cc7-cbb2-423a-acd9-c460912ff5fb None None] MFA Rules not processed for user `ae434617b92b463fbbe923aca84e74f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:52.825563 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-496f5cc7-cbb2-423a-acd9-c460912ff5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:52.976488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:52.984036 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec093c-cfcd-4e42-b3ba-0e5f1d0c6c44 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:52.993535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ca812-e6d8-445d-9a4d-ce0f75bb87d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:52.995104 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ca812-e6d8-445d-9a4d-ce0f75bb87d0 service placement] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:52.995462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ca812-e6d8-445d-9a4d-ce0f75bb87d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:52.995649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ca812-e6d8-445d-9a4d-ce0f75bb87d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:53.000100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4b2ca812-e6d8-445d-9a4d-ce0f75bb87d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:53.045072 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 867/1744] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:53.047616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332a5a2-c13d-49da-ad90-cadad4fc61cf None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:53.048320 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332a5a2-c13d-49da-ad90-cadad4fc61cf None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:53.048786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332a5a2-c13d-49da-ad90-cadad4fc61cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:53.049169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ca812-e6d8-445d-9a4d-ce0f75bb87d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:53.051595 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ca812-e6d8-445d-9a4d-ce0f75bb87d0 service placement] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:53.085865 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 878/1745] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:53.088040 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ca812-e6d8-445d-9a4d-ce0f75bb87d0 service placement] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:53.093832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7332a5a2-c13d-49da-ad90-cadad4fc61cf None None] MFA Rules not processed for user `5182476e94ea4f0c8049001bebd351bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:53.100882 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7332a5a2-c13d-49da-ad90-cadad4fc61cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:53.274221 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 868/1746] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:53.278172 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332a5a2-c13d-49da-ad90-cadad4fc61cf None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:53.283574 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ca812-e6d8-445d-9a4d-ce0f75bb87d0 service placement] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:53.294270 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adb211-046d-43d8-a3f9-01a1eed607dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:53.294984 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adb211-046d-43d8-a3f9-01a1eed607dd admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:53.295251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adb211-046d-43d8-a3f9-01a1eed607dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:53.295529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adb211-046d-43d8-a3f9-01a1eed607dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:53.296431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adb211-046d-43d8-a3f9-01a1eed607dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:53.298149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adb211-046d-43d8-a3f9-01a1eed607dd admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:53.304265 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332a5a2-c13d-49da-ad90-cadad4fc61cf None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:53.319185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa260c-9ebc-427e-91c2-730a92e69a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:53.320035 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa260c-9ebc-427e-91c2-730a92e69a79 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:53.320325 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa260c-9ebc-427e-91c2-730a92e69a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:53.320608 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa260c-9ebc-427e-91c2-730a92e69a79 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:53.321303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa260c-9ebc-427e-91c2-730a92e69a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:53.324375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa260c-9ebc-427e-91c2-730a92e69a79 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:53.330048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 879/1747] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:53.331469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79264a91-9020-48e9-b6ec-104e77cd019a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:53.331804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79264a91-9020-48e9-b6ec-104e77cd019a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:53.332080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79264a91-9020-48e9-b6ec-104e77cd019a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:53.366145 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-79264a91-9020-48e9-b6ec-104e77cd019a None None] MFA Rules not processed for user `448161cd39dc4a6786c8813faa79376a`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:53.367558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-79264a91-9020-48e9-b6ec-104e77cd019a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:53.378636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 880/1748] 10.222.0.98 () {58 vars in 1058 bytes} [Tue Jul 26 15:20:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:53.379710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79264a91-9020-48e9-b6ec-104e77cd019a None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:53.386001 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:53.402934 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79264a91-9020-48e9-b6ec-104e77cd019a None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:53.414968 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee675f6-123f-4539-bded-3df12d1df4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:53.415788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee675f6-123f-4539-bded-3df12d1df4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:53.421308 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee675f6-123f-4539-bded-3df12d1df4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:53.422509 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee675f6-123f-4539-bded-3df12d1df4f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:53.424015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee675f6-123f-4539-bded-3df12d1df4f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:53.440340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee675f6-123f-4539-bded-3df12d1df4f7 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:53.710691 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 869/1749] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:53 2022] POST /identity/v3/users => generated 308 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:53.710691 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa260c-9ebc-427e-91c2-730a92e69a79 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:53.751127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa260c-9ebc-427e-91c2-730a92e69a79 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:53.768685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9adea2-f1c6-4553-9b8e-9c09f84d4095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:53.768685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9adea2-f1c6-4553-9b8e-9c09f84d4095 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:53.768685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9adea2-f1c6-4553-9b8e-9c09f84d4095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:53.768685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9adea2-f1c6-4553-9b8e-9c09f84d4095 admin admin] PATH_INFO: `/v3/projects/380f83b0ea434d01bed35c4bfeca0833/users/c3da758acdf64057bf0e20c3b79d38b8/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:53.772027 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 881/1750] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:20:53 2022] POST /identity/v3/projects => generated 379 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:53.772816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9adea2-f1c6-4553-9b8e-9c09f84d4095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380f83b0ea434d01bed35c4bfeca0833, user_id=c3da758acdf64057bf0e20c3b79d38b8, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:53.776622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee675f6-123f-4539-bded-3df12d1df4f7 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:53.778494 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9adea2-f1c6-4553-9b8e-9c09f84d4095 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:53.815380 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 870/1751] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:53 2022] PUT /identity/v3/projects/380f83b0ea434d01bed35c4bfeca0833/users/c3da758acdf64057bf0e20c3b79d38b8/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:53.818755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9adea2-f1c6-4553-9b8e-9c09f84d4095 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:53.967882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee675f6-123f-4539-bded-3df12d1df4f7 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:54.022216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9adea2-f1c6-4553-9b8e-9c09f84d4095 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:54.038075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef8282-6956-469f-81e3-288ff813db45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:54.040094 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef8282-6956-469f-81e3-288ff813db45 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:54.040685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef8282-6956-469f-81e3-288ff813db45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:54.041216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef8282-6956-469f-81e3-288ff813db45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:54.042656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef8282-6956-469f-81e3-288ff813db45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:54.046445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef8282-6956-469f-81e3-288ff813db45 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:54.076640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 871/1752] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:54.078394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef8282-6956-469f-81e3-288ff813db45 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:54.097275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef8282-6956-469f-81e3-288ff813db45 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:54.106236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713151b-fa43-4a69-b31a-ea13079d868c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:54.107573 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713151b-fa43-4a69-b31a-ea13079d868c admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:54.108018 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713151b-fa43-4a69-b31a-ea13079d868c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:54.108630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713151b-fa43-4a69-b31a-ea13079d868c admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:54.109713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713151b-fa43-4a69-b31a-ea13079d868c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:54.112109 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713151b-fa43-4a69-b31a-ea13079d868c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:54.144206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc34abe-54d8-4f5c-b0a9-a10fe47b2c07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:54.144888 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc34abe-54d8-4f5c-b0a9-a10fe47b2c07 service placement] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:54.145163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc34abe-54d8-4f5c-b0a9-a10fe47b2c07 service placement] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:54.145452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc34abe-54d8-4f5c-b0a9-a10fe47b2c07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:54.166126 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc34abe-54d8-4f5c-b0a9-a10fe47b2c07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:54.182917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc34abe-54d8-4f5c-b0a9-a10fe47b2c07 service placement] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:54.218405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 882/1753] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:54.219940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c1c81-ea99-436a-8bf8-16d6cd00d153 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:54.220234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c1c81-ea99-436a-8bf8-16d6cd00d153 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:54.220513 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c1c81-ea99-436a-8bf8-16d6cd00d153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:54.295468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-e56c1c81-ea99-436a-8bf8-16d6cd00d153 None None] MFA Rules not processed for user `c3da758acdf64057bf0e20c3b79d38b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:54.297090 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e56c1c81-ea99-436a-8bf8-16d6cd00d153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:54.299507 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 872/1754] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:20:54 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:20:54.300919 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713151b-fa43-4a69-b31a-ea13079d868c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:54.341108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713151b-fa43-4a69-b31a-ea13079d868c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:54.352201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d37c5b-67af-4f03-a945-3bc19b13bd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:54.354076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d37c5b-67af-4f03-a945-3bc19b13bd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:54.355162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d37c5b-67af-4f03-a945-3bc19b13bd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:54.355448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d37c5b-67af-4f03-a945-3bc19b13bd08 admin admin] PATH_INFO: `/v3/projects/178ffbad2742425aa61f7cf75419ea43/users/a7a2434f3965434e95edc351e9e018b2/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:54.428772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:54.448510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 883/1755] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:54.450964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c1c81-ea99-436a-8bf8-16d6cd00d153 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:54.461442 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d37c5b-67af-4f03-a945-3bc19b13bd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=178ffbad2742425aa61f7cf75419ea43, user_id=a7a2434f3965434e95edc351e9e018b2, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:54.470450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d37c5b-67af-4f03-a945-3bc19b13bd08 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:54.475001 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c1c81-ea99-436a-8bf8-16d6cd00d153 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:54.485414 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae3a88-ba56-4a62-a96c-a2fc63b45b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:54.487397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae3a88-ba56-4a62-a96c-a2fc63b45b14 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:54.487852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae3a88-ba56-4a62-a96c-a2fc63b45b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:54.488126 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae3a88-ba56-4a62-a96c-a2fc63b45b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:54.489253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae3a88-ba56-4a62-a96c-a2fc63b45b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:54.492385 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae3a88-ba56-4a62-a96c-a2fc63b45b14 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:54.511800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 884/1756] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:54.513363 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae3a88-ba56-4a62-a96c-a2fc63b45b14 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:54.693833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 873/1757] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:54 2022] PUT /identity/v3/projects/178ffbad2742425aa61f7cf75419ea43/users/a7a2434f3965434e95edc351e9e018b2/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:54.695701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d37c5b-67af-4f03-a945-3bc19b13bd08 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:54.741210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae3a88-ba56-4a62-a96c-a2fc63b45b14 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:54.746499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:54.973479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d37c5b-67af-4f03-a945-3bc19b13bd08 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:54.995558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16961e-03fa-4a3c-a908-cfadf5931126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:54.996360 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0006b-8e76-423c-a32b-a0ea52792349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:54.997389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0006b-8e76-423c-a32b-a0ea52792349 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:54.997866 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0006b-8e76-423c-a32b-a0ea52792349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:54.998334 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0006b-8e76-423c-a32b-a0ea52792349 admin admin] PATH_INFO: `/v3/projects/ef5b2da6a3d34be0a2ccf4ddd22b0278/users/6960580a40644e75ad4ca5e4e8ce41af/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:54.998608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16961e-03fa-4a3c-a908-cfadf5931126 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:54.999346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16961e-03fa-4a3c-a908-cfadf5931126 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:55.000231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16961e-03fa-4a3c-a908-cfadf5931126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:55.060123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0006b-8e76-423c-a32b-a0ea52792349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5b2da6a3d34be0a2ccf4ddd22b0278, user_id=6960580a40644e75ad4ca5e4e8ce41af, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:55.068165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0006b-8e76-423c-a32b-a0ea52792349 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:55.186832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16961e-03fa-4a3c-a908-cfadf5931126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:55.192742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16961e-03fa-4a3c-a908-cfadf5931126 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:55.214727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 874/1758] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:54 2022] PUT /identity/v3/projects/ef5b2da6a3d34be0a2ccf4ddd22b0278/users/6960580a40644e75ad4ca5e4e8ce41af/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:55.215793 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0006b-8e76-423c-a32b-a0ea52792349 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:55.252365 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 885/1759] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:55.253442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16961e-03fa-4a3c-a908-cfadf5931126 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:55.255083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3e16961e-03fa-4a3c-a908-cfadf5931126 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:55.290521 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16961e-03fa-4a3c-a908-cfadf5931126 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:55.397143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0006b-8e76-423c-a32b-a0ea52792349 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:55.410590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fda35-e9dc-41cb-b67e-5a9829ab1b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:55.411399 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fda35-e9dc-41cb-b67e-5a9829ab1b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:55.411963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fda35-e9dc-41cb-b67e-5a9829ab1b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:55.412337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fda35-e9dc-41cb-b67e-5a9829ab1b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:55.413174 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fda35-e9dc-41cb-b67e-5a9829ab1b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:55.420877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fda35-e9dc-41cb-b67e-5a9829ab1b8d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:55.430058 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24661ab3-af7d-43bb-b310-b42f6e953706 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:55.430797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24661ab3-af7d-43bb-b310-b42f6e953706 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:55.431089 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24661ab3-af7d-43bb-b310-b42f6e953706 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:55.432076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24661ab3-af7d-43bb-b310-b42f6e953706 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:55.435074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-24661ab3-af7d-43bb-b310-b42f6e953706 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:55.446665 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 875/1760] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:55.448454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fda35-e9dc-41cb-b67e-5a9829ab1b8d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:55.469637 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fda35-e9dc-41cb-b67e-5a9829ab1b8d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:55.471891 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:55.477781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6f3b7-941f-49a5-a3c3-4be853b87af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:55.479013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6f3b7-941f-49a5-a3c3-4be853b87af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:55.479870 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6f3b7-941f-49a5-a3c3-4be853b87af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:55.480258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6f3b7-941f-49a5-a3c3-4be853b87af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:55.481190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6f3b7-941f-49a5-a3c3-4be853b87af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:55.483304 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6f3b7-941f-49a5-a3c3-4be853b87af5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:55.508128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 876/1761] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:20:55.509047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6f3b7-941f-49a5-a3c3-4be853b87af5 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:55.553008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6f3b7-941f-49a5-a3c3-4be853b87af5 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:55.595877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ff6be-d9b1-47f1-8416-de43c2d3bf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:55.596648 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ff6be-d9b1-47f1-8416-de43c2d3bf22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:55.596931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ff6be-d9b1-47f1-8416-de43c2d3bf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:55.597206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ff6be-d9b1-47f1-8416-de43c2d3bf22 admin admin] PATH_INFO: `/v3/projects/178ffbad2742425aa61f7cf75419ea43/users/a7a2434f3965434e95edc351e9e018b2/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:55.602458 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ff6be-d9b1-47f1-8416-de43c2d3bf22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=178ffbad2742425aa61f7cf75419ea43, user_id=a7a2434f3965434e95edc351e9e018b2, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:55.608445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ff6be-d9b1-47f1-8416-de43c2d3bf22 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:55.635587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24661ab3-af7d-43bb-b310-b42f6e953706 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:55.638310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24661ab3-af7d-43bb-b310-b42f6e953706 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:55.643735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 877/1762] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:55 2022] PUT /identity/v3/projects/178ffbad2742425aa61f7cf75419ea43/users/a7a2434f3965434e95edc351e9e018b2/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:55.648507 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ff6be-d9b1-47f1-8416-de43c2d3bf22 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:55.680422 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 886/1763] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:55.891353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ff6be-d9b1-47f1-8416-de43c2d3bf22 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:55.899251 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee5a04-06b1-488f-97e9-7cf5871ff2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:55.901536 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee5a04-06b1-488f-97e9-7cf5871ff2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:55.902157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee5a04-06b1-488f-97e9-7cf5871ff2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:55.902623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee5a04-06b1-488f-97e9-7cf5871ff2f7 admin admin] PATH_INFO: `/v3/projects/ef5b2da6a3d34be0a2ccf4ddd22b0278/users/6960580a40644e75ad4ca5e4e8ce41af/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:55.904996 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee5a04-06b1-488f-97e9-7cf5871ff2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5b2da6a3d34be0a2ccf4ddd22b0278, user_id=6960580a40644e75ad4ca5e4e8ce41af, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:55.913848 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee5a04-06b1-488f-97e9-7cf5871ff2f7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:55.918794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:55.927846 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 878/1764] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:20:55 2022] PUT /identity/v3/projects/ef5b2da6a3d34be0a2ccf4ddd22b0278/users/6960580a40644e75ad4ca5e4e8ce41af/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:20:55.946054 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1cec8-4cc4-45bd-8665-3f1185e3586a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:55.946054 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1cec8-4cc4-45bd-8665-3f1185e3586a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:55.960026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1cec8-4cc4-45bd-8665-3f1185e3586a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:56.021733 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-38a1cec8-4cc4-45bd-8665-3f1185e3586a None None] MFA Rules not processed for user `6960580a40644e75ad4ca5e4e8ce41af`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:56.023745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-38a1cec8-4cc4-45bd-8665-3f1185e3586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:56.205674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 887/1765] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:20:57.372445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee5a04-06b1-488f-97e9-7cf5871ff2f7 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:57.603472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee5a04-06b1-488f-97e9-7cf5871ff2f7 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:57.628932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e72a7-11fe-49e6-aca0-c7c0621bcd82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:57.632033 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e72a7-11fe-49e6-aca0-c7c0621bcd82 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:57.632604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e72a7-11fe-49e6-aca0-c7c0621bcd82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:57.649072 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e72a7-11fe-49e6-aca0-c7c0621bcd82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:57.682179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e72a7-11fe-49e6-aca0-c7c0621bcd82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:57.685575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e72a7-11fe-49e6-aca0-c7c0621bcd82 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:57.722417 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 879/1766] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:58.146050 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1cec8-4cc4-45bd-8665-3f1185e3586a None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:20:58.168233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1cec8-4cc4-45bd-8665-3f1185e3586a None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:20:58.178261 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d3dec-c306-4795-bc55-b1ac6100d064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:20:58.180028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3dec-c306-4795-bc55-b1ac6100d064 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:58.181263 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3dec-c306-4795-bc55-b1ac6100d064 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:58.181974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3dec-c306-4795-bc55-b1ac6100d064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:58.467741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d3dec-c306-4795-bc55-b1ac6100d064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:20:58.467741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d3dec-c306-4795-bc55-b1ac6100d064 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:20:58.467741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 888/1767] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:20:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:20:59.094262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6a52c-03d3-4fae-8a24-afcc3d88fc7e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:20:59.095126 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6a52c-03d3-4fae-8a24-afcc3d88fc7e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:20:59.095392 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6a52c-03d3-4fae-8a24-afcc3d88fc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:20:59.208772 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5eb6a52c-03d3-4fae-8a24-afcc3d88fc7e None None] MFA Rules not processed for user `a7a2434f3965434e95edc351e9e018b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:20:59.214736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5eb6a52c-03d3-4fae-8a24-afcc3d88fc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:20:59.446594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 880/1768] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:20:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:00.983408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dfcd2-4af4-45f6-8781-058b2c473ac9 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:00.984987 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dfcd2-4af4-45f6-8781-058b2c473ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:00.985830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dfcd2-4af4-45f6-8781-058b2c473ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:01.160145 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:01.168123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-4b0dfcd2-4af4-45f6-8781-058b2c473ac9 None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:01.170064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4b0dfcd2-4af4-45f6-8781-058b2c473ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:01.334093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 889/1769] 10.222.0.98 () {58 vars in 1009 bytes} [Tue Jul 26 15:21:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:21:01.645628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a6208-22a7-4a5c-9fa3-352e172aae1d None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:01.650574 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a6208-22a7-4a5c-9fa3-352e172aae1d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:01.650574 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a6208-22a7-4a5c-9fa3-352e172aae1d None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:01.650574 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 881/1770] 10.222.0.98 () {54 vars in 921 bytes} [Tue Jul 26 15:21:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:21:01.743174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b112eea-0ddf-411f-b5fa-848f4d788472 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:01.751601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b112eea-0ddf-411f-b5fa-848f4d788472 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:01.752198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b112eea-0ddf-411f-b5fa-848f4d788472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:01.826786 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-5b112eea-0ddf-411f-b5fa-848f4d788472 None None] MFA Rules not processed for user `448161cd39dc4a6786c8813faa79376a`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:01.830283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5b112eea-0ddf-411f-b5fa-848f4d788472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:01.953099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 890/1771] 10.222.0.98 () {58 vars in 1018 bytes} [Tue Jul 26 15:21:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:01.956570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a6208-22a7-4a5c-9fa3-352e172aae1d None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:01.959327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-953a6208-22a7-4a5c-9fa3-352e172aae1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:01.973152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b112eea-0ddf-411f-b5fa-848f4d788472 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:01.994168 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b112eea-0ddf-411f-b5fa-848f4d788472 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:02.004565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9335b9-a328-437f-b387-092625693330 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:02.005634 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9335b9-a328-437f-b387-092625693330 service placement] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:02.006322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9335b9-a328-437f-b387-092625693330 service placement] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:02.006960 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9335b9-a328-437f-b387-092625693330 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:02.021680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9335b9-a328-437f-b387-092625693330 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:02.023880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9335b9-a328-437f-b387-092625693330 service placement] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:02.050050 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 891/1772] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:02.233804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a6208-22a7-4a5c-9fa3-352e172aae1d None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:02.250130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4b51b-c7f0-4ab9-9f13-2415ca7e0fc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:02.250968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4b51b-c7f0-4ab9-9f13-2415ca7e0fc0 service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:02.251264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4b51b-c7f0-4ab9-9f13-2415ca7e0fc0 service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:02.251548 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4b51b-c7f0-4ab9-9f13-2415ca7e0fc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:02.264180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:02.267960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4b51b-c7f0-4ab9-9f13-2415ca7e0fc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:02.274839 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4b51b-c7f0-4ab9-9f13-2415ca7e0fc0 service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:02.297605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 882/1773] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:21:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:21:04.711740 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc5f7c-1b70-4039-a894-634847551e46 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:04.711740 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc5f7c-1b70-4039-a894-634847551e46 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:04.711740 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc5f7c-1b70-4039-a894-634847551e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:04.815577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-8ddc5f7c-1b70-4039-a894-634847551e46 None None] MFA Rules not processed for user `e44d2d2b50484fb89b0688ff28615d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:04.818063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8ddc5f7c-1b70-4039-a894-634847551e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:05.075533 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 892/1774] 10.222.0.122 () {58 vars in 1016 bytes} [Tue Jul 26 15:21:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:05.319242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4b51b-c7f0-4ab9-9f13-2415ca7e0fc0 service swift] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:05.324153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3bd4b51b-c7f0-4ab9-9f13-2415ca7e0fc0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:05.369155 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4b51b-c7f0-4ab9-9f13-2415ca7e0fc0 service swift] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:05.393521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b77d20-f809-49bc-af36-93da650149ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:05.393948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b77d20-f809-49bc-af36-93da650149ce service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:05.394321 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b77d20-f809-49bc-af36-93da650149ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:05.394771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b77d20-f809-49bc-af36-93da650149ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:05.412126 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b77d20-f809-49bc-af36-93da650149ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:05.413913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b77d20-f809-49bc-af36-93da650149ce service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:05.451197 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 883/1775] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:05.461049 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc5f7c-1b70-4039-a894-634847551e46 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:05.492936 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc5f7c-1b70-4039-a894-634847551e46 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:05.528274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36827cb-7225-433e-a6e6-7157f39d9b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:05.530132 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36827cb-7225-433e-a6e6-7157f39d9b06 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:05.530456 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36827cb-7225-433e-a6e6-7157f39d9b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:05.530745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36827cb-7225-433e-a6e6-7157f39d9b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:05.585701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36827cb-7225-433e-a6e6-7157f39d9b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:05.606639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36827cb-7225-433e-a6e6-7157f39d9b06 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:05.660075 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 893/1776] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:06.171147 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b77d20-f809-49bc-af36-93da650149ce service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:06.403174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36827cb-7225-433e-a6e6-7157f39d9b06 service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:06.444417 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b77d20-f809-49bc-af36-93da650149ce service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:06.459581 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74450a-12d1-4f41-a29a-3f789c0d04a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:06.464684 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74450a-12d1-4f41-a29a-3f789c0d04a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:06.464844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36827cb-7225-433e-a6e6-7157f39d9b06 service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:06.465025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74450a-12d1-4f41-a29a-3f789c0d04a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:06.465025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74450a-12d1-4f41-a29a-3f789c0d04a3 admin admin] PATH_INFO: `/v3/users/308c1d7aec6b4acaa3fa233a9e954404` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:06.465025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74450a-12d1-4f41-a29a-3f789c0d04a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=308c1d7aec6b4acaa3fa233a9e954404)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:06.475098 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b74bab-55eb-49b8-bc7a-dbcbdc4faf64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:06.476964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b74bab-55eb-49b8-bc7a-dbcbdc4faf64 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:06.478398 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b74bab-55eb-49b8-bc7a-dbcbdc4faf64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:06.478941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b74bab-55eb-49b8-bc7a-dbcbdc4faf64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:06.482721 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-05b74bab-55eb-49b8-bc7a-dbcbdc4faf64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:06.487585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74450a-12d1-4f41-a29a-3f789c0d04a3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:06.620359 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:06.765752 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b74bab-55eb-49b8-bc7a-dbcbdc4faf64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:06.772626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b74bab-55eb-49b8-bc7a-dbcbdc4faf64 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:06.813534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 894/1777] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:06.994128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2b74450a-12d1-4f41-a29a-3f789c0d04a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308c1d7aec6b4acaa3fa233a9e954404'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:06.997626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2b74450a-12d1-4f41-a29a-3f789c0d04a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308c1d7aec6b4acaa3fa233a9e954404'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:07.069603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2b74450a-12d1-4f41-a29a-3f789c0d04a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308c1d7aec6b4acaa3fa233a9e954404'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:07.072986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2b74450a-12d1-4f41-a29a-3f789c0d04a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308c1d7aec6b4acaa3fa233a9e954404'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:07.332855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2b74450a-12d1-4f41-a29a-3f789c0d04a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308c1d7aec6b4acaa3fa233a9e954404'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:07.364005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 884/1778] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:06 2022] DELETE /identity/v3/users/308c1d7aec6b4acaa3fa233a9e954404 => generated 0 bytes in 1194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:07.372516 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e9816-aaf3-4e22-a4af-e2398ac45f49 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:07.373873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e9816-aaf3-4e22-a4af-e2398ac45f49 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:07.375632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e9816-aaf3-4e22-a4af-e2398ac45f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:07.435807 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-955e9816-aaf3-4e22-a4af-e2398ac45f49 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:07.444770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-955e9816-aaf3-4e22-a4af-e2398ac45f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:07.811275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 895/1779] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:07.952277 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74450a-12d1-4f41-a29a-3f789c0d04a3 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:07.957946 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2b74450a-12d1-4f41-a29a-3f789c0d04a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:08.127357 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a7b8c-a72b-40ea-a43f-c5ac3656121d None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:08.129101 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a7b8c-a72b-40ea-a43f-c5ac3656121d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:08.130102 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a7b8c-a72b-40ea-a43f-c5ac3656121d None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:08.133614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 896/1780] 10.222.0.98 () {54 vars in 921 bytes} [Tue Jul 26 15:21:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:21:08.215705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f93c6-0101-4e19-8a94-1fd22bea57c6 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:08.216356 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f93c6-0101-4e19-8a94-1fd22bea57c6 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:08.216945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f93c6-0101-4e19-8a94-1fd22bea57c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:08.306865 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-952f93c6-0101-4e19-8a94-1fd22bea57c6 None None] MFA Rules not processed for user `448161cd39dc4a6786c8813faa79376a`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:08.311667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-952f93c6-0101-4e19-8a94-1fd22bea57c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:08.348974 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74450a-12d1-4f41-a29a-3f789c0d04a3 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:08.400398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641418bf-5cd3-4381-89c4-cade84850e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:08.400398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641418bf-5cd3-4381-89c4-cade84850e09 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:08.400398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641418bf-5cd3-4381-89c4-cade84850e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:08.401148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641418bf-5cd3-4381-89c4-cade84850e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:08.472487 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641418bf-5cd3-4381-89c4-cade84850e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:08.476135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641418bf-5cd3-4381-89c4-cade84850e09 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:08.521217 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 885/1781] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:08.690843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 897/1782] 10.222.0.98 () {58 vars in 1018 bytes} [Tue Jul 26 15:21:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:21:08.731493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641418bf-5cd3-4381-89c4-cade84850e09 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:08.734578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-641418bf-5cd3-4381-89c4-cade84850e09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:08.755474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f93c6-0101-4e19-8a94-1fd22bea57c6 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:08.758797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-952f93c6-0101-4e19-8a94-1fd22bea57c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:08.787286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:08.813335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641418bf-5cd3-4381-89c4-cade84850e09 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:08.821524 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f93c6-0101-4e19-8a94-1fd22bea57c6 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:08.843767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c8e88-ce9c-4eec-a9e2-60977a01f656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:08.843767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c8e88-ce9c-4eec-a9e2-60977a01f656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:08.843767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c8e88-ce9c-4eec-a9e2-60977a01f656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:08.843767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c8e88-ce9c-4eec-a9e2-60977a01f656 admin admin] PATH_INFO: `/v3/users/8c2443bed4524175ada322cff385a15a` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:08.854164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c8e88-ce9c-4eec-a9e2-60977a01f656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2443bed4524175ada322cff385a15a)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:08.893131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03523e-f5d7-4548-ac44-e6e15e4c7fe9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:08.901913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c8e88-ce9c-4eec-a9e2-60977a01f656 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:08.903471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03523e-f5d7-4548-ac44-e6e15e4c7fe9 service placement] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:08.904342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03523e-f5d7-4548-ac44-e6e15e4c7fe9 service placement] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:08.905258 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03523e-f5d7-4548-ac44-e6e15e4c7fe9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:08.984104 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03523e-f5d7-4548-ac44-e6e15e4c7fe9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:08.987238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03523e-f5d7-4548-ac44-e6e15e4c7fe9 service placement] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:09.067831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 898/1783] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:09.367874 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5c9c8e88-ce9c-4eec-a9e2-60977a01f656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2443bed4524175ada322cff385a15a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:09.371723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5c9c8e88-ce9c-4eec-a9e2-60977a01f656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2443bed4524175ada322cff385a15a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:09.430975 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5c9c8e88-ce9c-4eec-a9e2-60977a01f656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2443bed4524175ada322cff385a15a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:09.433147 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5c9c8e88-ce9c-4eec-a9e2-60977a01f656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2443bed4524175ada322cff385a15a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:09.590050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5c9c8e88-ce9c-4eec-a9e2-60977a01f656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2443bed4524175ada322cff385a15a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:09.633389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 886/1784] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:08 2022] DELETE /identity/v3/users/8c2443bed4524175ada322cff385a15a => generated 0 bytes in 899 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:11.869625 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03523e-f5d7-4548-ac44-e6e15e4c7fe9 service placement] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:11.902515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03523e-f5d7-4548-ac44-e6e15e4c7fe9 service placement] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:11.994034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:12.017051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cfd3c-c8cf-4c51-a503-a047fb4f33fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:12.018648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cfd3c-c8cf-4c51-a503-a047fb4f33fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:12.019388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cfd3c-c8cf-4c51-a503-a047fb4f33fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:12.020597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cfd3c-c8cf-4c51-a503-a047fb4f33fa admin admin] PATH_INFO: `/v3/projects/35088fe10eb844229324f512b685c6bc` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:12.022379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cfd3c-c8cf-4c51-a503-a047fb4f33fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=35088fe10eb844229324f512b685c6bc)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:12.026716 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cfd3c-c8cf-4c51-a503-a047fb4f33fa admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:12.191618 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8a321-8ae0-4b2c-ae72-bd1de9c159c7 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:12.197668 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8a321-8ae0-4b2c-ae72-bd1de9c159c7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:12.198477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8a321-8ae0-4b2c-ae72-bd1de9c159c7 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:12.202233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 887/1785] 10.222.0.98 () {54 vars in 921 bytes} [Tue Jul 26 15:21:12 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:21:12.316099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa4fe0-821a-452b-b18f-dbe5ece53cf6 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:12.316603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa4fe0-821a-452b-b18f-dbe5ece53cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:12.317563 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa4fe0-821a-452b-b18f-dbe5ece53cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:12.338709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-791cfd3c-c8cf-4c51-a503-a047fb4f33fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35088fe10eb844229324f512b685c6bc', 'request_id': 'req-791cfd3c-c8cf-4c51-a503-a047fb4f33fa'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:12.423275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-91fa4fe0-821a-452b-b18f-dbe5ece53cf6 None None] MFA Rules not processed for user `a4a6c0e7ca434010980d7cac1800dbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:12.423275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-91fa4fe0-821a-452b-b18f-dbe5ece53cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:12.445642 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-791cfd3c-c8cf-4c51-a503-a047fb4f33fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35088fe10eb844229324f512b685c6bc', 'request_id': 'req-791cfd3c-c8cf-4c51-a503-a047fb4f33fa'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:12.468093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-791cfd3c-c8cf-4c51-a503-a047fb4f33fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35088fe10eb844229324f512b685c6bc', 'request_id': 'req-791cfd3c-c8cf-4c51-a503-a047fb4f33fa'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:12.549928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-791cfd3c-c8cf-4c51-a503-a047fb4f33fa admin admin] The token cache is being invalidate because project 35088fe10eb844229324f512b685c6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:12.551872 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-791cfd3c-c8cf-4c51-a503-a047fb4f33fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:12.556150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-791cfd3c-c8cf-4c51-a503-a047fb4f33fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:12.564571 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 899/1786] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:11 2022] DELETE /identity/v3/projects/35088fe10eb844229324f512b685c6bc => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:12.612347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d08bc-aa3f-4331-8e73-84ab90a60cd5 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:12.612347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d08bc-aa3f-4331-8e73-84ab90a60cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:12.612347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d08bc-aa3f-4331-8e73-84ab90a60cd5 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:12.612347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 900/1787] 10.222.0.98 () {54 vars in 921 bytes} [Tue Jul 26 15:21:12 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:21:12.612347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8448f0-01d7-4cb4-a230-5a7de348efd5 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:12.612347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8448f0-01d7-4cb4-a230-5a7de348efd5 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:12.613148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8448f0-01d7-4cb4-a230-5a7de348efd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:12.797256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-ec8448f0-01d7-4cb4-a230-5a7de348efd5 None None] MFA Rules not processed for user `a4a6c0e7ca434010980d7cac1800dbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:12.804824 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ec8448f0-01d7-4cb4-a230-5a7de348efd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:12.806796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 888/1788] 10.222.0.98 () {58 vars in 1018 bytes} [Tue Jul 26 15:21:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:21:12.808897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa4fe0-821a-452b-b18f-dbe5ece53cf6 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:12.813519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-91fa4fe0-821a-452b-b18f-dbe5ece53cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:12.874026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 901/1789] 10.222.0.98 () {58 vars in 1018 bytes} [Tue Jul 26 15:21:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:13.292093 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa4fe0-821a-452b-b18f-dbe5ece53cf6 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:13.317010 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b2eb3-a920-4bb7-a819-bcc1920fc2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:13.317704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b2eb3-a920-4bb7-a819-bcc1920fc2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:13.318259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b2eb3-a920-4bb7-a819-bcc1920fc2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:13.318803 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b2eb3-a920-4bb7-a819-bcc1920fc2be admin admin] PATH_INFO: `/v3/users/a7a2434f3965434e95edc351e9e018b2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:13.320828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b2eb3-a920-4bb7-a819-bcc1920fc2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a2434f3965434e95edc351e9e018b2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:13.325488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b2eb3-a920-4bb7-a819-bcc1920fc2be admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:13.377796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:13.745862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-120b2eb3-a920-4bb7-a819-bcc1920fc2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a2434f3965434e95edc351e9e018b2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:13.748836 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-120b2eb3-a920-4bb7-a819-bcc1920fc2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a2434f3965434e95edc351e9e018b2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:13.783465 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8448f0-01d7-4cb4-a230-5a7de348efd5 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:13.786531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ec8448f0-01d7-4cb4-a230-5a7de348efd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:13.797993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-120b2eb3-a920-4bb7-a819-bcc1920fc2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a2434f3965434e95edc351e9e018b2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:13.799173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-120b2eb3-a920-4bb7-a819-bcc1920fc2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a2434f3965434e95edc351e9e018b2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:13.862678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8448f0-01d7-4cb4-a230-5a7de348efd5 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:13.880649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5ce63-3474-4886-b0c5-2755a579f9c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:13.880649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5ce63-3474-4886-b0c5-2755a579f9c3 service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:13.880649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5ce63-3474-4886-b0c5-2755a579f9c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:13.880649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5ce63-3474-4886-b0c5-2755a579f9c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:13.887945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-bfa5ce63-3474-4886-b0c5-2755a579f9c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:13.950420 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-120b2eb3-a920-4bb7-a819-bcc1920fc2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a2434f3965434e95edc351e9e018b2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:13.961701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5ce63-3474-4886-b0c5-2755a579f9c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:13.969391 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5ce63-3474-4886-b0c5-2755a579f9c3 service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:14.003771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 889/1790] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:12 2022] DELETE /identity/v3/users/a7a2434f3965434e95edc351e9e018b2 => generated 0 bytes in 1187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:14.011936 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 902/1791] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:21:14.214052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b2eb3-a920-4bb7-a819-bcc1920fc2be admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:14.216650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-120b2eb3-a920-4bb7-a819-bcc1920fc2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:14.226200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5ce63-3474-4886-b0c5-2755a579f9c3 service nova] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:14.229965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-bfa5ce63-3474-4886-b0c5-2755a579f9c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:14.272941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5ce63-3474-4886-b0c5-2755a579f9c3 service nova] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:14.511170 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b2eb3-a920-4bb7-a819-bcc1920fc2be admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:14.531869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e6400-d41b-42f0-9377-3a795577f748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:14.536324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e6400-d41b-42f0-9377-3a795577f748 service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:14.536324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e6400-d41b-42f0-9377-3a795577f748 service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:14.536324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e6400-d41b-42f0-9377-3a795577f748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:14.540908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdd595-9076-4475-a6a2-008fbc3fe491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:14.544847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-1f9e6400-d41b-42f0-9377-3a795577f748 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:14.552906 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdd595-9076-4475-a6a2-008fbc3fe491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:14.553261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdd595-9076-4475-a6a2-008fbc3fe491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:14.553715 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdd595-9076-4475-a6a2-008fbc3fe491 admin admin] PATH_INFO: `/v3/projects/68c3176c2e284b2db425e4731acad803` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:14.556542 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdd595-9076-4475-a6a2-008fbc3fe491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c3176c2e284b2db425e4731acad803)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:14.558903 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdd595-9076-4475-a6a2-008fbc3fe491 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:14.619023 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e6400-d41b-42f0-9377-3a795577f748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:14.627971 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e6400-d41b-42f0-9377-3a795577f748 service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:14.669776 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 903/1792] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:21:14.800669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-38bdd595-9076-4475-a6a2-008fbc3fe491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c3176c2e284b2db425e4731acad803', 'request_id': 'req-38bdd595-9076-4475-a6a2-008fbc3fe491'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:14.823311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-38bdd595-9076-4475-a6a2-008fbc3fe491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c3176c2e284b2db425e4731acad803', 'request_id': 'req-38bdd595-9076-4475-a6a2-008fbc3fe491'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:14.872343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-38bdd595-9076-4475-a6a2-008fbc3fe491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c3176c2e284b2db425e4731acad803', 'request_id': 'req-38bdd595-9076-4475-a6a2-008fbc3fe491'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:14.988251 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-38bdd595-9076-4475-a6a2-008fbc3fe491 admin admin] The token cache is being invalidate because project 68c3176c2e284b2db425e4731acad803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:14.991052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-38bdd595-9076-4475-a6a2-008fbc3fe491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:14.992410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-38bdd595-9076-4475-a6a2-008fbc3fe491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:15.001797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 890/1793] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:14 2022] DELETE /identity/v3/projects/68c3176c2e284b2db425e4731acad803 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:15.009831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e6400-d41b-42f0-9377-3a795577f748 service nova] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:15.051798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e6400-d41b-42f0-9377-3a795577f748 service nova] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:15.175344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:15.210464 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1054031-34dc-410d-86ab-c897c92592a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:15.211787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1054031-34dc-410d-86ab-c897c92592a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:15.212145 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1054031-34dc-410d-86ab-c897c92592a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:15.212460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1054031-34dc-410d-86ab-c897c92592a4 admin admin] PATH_INFO: `/v3/users/c3da758acdf64057bf0e20c3b79d38b8` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:15.214946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1054031-34dc-410d-86ab-c897c92592a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3da758acdf64057bf0e20c3b79d38b8)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:15.218902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1054031-34dc-410d-86ab-c897c92592a4 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:15.571984 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdd595-9076-4475-a6a2-008fbc3fe491 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:15.575590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-38bdd595-9076-4475-a6a2-008fbc3fe491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:15.607227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdd595-9076-4475-a6a2-008fbc3fe491 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:15.630565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e1054031-34dc-410d-86ab-c897c92592a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3da758acdf64057bf0e20c3b79d38b8'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:15.630565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e1054031-34dc-410d-86ab-c897c92592a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3da758acdf64057bf0e20c3b79d38b8'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:15.631917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e7850-0b77-48e4-9823-d18beaec4b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:15.631917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e7850-0b77-48e4-9823-d18beaec4b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:15.631917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e7850-0b77-48e4-9823-d18beaec4b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:15.631917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e7850-0b77-48e4-9823-d18beaec4b0b admin admin] PATH_INFO: `/v3/users/ae434617b92b463fbbe923aca84e74f9` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:15.632430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e7850-0b77-48e4-9823-d18beaec4b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae434617b92b463fbbe923aca84e74f9)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:15.632430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e7850-0b77-48e4-9823-d18beaec4b0b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:15.654863 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e1054031-34dc-410d-86ab-c897c92592a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3da758acdf64057bf0e20c3b79d38b8'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:15.815271 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e1054031-34dc-410d-86ab-c897c92592a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3da758acdf64057bf0e20c3b79d38b8'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:15.816687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e1054031-34dc-410d-86ab-c897c92592a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3da758acdf64057bf0e20c3b79d38b8'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:15.858232 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 904/1794] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:15 2022] DELETE /identity/v3/users/c3da758acdf64057bf0e20c3b79d38b8 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:15.941132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:15.980644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0d5e7850-0b77-48e4-9823-d18beaec4b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae434617b92b463fbbe923aca84e74f9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:15.982461 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0d5e7850-0b77-48e4-9823-d18beaec4b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae434617b92b463fbbe923aca84e74f9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:16.033866 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0d5e7850-0b77-48e4-9823-d18beaec4b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae434617b92b463fbbe923aca84e74f9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:16.035785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0d5e7850-0b77-48e4-9823-d18beaec4b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae434617b92b463fbbe923aca84e74f9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:16.165664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1054031-34dc-410d-86ab-c897c92592a4 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:16.168179 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e1054031-34dc-410d-86ab-c897c92592a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:16.227665 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0d5e7850-0b77-48e4-9823-d18beaec4b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae434617b92b463fbbe923aca84e74f9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:16.270708 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 891/1795] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:15 2022] DELETE /identity/v3/users/ae434617b92b463fbbe923aca84e74f9 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:21:16.279786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35f583-1922-4f8b-b818-e3a1618e5431 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:16.280361 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35f583-1922-4f8b-b818-e3a1618e5431 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:16.280821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35f583-1922-4f8b-b818-e3a1618e5431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:16.319084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ec35f583-1922-4f8b-b818-e3a1618e5431 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:16.341265 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ec35f583-1922-4f8b-b818-e3a1618e5431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:16.355782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1054031-34dc-410d-86ab-c897c92592a4 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:16.539996 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 892/1796] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:16.595388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35f583-1922-4f8b-b818-e3a1618e5431 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:16.598078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ec35f583-1922-4f8b-b818-e3a1618e5431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:16.672422 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1621a27-94a0-4038-91cf-772c0beac092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:16.673349 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1621a27-94a0-4038-91cf-772c0beac092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:16.673737 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1621a27-94a0-4038-91cf-772c0beac092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:16.674199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1621a27-94a0-4038-91cf-772c0beac092 admin admin] PATH_INFO: `/v3/users/6a6ff94fbb48456299748838b7c93626` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:16.676457 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1621a27-94a0-4038-91cf-772c0beac092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6ff94fbb48456299748838b7c93626)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:16.678828 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1621a27-94a0-4038-91cf-772c0beac092 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:16.796290 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35f583-1922-4f8b-b818-e3a1618e5431 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:16.807331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6c05e-1188-40c3-abda-3597d099e5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:16.808174 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6c05e-1188-40c3-abda-3597d099e5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:16.808467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6c05e-1188-40c3-abda-3597d099e5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:16.808753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6c05e-1188-40c3-abda-3597d099e5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:16.847696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6c05e-1188-40c3-abda-3597d099e5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:16.849512 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6c05e-1188-40c3-abda-3597d099e5f8 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:16.881615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 893/1797] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:16.881615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6c05e-1188-40c3-abda-3597d099e5f8 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:16.881615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-17f6c05e-1188-40c3-abda-3597d099e5f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:16.913562 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6c05e-1188-40c3-abda-3597d099e5f8 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:16.936226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e1107-1a64-43a6-bd68-4ad79bfdcda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:16.938214 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e1107-1a64-43a6-bd68-4ad79bfdcda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:16.939604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e1107-1a64-43a6-bd68-4ad79bfdcda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:16.940187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e1107-1a64-43a6-bd68-4ad79bfdcda1 admin admin] PATH_INFO: `/v3/projects/178ffbad2742425aa61f7cf75419ea43` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:16.947158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e1107-1a64-43a6-bd68-4ad79bfdcda1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=178ffbad2742425aa61f7cf75419ea43)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:16.960871 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e1107-1a64-43a6-bd68-4ad79bfdcda1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:17.036645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e1621a27-94a0-4038-91cf-772c0beac092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6ff94fbb48456299748838b7c93626'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:17.042575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e1621a27-94a0-4038-91cf-772c0beac092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6ff94fbb48456299748838b7c93626'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:17.107178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e1621a27-94a0-4038-91cf-772c0beac092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6ff94fbb48456299748838b7c93626'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:17.262289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e1621a27-94a0-4038-91cf-772c0beac092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6ff94fbb48456299748838b7c93626'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:17.264620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e1621a27-94a0-4038-91cf-772c0beac092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6ff94fbb48456299748838b7c93626'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:17.270410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-138e1107-1a64-43a6-bd68-4ad79bfdcda1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178ffbad2742425aa61f7cf75419ea43', 'request_id': 'req-138e1107-1a64-43a6-bd68-4ad79bfdcda1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:17.318787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 905/1798] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:16 2022] DELETE /identity/v3/users/6a6ff94fbb48456299748838b7c93626 => generated 0 bytes in 1155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:21:17.329386 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25bd77-42d2-4d7d-b29b-464ff79d7191 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:17.331172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25bd77-42d2-4d7d-b29b-464ff79d7191 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:17.332346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25bd77-42d2-4d7d-b29b-464ff79d7191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:17.337228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-138e1107-1a64-43a6-bd68-4ad79bfdcda1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178ffbad2742425aa61f7cf75419ea43', 'request_id': 'req-138e1107-1a64-43a6-bd68-4ad79bfdcda1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:17.365326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-138e1107-1a64-43a6-bd68-4ad79bfdcda1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178ffbad2742425aa61f7cf75419ea43', 'request_id': 'req-138e1107-1a64-43a6-bd68-4ad79bfdcda1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:17.410087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-3a25bd77-42d2-4d7d-b29b-464ff79d7191 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:17.422417 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3a25bd77-42d2-4d7d-b29b-464ff79d7191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:17.458234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:17.525832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-138e1107-1a64-43a6-bd68-4ad79bfdcda1 admin admin] The token cache is being invalidate because project 178ffbad2742425aa61f7cf75419ea43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:17.526222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-138e1107-1a64-43a6-bd68-4ad79bfdcda1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:17.531049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-138e1107-1a64-43a6-bd68-4ad79bfdcda1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:17.542025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 894/1799] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:16 2022] DELETE /identity/v3/projects/178ffbad2742425aa61f7cf75419ea43 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:17.544765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb08149-2602-4de5-b414-a687a7c4e0b5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:17.547543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb08149-2602-4de5-b414-a687a7c4e0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:17.548059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb08149-2602-4de5-b414-a687a7c4e0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:17.617817 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3eb08149-2602-4de5-b414-a687a7c4e0b5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:17.622743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3eb08149-2602-4de5-b414-a687a7c4e0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:17.644419 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 895/1800] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:17.646499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 906/1801] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:17.655639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf88ba8-db73-40b9-a08b-e0ca5aadddf0 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:17.657300 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf88ba8-db73-40b9-a08b-e0ca5aadddf0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:17.658149 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf88ba8-db73-40b9-a08b-e0ca5aadddf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:17.716412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:17.724369 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-daf88ba8-db73-40b9-a08b-e0ca5aadddf0 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:17.729112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-daf88ba8-db73-40b9-a08b-e0ca5aadddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:17.751008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 896/1802] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:17.757689 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25bd77-42d2-4d7d-b29b-464ff79d7191 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:17.802304 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25bd77-42d2-4d7d-b29b-464ff79d7191 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:17.808198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf88ba8-db73-40b9-a08b-e0ca5aadddf0 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:17.812271 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-daf88ba8-db73-40b9-a08b-e0ca5aadddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:17.840329 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70f7da-9c2d-4715-9fe2-c83f7f6a2efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:17.844878 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70f7da-9c2d-4715-9fe2-c83f7f6a2efc admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:17.844878 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70f7da-9c2d-4715-9fe2-c83f7f6a2efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:17.844878 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70f7da-9c2d-4715-9fe2-c83f7f6a2efc admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:17.844878 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70f7da-9c2d-4715-9fe2-c83f7f6a2efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:21:17.844878 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70f7da-9c2d-4715-9fe2-c83f7f6a2efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:17.867152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70f7da-9c2d-4715-9fe2-c83f7f6a2efc admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:17.958814 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 907/1803] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:21:17.964165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70f7da-9c2d-4715-9fe2-c83f7f6a2efc admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:18.030606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70f7da-9c2d-4715-9fe2-c83f7f6a2efc admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:18.041143 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476102f-e632-4169-a8c4-dbeac27d729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:18.042440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476102f-e632-4169-a8c4-dbeac27d729d admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:18.047790 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476102f-e632-4169-a8c4-dbeac27d729d admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:18.048060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476102f-e632-4169-a8c4-dbeac27d729d admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:18.048901 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476102f-e632-4169-a8c4-dbeac27d729d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:18.053002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476102f-e632-4169-a8c4-dbeac27d729d admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:18.067914 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf88ba8-db73-40b9-a08b-e0ca5aadddf0 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:18.126785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa267a2b-7b66-4165-987c-25abd6fa89c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:18.127915 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa267a2b-7b66-4165-987c-25abd6fa89c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:18.128405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa267a2b-7b66-4165-987c-25abd6fa89c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:18.128903 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa267a2b-7b66-4165-987c-25abd6fa89c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:18.228693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa267a2b-7b66-4165-987c-25abd6fa89c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:18.232166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa267a2b-7b66-4165-987c-25abd6fa89c0 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:18.291380 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 897/1804] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:18.291636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 908/1805] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:17 2022] POST /identity/v3/projects => generated 383 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:18.292982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa267a2b-7b66-4165-987c-25abd6fa89c0 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:18.332142 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa267a2b-7b66-4165-987c-25abd6fa89c0 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:18.517846 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafdd50-a8f4-44f3-8c2b-3c7492152a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:18.518828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafdd50-a8f4-44f3-8c2b-3c7492152a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:18.519338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafdd50-a8f4-44f3-8c2b-3c7492152a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:18.519823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafdd50-a8f4-44f3-8c2b-3c7492152a30 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:18.520702 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafdd50-a8f4-44f3-8c2b-3c7492152a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:18.546029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafdd50-a8f4-44f3-8c2b-3c7492152a30 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:18.700177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 898/1806] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:18 2022] POST /identity/v3/users => generated 292 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:18.701241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476102f-e632-4169-a8c4-dbeac27d729d admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:18.715275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476102f-e632-4169-a8c4-dbeac27d729d admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:18.738342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9502ab-da17-44cd-b9e0-3e2cbbdca9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:18.738342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9502ab-da17-44cd-b9e0-3e2cbbdca9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:18.738342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9502ab-da17-44cd-b9e0-3e2cbbdca9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:18.738342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9502ab-da17-44cd-b9e0-3e2cbbdca9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:18.739760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9502ab-da17-44cd-b9e0-3e2cbbdca9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:18.739760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9502ab-da17-44cd-b9e0-3e2cbbdca9b6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:18.777299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 909/1807] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:21:18.779624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafdd50-a8f4-44f3-8c2b-3c7492152a30 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:18.821618 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafdd50-a8f4-44f3-8c2b-3c7492152a30 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:18.852572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce19cfd-6a0b-4c99-a780-bd37fcd649e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:18.855411 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce19cfd-6a0b-4c99-a780-bd37fcd649e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:18.855620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce19cfd-6a0b-4c99-a780-bd37fcd649e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:18.856048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce19cfd-6a0b-4c99-a780-bd37fcd649e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:18.857484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce19cfd-6a0b-4c99-a780-bd37fcd649e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:18.865925 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce19cfd-6a0b-4c99-a780-bd37fcd649e8 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:18.934982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 899/1808] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:18.936711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9502ab-da17-44cd-b9e0-3e2cbbdca9b6 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:18.982237 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9502ab-da17-44cd-b9e0-3e2cbbdca9b6 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:19.009649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869dbd1-e0f2-4662-ad64-dcdde20265f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:19.014633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869dbd1-e0f2-4662-ad64-dcdde20265f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:19.015606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869dbd1-e0f2-4662-ad64-dcdde20265f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:19.016463 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869dbd1-e0f2-4662-ad64-dcdde20265f8 admin admin] PATH_INFO: `/v3/projects/5fa43e76d313421ca2ea897390f2556f/users/971076f603af4e6aa5e15c3c6457fa57/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:19.092881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869dbd1-e0f2-4662-ad64-dcdde20265f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa43e76d313421ca2ea897390f2556f, user_id=971076f603af4e6aa5e15c3c6457fa57, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:19.117918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869dbd1-e0f2-4662-ad64-dcdde20265f8 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:19.309207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 910/1809] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:18 2022] PUT /identity/v3/projects/5fa43e76d313421ca2ea897390f2556f/users/971076f603af4e6aa5e15c3c6457fa57/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:19.323499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfb028-f622-4652-a38f-3c458e19ad85 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:19.324111 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfb028-f622-4652-a38f-3c458e19ad85 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:19.324669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfb028-f622-4652-a38f-3c458e19ad85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:19.404938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-0bdfb028-f622-4652-a38f-3c458e19ad85 None None] MFA Rules not processed for user `971076f603af4e6aa5e15c3c6457fa57`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:19.407428 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0bdfb028-f622-4652-a38f-3c458e19ad85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:19.447839 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:19.645211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 900/1810] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:19.648160 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869dbd1-e0f2-4662-ad64-dcdde20265f8 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:19.746579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:19.929676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869dbd1-e0f2-4662-ad64-dcdde20265f8 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:19.964948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd363c-46ea-4167-a797-ef83772f305e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:19.966322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd363c-46ea-4167-a797-ef83772f305e admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:19.966883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd363c-46ea-4167-a797-ef83772f305e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:19.967391 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd363c-46ea-4167-a797-ef83772f305e admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:19.970262 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd363c-46ea-4167-a797-ef83772f305e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:19.979490 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd363c-46ea-4167-a797-ef83772f305e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:20.010892 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfb028-f622-4652-a38f-3c458e19ad85 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:20.013300 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0bdfb028-f622-4652-a38f-3c458e19ad85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:20.063275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfb028-f622-4652-a38f-3c458e19ad85 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:20.078884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77319749-7206-42b1-9a3c-b33d02085b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:20.078884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77319749-7206-42b1-9a3c-b33d02085b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:20.078884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77319749-7206-42b1-9a3c-b33d02085b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:20.078884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77319749-7206-42b1-9a3c-b33d02085b03 admin admin] PATH_INFO: `/v3/projects/32098043f909473db847df9896329764` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:20.079226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77319749-7206-42b1-9a3c-b33d02085b03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32098043f909473db847df9896329764)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:20.080533 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77319749-7206-42b1-9a3c-b33d02085b03 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:20.236092 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 911/1811] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:19 2022] POST /identity/v3/projects => generated 383 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:20.241938 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd363c-46ea-4167-a797-ef83772f305e admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:20.249052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-9dfd363c-46ea-4167-a797-ef83772f305e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:20.421309 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd363c-46ea-4167-a797-ef83772f305e admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:20.440648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d99f13-ed9e-432e-ad06-960adc2183aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:20.442214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d99f13-ed9e-432e-ad06-960adc2183aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:20.444095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d99f13-ed9e-432e-ad06-960adc2183aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:20.444709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d99f13-ed9e-432e-ad06-960adc2183aa admin admin] PATH_INFO: `/v3/projects/380f83b0ea434d01bed35c4bfeca0833` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:20.448381 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d99f13-ed9e-432e-ad06-960adc2183aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=380f83b0ea434d01bed35c4bfeca0833)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:20.452555 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d99f13-ed9e-432e-ad06-960adc2183aa admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:20.517452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-77319749-7206-42b1-9a3c-b33d02085b03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32098043f909473db847df9896329764', 'request_id': 'req-77319749-7206-42b1-9a3c-b33d02085b03'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:20.567964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-77319749-7206-42b1-9a3c-b33d02085b03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32098043f909473db847df9896329764', 'request_id': 'req-77319749-7206-42b1-9a3c-b33d02085b03'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:20.598893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-77319749-7206-42b1-9a3c-b33d02085b03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32098043f909473db847df9896329764', 'request_id': 'req-77319749-7206-42b1-9a3c-b33d02085b03'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:20.759597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-20d99f13-ed9e-432e-ad06-960adc2183aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380f83b0ea434d01bed35c4bfeca0833', 'request_id': 'req-20d99f13-ed9e-432e-ad06-960adc2183aa'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:20.787500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-77319749-7206-42b1-9a3c-b33d02085b03 admin admin] The token cache is being invalidate because project 32098043f909473db847df9896329764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:20.788202 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-77319749-7206-42b1-9a3c-b33d02085b03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:20.790912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-77319749-7206-42b1-9a3c-b33d02085b03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:20.798611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 901/1812] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:20 2022] DELETE /identity/v3/projects/32098043f909473db847df9896329764 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:20.798611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77319749-7206-42b1-9a3c-b33d02085b03 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:20.798611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-77319749-7206-42b1-9a3c-b33d02085b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:20.939348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-20d99f13-ed9e-432e-ad06-960adc2183aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380f83b0ea434d01bed35c4bfeca0833', 'request_id': 'req-20d99f13-ed9e-432e-ad06-960adc2183aa'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:20.965457 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-20d99f13-ed9e-432e-ad06-960adc2183aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380f83b0ea434d01bed35c4bfeca0833', 'request_id': 'req-20d99f13-ed9e-432e-ad06-960adc2183aa'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:21.000675 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-20d99f13-ed9e-432e-ad06-960adc2183aa admin admin] The token cache is being invalidate because project 380f83b0ea434d01bed35c4bfeca0833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:21.001091 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-20d99f13-ed9e-432e-ad06-960adc2183aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:21.009248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-20d99f13-ed9e-432e-ad06-960adc2183aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:21.012932 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 912/1813] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:20 2022] DELETE /identity/v3/projects/380f83b0ea434d01bed35c4bfeca0833 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:21.014990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d99f13-ed9e-432e-ad06-960adc2183aa admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:21.018623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-20d99f13-ed9e-432e-ad06-960adc2183aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:21.056490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77319749-7206-42b1-9a3c-b33d02085b03 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:21.144452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:21.154790 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:21.193535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4756839-ac0a-4cbd-a5cc-850bd6174970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:21.195009 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4756839-ac0a-4cbd-a5cc-850bd6174970 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:21.196354 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4756839-ac0a-4cbd-a5cc-850bd6174970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:21.196973 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4756839-ac0a-4cbd-a5cc-850bd6174970 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:21.201013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4756839-ac0a-4cbd-a5cc-850bd6174970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:21.213663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4756839-ac0a-4cbd-a5cc-850bd6174970 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:21.253066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d99f13-ed9e-432e-ad06-960adc2183aa admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:21.261178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05154caa-77ac-45e3-978b-0c87edb48081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:21.262093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05154caa-77ac-45e3-978b-0c87edb48081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:21.262600 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05154caa-77ac-45e3-978b-0c87edb48081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:21.263118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05154caa-77ac-45e3-978b-0c87edb48081 admin admin] PATH_INFO: `/v3/projects/18702931ec5f4ca3a5f6b2efb4d5c296` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:21.268981 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05154caa-77ac-45e3-978b-0c87edb48081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18702931ec5f4ca3a5f6b2efb4d5c296)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:21.272694 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05154caa-77ac-45e3-978b-0c87edb48081 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:21.437915 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 902/1814] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:20 2022] POST /identity/v3/users => generated 298 bytes in 644 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:21.453889 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4756839-ac0a-4cbd-a5cc-850bd6174970 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:21.466551 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e4756839-ac0a-4cbd-a5cc-850bd6174970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:21.527061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4756839-ac0a-4cbd-a5cc-850bd6174970 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:21.527182 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05154caa-77ac-45e3-978b-0c87edb48081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18702931ec5f4ca3a5f6b2efb4d5c296', 'request_id': 'req-05154caa-77ac-45e3-978b-0c87edb48081'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:21.674934 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72230cfc-2563-4787-84f3-7bf5a2eb01d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:21.689081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72230cfc-2563-4787-84f3-7bf5a2eb01d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:21.689081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72230cfc-2563-4787-84f3-7bf5a2eb01d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:21.689081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72230cfc-2563-4787-84f3-7bf5a2eb01d0 admin admin] PATH_INFO: `/v3/users/6960580a40644e75ad4ca5e4e8ce41af` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:21.689081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72230cfc-2563-4787-84f3-7bf5a2eb01d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6960580a40644e75ad4ca5e4e8ce41af)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:21.689081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72230cfc-2563-4787-84f3-7bf5a2eb01d0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:21.952788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05154caa-77ac-45e3-978b-0c87edb48081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18702931ec5f4ca3a5f6b2efb4d5c296', 'request_id': 'req-05154caa-77ac-45e3-978b-0c87edb48081'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:21.963672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05154caa-77ac-45e3-978b-0c87edb48081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18702931ec5f4ca3a5f6b2efb4d5c296', 'request_id': 'req-05154caa-77ac-45e3-978b-0c87edb48081'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:21.979578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05154caa-77ac-45e3-978b-0c87edb48081 admin admin] The token cache is being invalidate because project 18702931ec5f4ca3a5f6b2efb4d5c296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:21.979931 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05154caa-77ac-45e3-978b-0c87edb48081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:21.980818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05154caa-77ac-45e3-978b-0c87edb48081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:21.982802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 913/1815] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:21 2022] DELETE /identity/v3/projects/18702931ec5f4ca3a5f6b2efb4d5c296 => generated 0 bytes in 969 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:21.984983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8e261-9690-485e-b958-236cf6204dc2 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:21.985361 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8e261-9690-485e-b958-236cf6204dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:21.985796 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8e261-9690-485e-b958-236cf6204dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:22.013854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-e6e8e261-9690-485e-b958-236cf6204dc2 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:22.015485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e6e8e261-9690-485e-b958-236cf6204dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:22.035091 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 914/1816] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:22.035091 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8e261-9690-485e-b958-236cf6204dc2 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:22.037692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e6e8e261-9690-485e-b958-236cf6204dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:22.061351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8e261-9690-485e-b958-236cf6204dc2 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:22.073604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8705a-927e-4643-9d89-e7d33ad97c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:22.077994 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8705a-927e-4643-9d89-e7d33ad97c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:22.079136 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8705a-927e-4643-9d89-e7d33ad97c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:22.081085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8705a-927e-4643-9d89-e7d33ad97c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:22.089230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8705a-927e-4643-9d89-e7d33ad97c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:22.089230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8705a-927e-4643-9d89-e7d33ad97c65 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:22.119128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 915/1817] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:22.120264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8705a-927e-4643-9d89-e7d33ad97c65 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:22.125247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-74e8705a-927e-4643-9d89-e7d33ad97c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:22.154768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8705a-927e-4643-9d89-e7d33ad97c65 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:22.164358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1494e4-8223-4d3f-b5cb-735821c88230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:22.165448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1494e4-8223-4d3f-b5cb-735821c88230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:22.165935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1494e4-8223-4d3f-b5cb-735821c88230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:22.166482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1494e4-8223-4d3f-b5cb-735821c88230 admin admin] PATH_INFO: `/v3/users/69adf25dc4a046dd936023f6b22f3c87` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:22.168992 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1494e4-8223-4d3f-b5cb-735821c88230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69adf25dc4a046dd936023f6b22f3c87)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:22.173580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1494e4-8223-4d3f-b5cb-735821c88230 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:22.408140 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-72230cfc-2563-4787-84f3-7bf5a2eb01d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6960580a40644e75ad4ca5e4e8ce41af'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:22.409961 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-72230cfc-2563-4787-84f3-7bf5a2eb01d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6960580a40644e75ad4ca5e4e8ce41af'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:22.427987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-72230cfc-2563-4787-84f3-7bf5a2eb01d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6960580a40644e75ad4ca5e4e8ce41af'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:22.432707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-72230cfc-2563-4787-84f3-7bf5a2eb01d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6960580a40644e75ad4ca5e4e8ce41af'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:22.570496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-72230cfc-2563-4787-84f3-7bf5a2eb01d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6960580a40644e75ad4ca5e4e8ce41af'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:22.596743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1c1494e4-8223-4d3f-b5cb-735821c88230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69adf25dc4a046dd936023f6b22f3c87'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:22.597750 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1c1494e4-8223-4d3f-b5cb-735821c88230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69adf25dc4a046dd936023f6b22f3c87'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:22.609976 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 903/1818] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:21 2022] DELETE /identity/v3/users/6960580a40644e75ad4ca5e4e8ce41af => generated 0 bytes in 1157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:22.613127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a570a8b-79b3-4fa8-96ea-0a48c1aac04f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:22.613127 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a570a8b-79b3-4fa8-96ea-0a48c1aac04f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:22.613491 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a570a8b-79b3-4fa8-96ea-0a48c1aac04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:22.628973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1c1494e4-8223-4d3f-b5cb-735821c88230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69adf25dc4a046dd936023f6b22f3c87'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:22.640756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5a570a8b-79b3-4fa8-96ea-0a48c1aac04f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:22.641812 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5a570a8b-79b3-4fa8-96ea-0a48c1aac04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:22.758778 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1c1494e4-8223-4d3f-b5cb-735821c88230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69adf25dc4a046dd936023f6b22f3c87'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:22.759872 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1c1494e4-8223-4d3f-b5cb-735821c88230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69adf25dc4a046dd936023f6b22f3c87'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:22.767275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 904/1819] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:22.768779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a570a8b-79b3-4fa8-96ea-0a48c1aac04f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:22.770624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5a570a8b-79b3-4fa8-96ea-0a48c1aac04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:22.787306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a570a8b-79b3-4fa8-96ea-0a48c1aac04f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:22.787905 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 916/1820] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:22 2022] DELETE /identity/v3/users/69adf25dc4a046dd936023f6b22f3c87 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:22.790749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1494e4-8223-4d3f-b5cb-735821c88230 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:22.916589 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363a41f-24d9-4292-914c-273d208e397b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:22.918533 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363a41f-24d9-4292-914c-273d208e397b admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:22.919074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363a41f-24d9-4292-914c-273d208e397b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:22.919524 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363a41f-24d9-4292-914c-273d208e397b admin admin] PATH_INFO: `/v3/projects/259306ae6f4b47e6833dc816644601bc/users/abcd8dd39e14458f856df264052faf12/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:22.929492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1494e4-8223-4d3f-b5cb-735821c88230 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:22.937515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230648c4-b603-4d39-9eda-161c2cabcad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:22.938316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230648c4-b603-4d39-9eda-161c2cabcad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:22.938827 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230648c4-b603-4d39-9eda-161c2cabcad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:22.939208 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230648c4-b603-4d39-9eda-161c2cabcad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:22.940044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230648c4-b603-4d39-9eda-161c2cabcad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:21:22.940456 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230648c4-b603-4d39-9eda-161c2cabcad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:22.942255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230648c4-b603-4d39-9eda-161c2cabcad4 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:22.964202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 917/1821] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:21:22.965561 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230648c4-b603-4d39-9eda-161c2cabcad4 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:22.970623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363a41f-24d9-4292-914c-273d208e397b admin admin] RBAC: Authorizing `identity:create_grant(project_id=259306ae6f4b47e6833dc816644601bc, user_id=abcd8dd39e14458f856df264052faf12, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:22.976763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363a41f-24d9-4292-914c-273d208e397b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:22.993587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230648c4-b603-4d39-9eda-161c2cabcad4 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:23.022577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20b7c8-44ee-467d-833c-690b9546308d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:23.024383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20b7c8-44ee-467d-833c-690b9546308d admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:23.024609 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:23.024779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20b7c8-44ee-467d-833c-690b9546308d admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:23.025253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20b7c8-44ee-467d-833c-690b9546308d admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:23.032065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20b7c8-44ee-467d-833c-690b9546308d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:23.036186 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20b7c8-44ee-467d-833c-690b9546308d admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:23.118951 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 905/1822] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:22 2022] PUT /identity/v3/projects/259306ae6f4b47e6833dc816644601bc/users/abcd8dd39e14458f856df264052faf12/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:23.129321 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363a41f-24d9-4292-914c-273d208e397b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:23.143025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:23.244705 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363a41f-24d9-4292-914c-273d208e397b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:23.251428 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c1654-6420-49de-9d36-1679743e97ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:23.252201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c1654-6420-49de-9d36-1679743e97ee admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:23.252573 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c1654-6420-49de-9d36-1679743e97ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:23.252980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c1654-6420-49de-9d36-1679743e97ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:23.253960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c1654-6420-49de-9d36-1679743e97ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:23.256107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c1654-6420-49de-9d36-1679743e97ee admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:23.274259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 918/1823] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:22 2022] POST /identity/v3/projects => generated 369 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:23.281905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 906/1824] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:21:23.282169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c1654-6420-49de-9d36-1679743e97ee admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:23.285301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20b7c8-44ee-467d-833c-690b9546308d admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:23.294276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c1654-6420-49de-9d36-1679743e97ee admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:23.374031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3a538-1417-476a-9b26-3002f40d378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:23.375144 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3a538-1417-476a-9b26-3002f40d378f admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:23.375574 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3a538-1417-476a-9b26-3002f40d378f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:23.376394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3a538-1417-476a-9b26-3002f40d378f admin admin] PATH_INFO: `/v3/projects/259306ae6f4b47e6833dc816644601bc/users/abcd8dd39e14458f856df264052faf12/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:23.380326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3a538-1417-476a-9b26-3002f40d378f admin admin] RBAC: Authorizing `identity:create_grant(project_id=259306ae6f4b47e6833dc816644601bc, user_id=abcd8dd39e14458f856df264052faf12, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:23.383932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3a538-1417-476a-9b26-3002f40d378f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:23.400252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 907/1825] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:23 2022] PUT /identity/v3/projects/259306ae6f4b47e6833dc816644601bc/users/abcd8dd39e14458f856df264052faf12/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:21:23.415367 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20b7c8-44ee-467d-833c-690b9546308d admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:23.419712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4007575-ce48-4d8c-b1f4-9d82058033db None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:23.420567 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4007575-ce48-4d8c-b1f4-9d82058033db None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:23.421037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4007575-ce48-4d8c-b1f4-9d82058033db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:23.483426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e4007575-ce48-4d8c-b1f4-9d82058033db None None] MFA Rules not processed for user `abcd8dd39e14458f856df264052faf12`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:23.486043 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e4007575-ce48-4d8c-b1f4-9d82058033db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:23.515481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d56989-14ef-4c15-b022-a5c76565602e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:23.516651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d56989-14ef-4c15-b022-a5c76565602e admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:23.517240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d56989-14ef-4c15-b022-a5c76565602e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:23.517653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d56989-14ef-4c15-b022-a5c76565602e admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:23.518799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d56989-14ef-4c15-b022-a5c76565602e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:23.525148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d56989-14ef-4c15-b022-a5c76565602e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:23.632266 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 908/1826] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:23.634800 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4007575-ce48-4d8c-b1f4-9d82058033db None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:23.637694 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e4007575-ce48-4d8c-b1f4-9d82058033db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:23.664179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4007575-ce48-4d8c-b1f4-9d82058033db None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:23.670815 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a34c43-5bf8-41fe-9573-618733241495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:23.671482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a34c43-5bf8-41fe-9573-618733241495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:23.671834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a34c43-5bf8-41fe-9573-618733241495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:23.672180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a34c43-5bf8-41fe-9573-618733241495 admin admin] PATH_INFO: `/v3/projects/ef5b2da6a3d34be0a2ccf4ddd22b0278` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:23.673726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a34c43-5bf8-41fe-9573-618733241495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5b2da6a3d34be0a2ccf4ddd22b0278)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:23.679119 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a34c43-5bf8-41fe-9573-618733241495 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:23.687536 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 919/1827] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:23 2022] POST /identity/v3/users => generated 285 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:23.688940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d56989-14ef-4c15-b022-a5c76565602e admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:23.709649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-00d56989-14ef-4c15-b022-a5c76565602e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:23.839939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d56989-14ef-4c15-b022-a5c76565602e admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:23.849234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796be6ba-ac8a-416b-8e34-7006e9cecd4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:23.849898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796be6ba-ac8a-416b-8e34-7006e9cecd4a service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:23.850180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796be6ba-ac8a-416b-8e34-7006e9cecd4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:23.853406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796be6ba-ac8a-416b-8e34-7006e9cecd4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:23.864212 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796be6ba-ac8a-416b-8e34-7006e9cecd4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:23.866491 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796be6ba-ac8a-416b-8e34-7006e9cecd4a service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:23.892364 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 920/1828] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:23.894402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796be6ba-ac8a-416b-8e34-7006e9cecd4a service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:23.929896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796be6ba-ac8a-416b-8e34-7006e9cecd4a service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:23.965005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-66a34c43-5bf8-41fe-9573-618733241495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5b2da6a3d34be0a2ccf4ddd22b0278', 'request_id': 'req-66a34c43-5bf8-41fe-9573-618733241495'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:23.998924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-66a34c43-5bf8-41fe-9573-618733241495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5b2da6a3d34be0a2ccf4ddd22b0278', 'request_id': 'req-66a34c43-5bf8-41fe-9573-618733241495'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:24.020157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-66a34c43-5bf8-41fe-9573-618733241495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5b2da6a3d34be0a2ccf4ddd22b0278', 'request_id': 'req-66a34c43-5bf8-41fe-9573-618733241495'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:24.042933 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:24.093417 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72501672-cadd-442f-b5f3-fbfe0c177f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:24.093417 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72501672-cadd-442f-b5f3-fbfe0c177f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:24.093417 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72501672-cadd-442f-b5f3-fbfe0c177f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:24.093417 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72501672-cadd-442f-b5f3-fbfe0c177f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:24.105820 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72501672-cadd-442f-b5f3-fbfe0c177f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:24.105820 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72501672-cadd-442f-b5f3-fbfe0c177f5e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:24.124118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 921/1829] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:24.125640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72501672-cadd-442f-b5f3-fbfe0c177f5e admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:24.129525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-72501672-cadd-442f-b5f3-fbfe0c177f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:24.249698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72501672-cadd-442f-b5f3-fbfe0c177f5e admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:24.258664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c158a33-d240-4694-9401-7d85f318f3b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:24.260135 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c158a33-d240-4694-9401-7d85f318f3b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:24.260135 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c158a33-d240-4694-9401-7d85f318f3b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:24.260135 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c158a33-d240-4694-9401-7d85f318f3b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:24.262098 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2c158a33-d240-4694-9401-7d85f318f3b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:24.307455 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:24.329161 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-66a34c43-5bf8-41fe-9573-618733241495 admin admin] The token cache is being invalidate because project ef5b2da6a3d34be0a2ccf4ddd22b0278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:24.329161 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-66a34c43-5bf8-41fe-9573-618733241495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:24.332706 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-66a34c43-5bf8-41fe-9573-618733241495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:24.341422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 909/1830] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:23 2022] DELETE /identity/v3/projects/ef5b2da6a3d34be0a2ccf4ddd22b0278 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:24.343548 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a34c43-5bf8-41fe-9573-618733241495 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:24.347663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-66a34c43-5bf8-41fe-9573-618733241495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:24.378274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a34c43-5bf8-41fe-9573-618733241495 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:24.386948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c158a33-d240-4694-9401-7d85f318f3b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:24.388371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdc09e-0d93-4447-8bb9-b358a1c637aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:24.388735 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c158a33-d240-4694-9401-7d85f318f3b4 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:24.389314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdc09e-0d93-4447-8bb9-b358a1c637aa admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:24.389660 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdc09e-0d93-4447-8bb9-b358a1c637aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:24.389967 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdc09e-0d93-4447-8bb9-b358a1c637aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:24.390950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdc09e-0d93-4447-8bb9-b358a1c637aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:24.392956 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdc09e-0d93-4447-8bb9-b358a1c637aa admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:24.403550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 922/1831] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:24.404489 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c158a33-d240-4694-9401-7d85f318f3b4 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:24.406342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2c158a33-d240-4694-9401-7d85f318f3b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:24.420132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 910/1832] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:24.420132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102911d-32f1-4b8e-a619-d91c59bccf46 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:24.420132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102911d-32f1-4b8e-a619-d91c59bccf46 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:24.420132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102911d-32f1-4b8e-a619-d91c59bccf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:24.434558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c158a33-d240-4694-9401-7d85f318f3b4 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:24.443819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be776733-3407-4fca-8a68-01ae448d5677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:24.444885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be776733-3407-4fca-8a68-01ae448d5677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:24.445856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be776733-3407-4fca-8a68-01ae448d5677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:24.447221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be776733-3407-4fca-8a68-01ae448d5677 admin admin] PATH_INFO: `/v3/projects/4b73e331787646f0b1e5324ec3bf473b` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:24.449427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be776733-3407-4fca-8a68-01ae448d5677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b73e331787646f0b1e5324ec3bf473b)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:24.453217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be776733-3407-4fca-8a68-01ae448d5677 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:24.457404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5102911d-32f1-4b8e-a619-d91c59bccf46 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:24.467596 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5102911d-32f1-4b8e-a619-d91c59bccf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:24.498671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 911/1833] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:24.500123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102911d-32f1-4b8e-a619-d91c59bccf46 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:24.520308 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102911d-32f1-4b8e-a619-d91c59bccf46 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:24.528327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785a38b-d7fc-4c4b-b1da-9f1249f9ca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:24.529258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785a38b-d7fc-4c4b-b1da-9f1249f9ca10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:24.529787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785a38b-d7fc-4c4b-b1da-9f1249f9ca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:24.530072 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785a38b-d7fc-4c4b-b1da-9f1249f9ca10 admin admin] PATH_INFO: `/v3/projects/7c069fbe29db4e45beb3f9b988f6ded5/users/bab147156f1a4d66847329ff60038042/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:24.553537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785a38b-d7fc-4c4b-b1da-9f1249f9ca10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c069fbe29db4e45beb3f9b988f6ded5, user_id=bab147156f1a4d66847329ff60038042, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:24.559037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785a38b-d7fc-4c4b-b1da-9f1249f9ca10 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:24.681536 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 912/1834] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:24 2022] PUT /identity/v3/projects/7c069fbe29db4e45beb3f9b988f6ded5/users/bab147156f1a4d66847329ff60038042/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:24.683890 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26069ca-b840-4547-bef2-f4f38d6839ee None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:24.684744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26069ca-b840-4547-bef2-f4f38d6839ee None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:24.684744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26069ca-b840-4547-bef2-f4f38d6839ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:24.698961 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-be776733-3407-4fca-8a68-01ae448d5677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b73e331787646f0b1e5324ec3bf473b', 'request_id': 'req-be776733-3407-4fca-8a68-01ae448d5677'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:24.714060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e26069ca-b840-4547-bef2-f4f38d6839ee None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:24.715356 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e26069ca-b840-4547-bef2-f4f38d6839ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:24.787933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-be776733-3407-4fca-8a68-01ae448d5677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b73e331787646f0b1e5324ec3bf473b', 'request_id': 'req-be776733-3407-4fca-8a68-01ae448d5677'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:24.805293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-be776733-3407-4fca-8a68-01ae448d5677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b73e331787646f0b1e5324ec3bf473b', 'request_id': 'req-be776733-3407-4fca-8a68-01ae448d5677'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:24.820297 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 913/1835] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:24.823523 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fac67e-71ed-4252-b936-f57fb21de746 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:24.824201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fac67e-71ed-4252-b936-f57fb21de746 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:24.824581 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fac67e-71ed-4252-b936-f57fb21de746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:24.836587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-be776733-3407-4fca-8a68-01ae448d5677 admin admin] The token cache is being invalidate because project 4b73e331787646f0b1e5324ec3bf473b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:24.837320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-be776733-3407-4fca-8a68-01ae448d5677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:24.838798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-be776733-3407-4fca-8a68-01ae448d5677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:24.848580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 923/1836] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:24 2022] DELETE /identity/v3/projects/4b73e331787646f0b1e5324ec3bf473b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:24.848580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be776733-3407-4fca-8a68-01ae448d5677 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:24.848580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-be776733-3407-4fca-8a68-01ae448d5677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:24.880483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-33fac67e-71ed-4252-b936-f57fb21de746 None None] MFA Rules not processed for user `bab147156f1a4d66847329ff60038042`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:24.883983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-33fac67e-71ed-4252-b936-f57fb21de746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:24.910442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be776733-3407-4fca-8a68-01ae448d5677 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:24.920010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f807a-79f9-4d9d-872d-84a886f7899f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:24.920010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f807a-79f9-4d9d-872d-84a886f7899f admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:24.920010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f807a-79f9-4d9d-872d-84a886f7899f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:24.920010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f807a-79f9-4d9d-872d-84a886f7899f admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:24.921141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f807a-79f9-4d9d-872d-84a886f7899f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:21:24.921647 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f807a-79f9-4d9d-872d-84a886f7899f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:24.924357 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f807a-79f9-4d9d-872d-84a886f7899f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:24.949638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 924/1837] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:21:24.949638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f807a-79f9-4d9d-872d-84a886f7899f admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:24.960276 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-aa6f807a-79f9-4d9d-872d-84a886f7899f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:24.984405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f807a-79f9-4d9d-872d-84a886f7899f admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:24.992978 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e05093-2195-48c3-8aeb-c009e80b1943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:24.993951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e05093-2195-48c3-8aeb-c009e80b1943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:24.994517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e05093-2195-48c3-8aeb-c009e80b1943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:24.994973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e05093-2195-48c3-8aeb-c009e80b1943 admin admin] PATH_INFO: `/v3/users/6451ebba43e147669256e9ef8a27b0be` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:24.997814 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e05093-2195-48c3-8aeb-c009e80b1943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6451ebba43e147669256e9ef8a27b0be)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:25.000873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e05093-2195-48c3-8aeb-c009e80b1943 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:25.073149 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 914/1838] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:25.074252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fac67e-71ed-4252-b936-f57fb21de746 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:25.089085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fac67e-71ed-4252-b936-f57fb21de746 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:25.094739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b53f49-d03d-4f0d-a678-8e06445a9ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:25.095655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b53f49-d03d-4f0d-a678-8e06445a9ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:25.096005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b53f49-d03d-4f0d-a678-8e06445a9ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:25.096328 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b53f49-d03d-4f0d-a678-8e06445a9ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:25.097221 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b53f49-d03d-4f0d-a678-8e06445a9ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:25.107061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b53f49-d03d-4f0d-a678-8e06445a9ec8 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:25.321739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 915/1839] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:25 2022] POST /identity/v3/projects => generated 373 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:25.323348 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b53f49-d03d-4f0d-a678-8e06445a9ec8 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:25.347049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-53b53f49-d03d-4f0d-a678-8e06445a9ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:25.363637 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05e05093-2195-48c3-8aeb-c009e80b1943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6451ebba43e147669256e9ef8a27b0be'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:25.373199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05e05093-2195-48c3-8aeb-c009e80b1943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6451ebba43e147669256e9ef8a27b0be'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:25.391256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05e05093-2195-48c3-8aeb-c009e80b1943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6451ebba43e147669256e9ef8a27b0be'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:25.454217 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b53f49-d03d-4f0d-a678-8e06445a9ec8 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:25.462961 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b3e2e-b1d2-4cb2-8844-34a35374b0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:25.463623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b3e2e-b1d2-4cb2-8844-34a35374b0fe admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:25.463904 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b3e2e-b1d2-4cb2-8844-34a35374b0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:25.464379 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b3e2e-b1d2-4cb2-8844-34a35374b0fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:25.467477 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05e05093-2195-48c3-8aeb-c009e80b1943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6451ebba43e147669256e9ef8a27b0be'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:25.470514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b3e2e-b1d2-4cb2-8844-34a35374b0fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:25.470514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:25.470739 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05e05093-2195-48c3-8aeb-c009e80b1943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6451ebba43e147669256e9ef8a27b0be'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:25.471073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b3e2e-b1d2-4cb2-8844-34a35374b0fe admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:25.512701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 925/1840] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:24 2022] DELETE /identity/v3/users/6451ebba43e147669256e9ef8a27b0be => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:25.518102 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e05093-2195-48c3-8aeb-c009e80b1943 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:25.526264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-05e05093-2195-48c3-8aeb-c009e80b1943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:25.624300 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 916/1841] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:25 2022] POST /identity/v3/projects => generated 367 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:25.636077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b3e2e-b1d2-4cb2-8844-34a35374b0fe admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:25.657596 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-779b3e2e-b1d2-4cb2-8844-34a35374b0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:25.701896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e05093-2195-48c3-8aeb-c009e80b1943 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:25.752680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:25.806727 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a173a-f201-48cd-8afb-239a7f590feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:25.807919 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a173a-f201-48cd-8afb-239a7f590feb admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:25.808916 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a173a-f201-48cd-8afb-239a7f590feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:25.811960 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a173a-f201-48cd-8afb-239a7f590feb admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:25.811960 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a173a-f201-48cd-8afb-239a7f590feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:25.814414 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a173a-f201-48cd-8afb-239a7f590feb admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:25.827492 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b3e2e-b1d2-4cb2-8844-34a35374b0fe admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:25.830873 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef279a20-6985-4c16-8953-3ae9578f5213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:25.832110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef279a20-6985-4c16-8953-3ae9578f5213 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:25.832555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef279a20-6985-4c16-8953-3ae9578f5213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:25.833013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef279a20-6985-4c16-8953-3ae9578f5213 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:25.834213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef279a20-6985-4c16-8953-3ae9578f5213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:25.837733 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef279a20-6985-4c16-8953-3ae9578f5213 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:26.050860 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 926/1842] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:25 2022] POST /identity/v3/users => generated 287 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:26.052589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a173a-f201-48cd-8afb-239a7f590feb admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:26.058859 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 917/1843] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:25 2022] POST /identity/v3/users => generated 290 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:26.065500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef279a20-6985-4c16-8953-3ae9578f5213 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:26.077262 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a173a-f201-48cd-8afb-239a7f590feb admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:26.081014 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef279a20-6985-4c16-8953-3ae9578f5213 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:26.088619 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dfada-6ffa-438e-a3fc-b61dca97db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:26.089290 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dfada-6ffa-438e-a3fc-b61dca97db0b admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:26.089581 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dfada-6ffa-438e-a3fc-b61dca97db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:26.089867 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dfada-6ffa-438e-a3fc-b61dca97db0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:26.090664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dfada-6ffa-438e-a3fc-b61dca97db0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:26.091673 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a331e-de71-442c-98e5-990c050085e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:26.093136 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dfada-6ffa-438e-a3fc-b61dca97db0b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:26.094192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a331e-de71-442c-98e5-990c050085e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:26.095556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a331e-de71-442c-98e5-990c050085e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:26.096944 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a331e-de71-442c-98e5-990c050085e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:26.098303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a331e-de71-442c-98e5-990c050085e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:26.103707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a331e-de71-442c-98e5-990c050085e6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:26.120633 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 918/1844] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:26.124295 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dfada-6ffa-438e-a3fc-b61dca97db0b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:26.143231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dfada-6ffa-438e-a3fc-b61dca97db0b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:26.143611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 927/1845] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:26.151761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a331e-de71-442c-98e5-990c050085e6 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:26.160779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85be4d-98d6-4d00-8ce1-f0b7fdb71d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:26.160779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85be4d-98d6-4d00-8ce1-f0b7fdb71d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:26.160779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85be4d-98d6-4d00-8ce1-f0b7fdb71d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:26.160779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85be4d-98d6-4d00-8ce1-f0b7fdb71d97 admin admin] PATH_INFO: `/v3/projects/29b498a8fcda42e0a18743ce91f784fa/users/a8df4e48979d4854aae91b2545b22bf4/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:26.184422 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a331e-de71-442c-98e5-990c050085e6 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:26.198688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85be4d-98d6-4d00-8ce1-f0b7fdb71d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b498a8fcda42e0a18743ce91f784fa, user_id=a8df4e48979d4854aae91b2545b22bf4, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:26.199053 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e016a-1a7d-4376-8ca0-f1003161f667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:26.199149 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85be4d-98d6-4d00-8ce1-f0b7fdb71d97 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:26.199240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e016a-1a7d-4376-8ca0-f1003161f667 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:26.199240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e016a-1a7d-4376-8ca0-f1003161f667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:26.199240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e016a-1a7d-4376-8ca0-f1003161f667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:26.199240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e016a-1a7d-4376-8ca0-f1003161f667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:26.200474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e016a-1a7d-4376-8ca0-f1003161f667 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:26.221669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 928/1846] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:26.228402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e016a-1a7d-4376-8ca0-f1003161f667 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:26.260145 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e016a-1a7d-4376-8ca0-f1003161f667 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:26.280970 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9516ce2-3476-4eba-b910-7fc6e89ac6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:26.280970 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9516ce2-3476-4eba-b910-7fc6e89ac6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:26.280970 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9516ce2-3476-4eba-b910-7fc6e89ac6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:26.280970 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9516ce2-3476-4eba-b910-7fc6e89ac6c6 admin admin] PATH_INFO: `/v3/projects/d617254cfa6543ffa5d36a0516b4c6d9/users/e886241e6ac94ebdbbfd32370acd5e85/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:26.338264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9516ce2-3476-4eba-b910-7fc6e89ac6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d617254cfa6543ffa5d36a0516b4c6d9, user_id=e886241e6ac94ebdbbfd32370acd5e85, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:26.338264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9516ce2-3476-4eba-b910-7fc6e89ac6c6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:26.378556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 919/1847] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:26 2022] PUT /identity/v3/projects/29b498a8fcda42e0a18743ce91f784fa/users/a8df4e48979d4854aae91b2545b22bf4/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:26.386255 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85be4d-98d6-4d00-8ce1-f0b7fdb71d97 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:26.492043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 929/1848] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:26 2022] PUT /identity/v3/projects/d617254cfa6543ffa5d36a0516b4c6d9/users/e886241e6ac94ebdbbfd32370acd5e85/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:26.500099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38942525-0058-437a-a722-75e08b66913e None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:26.501031 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38942525-0058-437a-a722-75e08b66913e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:26.502621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38942525-0058-437a-a722-75e08b66913e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:26.546208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85be4d-98d6-4d00-8ce1-f0b7fdb71d97 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:26.552296 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-38942525-0058-437a-a722-75e08b66913e None None] MFA Rules not processed for user `e886241e6ac94ebdbbfd32370acd5e85`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:26.554593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-38942525-0058-437a-a722-75e08b66913e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:26.670653 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 930/1849] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:26.677440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38942525-0058-437a-a722-75e08b66913e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:26.700139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179b830-e9fd-44a4-a9bb-455ab2df5f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:26.701095 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179b830-e9fd-44a4-a9bb-455ab2df5f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:26.701462 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179b830-e9fd-44a4-a9bb-455ab2df5f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:26.701746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179b830-e9fd-44a4-a9bb-455ab2df5f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:26.703731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179b830-e9fd-44a4-a9bb-455ab2df5f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:26.705449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179b830-e9fd-44a4-a9bb-455ab2df5f78 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:26.724906 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 920/1850] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:21:26.730409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179b830-e9fd-44a4-a9bb-455ab2df5f78 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:26.762810 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179b830-e9fd-44a4-a9bb-455ab2df5f78 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:26.772685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c11a87-9d37-4591-885c-471f450e84b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:26.775707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c11a87-9d37-4591-885c-471f450e84b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:26.776651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c11a87-9d37-4591-885c-471f450e84b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:26.777347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c11a87-9d37-4591-885c-471f450e84b3 admin admin] PATH_INFO: `/v3/projects/29b498a8fcda42e0a18743ce91f784fa/users/a8df4e48979d4854aae91b2545b22bf4/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:26.781440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c11a87-9d37-4591-885c-471f450e84b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b498a8fcda42e0a18743ce91f784fa, user_id=a8df4e48979d4854aae91b2545b22bf4, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:26.788428 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c11a87-9d37-4591-885c-471f450e84b3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:26.810407 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:26.817018 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 921/1851] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:26 2022] PUT /identity/v3/projects/29b498a8fcda42e0a18743ce91f784fa/users/a8df4e48979d4854aae91b2545b22bf4/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:21:26.836501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f2019-7346-4bfe-a3c1-4cc62126fb66 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:26.836962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f2019-7346-4bfe-a3c1-4cc62126fb66 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:26.837602 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f2019-7346-4bfe-a3c1-4cc62126fb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:26.906412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c35f2019-7346-4bfe-a3c1-4cc62126fb66 None None] MFA Rules not processed for user `a8df4e48979d4854aae91b2545b22bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:26.906736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c35f2019-7346-4bfe-a3c1-4cc62126fb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:26.955234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38942525-0058-437a-a722-75e08b66913e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:27.153766 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f1099-5d4f-4f6e-b92e-10818a7e5a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:27.155284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f1099-5d4f-4f6e-b92e-10818a7e5a84 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:27.155756 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f1099-5d4f-4f6e-b92e-10818a7e5a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:27.156241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f1099-5d4f-4f6e-b92e-10818a7e5a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:27.157756 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f1099-5d4f-4f6e-b92e-10818a7e5a84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:27.165347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 922/1852] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:27.168658 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f2019-7346-4bfe-a3c1-4cc62126fb66 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:27.170810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f1099-5d4f-4f6e-b92e-10818a7e5a84 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:27.171485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c35f2019-7346-4bfe-a3c1-4cc62126fb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:27.227674 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f2019-7346-4bfe-a3c1-4cc62126fb66 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:27.244517 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc17e3-fa45-47a6-b488-372c3cb93a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:27.245407 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc17e3-fa45-47a6-b488-372c3cb93a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:27.281832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc17e3-fa45-47a6-b488-372c3cb93a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:27.281832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc17e3-fa45-47a6-b488-372c3cb93a4f admin admin] PATH_INFO: `/v3/projects/4a767e3bc5524e68bdcc21e2c21a6611` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:27.281832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc17e3-fa45-47a6-b488-372c3cb93a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a767e3bc5524e68bdcc21e2c21a6611)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:27.281832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc17e3-fa45-47a6-b488-372c3cb93a4f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:28.574855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 931/1853] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:26 2022] POST /identity/v3/projects => generated 369 bytes in 1898 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:21:28.576633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f1099-5d4f-4f6e-b92e-10818a7e5a84 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:28.581613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d85f1099-5d4f-4f6e-b92e-10818a7e5a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:28.604987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-81bc17e3-fa45-47a6-b488-372c3cb93a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a767e3bc5524e68bdcc21e2c21a6611', 'request_id': 'req-81bc17e3-fa45-47a6-b488-372c3cb93a4f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:28.631080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-81bc17e3-fa45-47a6-b488-372c3cb93a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a767e3bc5524e68bdcc21e2c21a6611', 'request_id': 'req-81bc17e3-fa45-47a6-b488-372c3cb93a4f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:28.658742 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-81bc17e3-fa45-47a6-b488-372c3cb93a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a767e3bc5524e68bdcc21e2c21a6611', 'request_id': 'req-81bc17e3-fa45-47a6-b488-372c3cb93a4f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:28.707114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f1099-5d4f-4f6e-b92e-10818a7e5a84 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:28.714014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e14a9-0fce-469e-bbcd-fcbe7a7651b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:28.715881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e14a9-0fce-469e-bbcd-fcbe7a7651b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:28.716303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e14a9-0fce-469e-bbcd-fcbe7a7651b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:28.723621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e14a9-0fce-469e-bbcd-fcbe7a7651b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:28.820464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-81bc17e3-fa45-47a6-b488-372c3cb93a4f admin admin] The token cache is being invalidate because project 4a767e3bc5524e68bdcc21e2c21a6611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:28.820464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-81bc17e3-fa45-47a6-b488-372c3cb93a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:28.820464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-81bc17e3-fa45-47a6-b488-372c3cb93a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:28.823735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 923/1854] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:27 2022] DELETE /identity/v3/projects/4a767e3bc5524e68bdcc21e2c21a6611 => generated 0 bytes in 1658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:28.824887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc17e3-fa45-47a6-b488-372c3cb93a4f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:28.827566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-81bc17e3-fa45-47a6-b488-372c3cb93a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:28.870034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e14a9-0fce-469e-bbcd-fcbe7a7651b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:28.873507 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e14a9-0fce-469e-bbcd-fcbe7a7651b3 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:28.894607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 932/1855] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:28.897560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6cc0b-b683-4e77-b0a8-ce29f2f76404 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:28.898880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6cc0b-b683-4e77-b0a8-ce29f2f76404 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:28.899285 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6cc0b-b683-4e77-b0a8-ce29f2f76404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:28.943206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-68d6cc0b-b683-4e77-b0a8-ce29f2f76404 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:28.947047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-68d6cc0b-b683-4e77-b0a8-ce29f2f76404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:29.003438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc17e3-fa45-47a6-b488-372c3cb93a4f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:29.089667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 933/1856] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:29.111959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d14ac7-ccba-4155-a3f3-c037239e2c66 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:29.112941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d14ac7-ccba-4155-a3f3-c037239e2c66 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:29.115059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d14ac7-ccba-4155-a3f3-c037239e2c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:29.192181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a1d14ac7-ccba-4155-a3f3-c037239e2c66 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:29.194255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a1d14ac7-ccba-4155-a3f3-c037239e2c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:29.204969 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcba2a4-9d1a-4eaa-8c19-8efeb28ad0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:29.216930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcba2a4-9d1a-4eaa-8c19-8efeb28ad0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:29.216930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcba2a4-9d1a-4eaa-8c19-8efeb28ad0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:29.216930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcba2a4-9d1a-4eaa-8c19-8efeb28ad0e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:29.216930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcba2a4-9d1a-4eaa-8c19-8efeb28ad0e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:29.217394 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 934/1857] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:29.217518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcba2a4-9d1a-4eaa-8c19-8efeb28ad0e2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:29.217717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d14ac7-ccba-4155-a3f3-c037239e2c66 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:29.220738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a1d14ac7-ccba-4155-a3f3-c037239e2c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:29.240984 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d14ac7-ccba-4155-a3f3-c037239e2c66 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:29.251106 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c5c03-5aee-4b1b-91fb-955b6e83829e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:29.252417 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c5c03-5aee-4b1b-91fb-955b6e83829e service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:29.252967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c5c03-5aee-4b1b-91fb-955b6e83829e service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:29.253527 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c5c03-5aee-4b1b-91fb-955b6e83829e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:29.258730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-298c5c03-5aee-4b1b-91fb-955b6e83829e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:29.354326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c5c03-5aee-4b1b-91fb-955b6e83829e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:29.356080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c5c03-5aee-4b1b-91fb-955b6e83829e service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:29.368396 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 935/1858] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:29.370090 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c5c03-5aee-4b1b-91fb-955b6e83829e service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:29.395197 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c5c03-5aee-4b1b-91fb-955b6e83829e service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:29.418000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b014b7-1f15-4d85-a8d3-347443f71e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:29.423249 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b014b7-1f15-4d85-a8d3-347443f71e42 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:29.423249 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b014b7-1f15-4d85-a8d3-347443f71e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:29.424971 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b014b7-1f15-4d85-a8d3-347443f71e42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:29.430783 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b014b7-1f15-4d85-a8d3-347443f71e42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:21:29.431659 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b014b7-1f15-4d85-a8d3-347443f71e42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:29.439911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b014b7-1f15-4d85-a8d3-347443f71e42 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:29.489043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 936/1859] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:21:29.498790 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b014b7-1f15-4d85-a8d3-347443f71e42 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:29.510178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 924/1860] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:28 2022] POST /identity/v3/users => generated 291 bytes in 682 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:29.512359 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcba2a4-9d1a-4eaa-8c19-8efeb28ad0e2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:29.519808 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b014b7-1f15-4d85-a8d3-347443f71e42 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:29.530298 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcba2a4-9d1a-4eaa-8c19-8efeb28ad0e2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:29.534921 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e203b0-a8da-4caa-a932-3e36036c265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:29.535627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e203b0-a8da-4caa-a932-3e36036c265c admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:29.535911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e203b0-a8da-4caa-a932-3e36036c265c admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:29.536371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e203b0-a8da-4caa-a932-3e36036c265c admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:29.538050 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e203b0-a8da-4caa-a932-3e36036c265c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:29.539640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3e3be-2bd4-4275-9771-4232f1096d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:29.545116 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3e3be-2bd4-4275-9771-4232f1096d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:29.545116 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3e3be-2bd4-4275-9771-4232f1096d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:29.545116 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3e3be-2bd4-4275-9771-4232f1096d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:29.545116 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3e3be-2bd4-4275-9771-4232f1096d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:29.545116 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3e3be-2bd4-4275-9771-4232f1096d17 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:29.555313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e203b0-a8da-4caa-a932-3e36036c265c admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:29.564455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 925/1861] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:29.571363 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3e3be-2bd4-4275-9771-4232f1096d17 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:29.592020 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3e3be-2bd4-4275-9771-4232f1096d17 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:29.602328 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38bb2c-25ab-4bca-9772-422a8b60b784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:29.603144 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38bb2c-25ab-4bca-9772-422a8b60b784 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:29.603451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38bb2c-25ab-4bca-9772-422a8b60b784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:29.603865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38bb2c-25ab-4bca-9772-422a8b60b784 admin admin] PATH_INFO: `/v3/projects/e678b5a41191478ba853939a18b6528d/users/9b1c227746df4e2d9c94f50492651d11/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:29.623278 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38bb2c-25ab-4bca-9772-422a8b60b784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e678b5a41191478ba853939a18b6528d, user_id=9b1c227746df4e2d9c94f50492651d11, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:29.628090 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38bb2c-25ab-4bca-9772-422a8b60b784 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:29.721271 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 937/1862] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:29 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:29.729926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e203b0-a8da-4caa-a932-3e36036c265c admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:29.807079 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 926/1863] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:29 2022] PUT /identity/v3/projects/e678b5a41191478ba853939a18b6528d/users/9b1c227746df4e2d9c94f50492651d11/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:29.813214 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38bb2c-25ab-4bca-9772-422a8b60b784 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:29.891875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e203b0-a8da-4caa-a932-3e36036c265c admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:29.928082 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38bb2c-25ab-4bca-9772-422a8b60b784 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:29.945607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba22e32-a005-4cac-a337-5394cac9e835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:29.946193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22e32-a005-4cac-a337-5394cac9e835 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:29.946617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22e32-a005-4cac-a337-5394cac9e835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:29.946898 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22e32-a005-4cac-a337-5394cac9e835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:29.947659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba22e32-a005-4cac-a337-5394cac9e835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:29.950468 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba22e32-a005-4cac-a337-5394cac9e835 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:29.969915 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 927/1864] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:21:29.971068 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba22e32-a005-4cac-a337-5394cac9e835 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:29.986033 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba22e32-a005-4cac-a337-5394cac9e835 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:30.006912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093477c1-8855-4547-88c1-bf33bb11010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:30.009425 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093477c1-8855-4547-88c1-bf33bb11010e admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:30.009645 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093477c1-8855-4547-88c1-bf33bb11010e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:30.010151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093477c1-8855-4547-88c1-bf33bb11010e admin admin] PATH_INFO: `/v3/projects/e678b5a41191478ba853939a18b6528d/users/9b1c227746df4e2d9c94f50492651d11/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:30.014607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093477c1-8855-4547-88c1-bf33bb11010e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e678b5a41191478ba853939a18b6528d, user_id=9b1c227746df4e2d9c94f50492651d11, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:30.020822 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093477c1-8855-4547-88c1-bf33bb11010e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:30.028215 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74c999-08c0-4fbb-ac3d-f66bf5254614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:30.029101 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74c999-08c0-4fbb-ac3d-f66bf5254614 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:30.029577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74c999-08c0-4fbb-ac3d-f66bf5254614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:30.029883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74c999-08c0-4fbb-ac3d-f66bf5254614 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:30.030875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74c999-08c0-4fbb-ac3d-f66bf5254614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:30.043710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74c999-08c0-4fbb-ac3d-f66bf5254614 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:30.043952 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 928/1865] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:29 2022] PUT /identity/v3/projects/e678b5a41191478ba853939a18b6528d/users/9b1c227746df4e2d9c94f50492651d11/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:30.058008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65be236-90dd-4cf2-8bea-07e6aae9c0d1 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:30.059056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65be236-90dd-4cf2-8bea-07e6aae9c0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:30.059372 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65be236-90dd-4cf2-8bea-07e6aae9c0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:30.099258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e65be236-90dd-4cf2-8bea-07e6aae9c0d1 None None] MFA Rules not processed for user `9b1c227746df4e2d9c94f50492651d11`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:30.100561 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e65be236-90dd-4cf2-8bea-07e6aae9c0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:30.159274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 938/1866] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:29 2022] POST /identity/v3/users => generated 293 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:30.168718 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74c999-08c0-4fbb-ac3d-f66bf5254614 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:30.192204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74c999-08c0-4fbb-ac3d-f66bf5254614 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:30.235349 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 929/1867] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:21:30.236451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65be236-90dd-4cf2-8bea-07e6aae9c0d1 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:30.238036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e65be236-90dd-4cf2-8bea-07e6aae9c0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:30.322185 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af4514-6955-41ef-9341-9ccad55c66d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:30.323615 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af4514-6955-41ef-9341-9ccad55c66d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:30.324017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af4514-6955-41ef-9341-9ccad55c66d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:30.324390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af4514-6955-41ef-9341-9ccad55c66d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:30.325186 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af4514-6955-41ef-9341-9ccad55c66d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:30.327898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af4514-6955-41ef-9341-9ccad55c66d0 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:30.347039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 939/1868] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:30.347039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af4514-6955-41ef-9341-9ccad55c66d0 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:30.347039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f2af4514-6955-41ef-9341-9ccad55c66d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:30.360390 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65be236-90dd-4cf2-8bea-07e6aae9c0d1 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:30.371152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49142c79-4665-442f-b7c0-1daabd92fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:30.385997 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49142c79-4665-442f-b7c0-1daabd92fc7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:30.385997 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49142c79-4665-442f-b7c0-1daabd92fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:30.385997 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49142c79-4665-442f-b7c0-1daabd92fc7f admin admin] PATH_INFO: `/v3/users/971076f603af4e6aa5e15c3c6457fa57` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:30.385997 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49142c79-4665-442f-b7c0-1daabd92fc7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=971076f603af4e6aa5e15c3c6457fa57)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:30.385997 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49142c79-4665-442f-b7c0-1daabd92fc7f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:30.470977 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af4514-6955-41ef-9341-9ccad55c66d0 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:30.478537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e90ef6-6df0-4a28-a089-35e71cd47e83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:30.479533 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e90ef6-6df0-4a28-a089-35e71cd47e83 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:30.490647 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e90ef6-6df0-4a28-a089-35e71cd47e83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:30.490647 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e90ef6-6df0-4a28-a089-35e71cd47e83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:30.500334 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e90ef6-6df0-4a28-a089-35e71cd47e83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:30.503151 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e90ef6-6df0-4a28-a089-35e71cd47e83 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:30.533078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 940/1869] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:30.534758 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e90ef6-6df0-4a28-a089-35e71cd47e83 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:30.581035 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e90ef6-6df0-4a28-a089-35e71cd47e83 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:30.592727 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6707e8d-6246-45f5-aadc-e03f504721fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:30.593812 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6707e8d-6246-45f5-aadc-e03f504721fd admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:30.594330 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6707e8d-6246-45f5-aadc-e03f504721fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:30.595316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6707e8d-6246-45f5-aadc-e03f504721fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:30.596714 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6707e8d-6246-45f5-aadc-e03f504721fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:30.600515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6707e8d-6246-45f5-aadc-e03f504721fd admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:30.628942 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 941/1870] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:30.635841 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6707e8d-6246-45f5-aadc-e03f504721fd admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:30.656654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6707e8d-6246-45f5-aadc-e03f504721fd admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:30.672532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e0c6d-362e-449c-ab2b-a11c9e8e58ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:30.677939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e0c6d-362e-449c-ab2b-a11c9e8e58ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:30.677939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e0c6d-362e-449c-ab2b-a11c9e8e58ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:30.677939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e0c6d-362e-449c-ab2b-a11c9e8e58ef admin admin] PATH_INFO: `/v3/projects/c27c6acaefa246599a6aed3d26d94474/users/5fb223c7bde44aedba68e73c85533537/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:30.702705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e0c6d-362e-449c-ab2b-a11c9e8e58ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27c6acaefa246599a6aed3d26d94474, user_id=5fb223c7bde44aedba68e73c85533537, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:30.707020 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e0c6d-362e-449c-ab2b-a11c9e8e58ef admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:30.801344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-49142c79-4665-442f-b7c0-1daabd92fc7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971076f603af4e6aa5e15c3c6457fa57'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:30.802329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-49142c79-4665-442f-b7c0-1daabd92fc7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971076f603af4e6aa5e15c3c6457fa57'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:30.863195 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 942/1871] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:30 2022] PUT /identity/v3/projects/c27c6acaefa246599a6aed3d26d94474/users/5fb223c7bde44aedba68e73c85533537/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:30.867532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-49142c79-4665-442f-b7c0-1daabd92fc7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971076f603af4e6aa5e15c3c6457fa57'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:30.869641 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-49142c79-4665-442f-b7c0-1daabd92fc7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971076f603af4e6aa5e15c3c6457fa57'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:30.879886 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7bb9e-b538-4240-a26f-d532bfcbf2c6 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:30.880691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7bb9e-b538-4240-a26f-d532bfcbf2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:30.881454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7bb9e-b538-4240-a26f-d532bfcbf2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:30.892151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:30.958999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-dea7bb9e-b538-4240-a26f-d532bfcbf2c6 None None] MFA Rules not processed for user `5fb223c7bde44aedba68e73c85533537`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:30.962024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-dea7bb9e-b538-4240-a26f-d532bfcbf2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:31.002870 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-49142c79-4665-442f-b7c0-1daabd92fc7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971076f603af4e6aa5e15c3c6457fa57'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:31.064591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 930/1872] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:30 2022] DELETE /identity/v3/users/971076f603af4e6aa5e15c3c6457fa57 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:31.073586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a7147-3539-4c99-ba01-ef7b5e2edd36 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:31.074222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a7147-3539-4c99-ba01-ef7b5e2edd36 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:31.077506 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a7147-3539-4c99-ba01-ef7b5e2edd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:31.133562 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-087a7147-3539-4c99-ba01-ef7b5e2edd36 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:31.135128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-087a7147-3539-4c99-ba01-ef7b5e2edd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:31.175439 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 943/1873] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:21:31.259046 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7bb9e-b538-4240-a26f-d532bfcbf2c6 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:31.261292 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-dea7bb9e-b538-4240-a26f-d532bfcbf2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:31.293876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 931/1874] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:31.298721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a7147-3539-4c99-ba01-ef7b5e2edd36 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:31.306626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-087a7147-3539-4c99-ba01-ef7b5e2edd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:31.405537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7bb9e-b538-4240-a26f-d532bfcbf2c6 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:31.439478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a7147-3539-4c99-ba01-ef7b5e2edd36 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:31.451174 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd035d3-bb85-4980-969d-b14f32bef74b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:31.453700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd035d3-bb85-4980-969d-b14f32bef74b service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:31.454493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd035d3-bb85-4980-969d-b14f32bef74b service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:31.456244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd035d3-bb85-4980-969d-b14f32bef74b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:31.489397 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd035d3-bb85-4980-969d-b14f32bef74b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:31.490105 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd035d3-bb85-4980-969d-b14f32bef74b service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:31.521030 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed3681-9b0f-4a16-83e2-488fe736ad8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:31.521580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed3681-9b0f-4a16-83e2-488fe736ad8b service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:31.521820 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed3681-9b0f-4a16-83e2-488fe736ad8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:31.522156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed3681-9b0f-4a16-83e2-488fe736ad8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:31.534985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 932/1875] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:21:31.570948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3c6f1-0a17-4eeb-9a3c-0d96947857d4 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:31.571653 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3c6f1-0a17-4eeb-9a3c-0d96947857d4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:31.572262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3c6f1-0a17-4eeb-9a3c-0d96947857d4 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:31.576785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 933/1876] 10.222.0.98 () {54 vars in 921 bytes} [Tue Jul 26 15:21:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:21:31.617818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d14f79-f243-4547-be11-a09f2f1bab99 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:31.618534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed3681-9b0f-4a16-83e2-488fe736ad8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:31.619535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d14f79-f243-4547-be11-a09f2f1bab99 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:31.620597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d14f79-f243-4547-be11-a09f2f1bab99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:31.623908 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed3681-9b0f-4a16-83e2-488fe736ad8b service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:31.664091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f7d14f79-f243-4547-be11-a09f2f1bab99 None None] MFA Rules not processed for user `a4a6c0e7ca434010980d7cac1800dbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:31.667368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f7d14f79-f243-4547-be11-a09f2f1bab99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:31.677768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 944/1877] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:21:31.728736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed3681-9b0f-4a16-83e2-488fe736ad8b service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:31.734843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6fed3681-9b0f-4a16-83e2-488fe736ad8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:31.777512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed3681-9b0f-4a16-83e2-488fe736ad8b service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:31.798933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:31.798933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b05323-65f2-4c10-b95b-efcab19f7b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:31.798933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b05323-65f2-4c10-b95b-efcab19f7b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:31.798933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b05323-65f2-4c10-b95b-efcab19f7b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:31.799499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b05323-65f2-4c10-b95b-efcab19f7b2f admin admin] PATH_INFO: `/v3/users/5fb223c7bde44aedba68e73c85533537` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:31.799499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b05323-65f2-4c10-b95b-efcab19f7b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb223c7bde44aedba68e73c85533537)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:31.803399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b05323-65f2-4c10-b95b-efcab19f7b2f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:31.896299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 934/1878] 10.222.0.98 () {58 vars in 1018 bytes} [Tue Jul 26 15:21:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:31.986866 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d14f79-f243-4547-be11-a09f2f1bab99 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:31.988275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f7d14f79-f243-4547-be11-a09f2f1bab99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:32.017785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d14f79-f243-4547-be11-a09f2f1bab99 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:32.032423 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90952b5b-600b-44d1-b82c-8ec02acf7bc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:32.033702 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90952b5b-600b-44d1-b82c-8ec02acf7bc6 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:32.034194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90952b5b-600b-44d1-b82c-8ec02acf7bc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:32.034889 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90952b5b-600b-44d1-b82c-8ec02acf7bc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:32.051923 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90952b5b-600b-44d1-b82c-8ec02acf7bc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:32.054769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90952b5b-600b-44d1-b82c-8ec02acf7bc6 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:32.072425 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 935/1879] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:21:32.129481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-23b05323-65f2-4c10-b95b-efcab19f7b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb223c7bde44aedba68e73c85533537'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:32.131676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-23b05323-65f2-4c10-b95b-efcab19f7b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb223c7bde44aedba68e73c85533537'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:32.181395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-23b05323-65f2-4c10-b95b-efcab19f7b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb223c7bde44aedba68e73c85533537'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:32.253122 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90952b5b-600b-44d1-b82c-8ec02acf7bc6 service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:32.256077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-90952b5b-600b-44d1-b82c-8ec02acf7bc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:32.285941 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90952b5b-600b-44d1-b82c-8ec02acf7bc6 service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:32.291753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a25b7-93fb-42ed-a09e-6228ad740d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:32.292599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a25b7-93fb-42ed-a09e-6228ad740d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:32.293048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a25b7-93fb-42ed-a09e-6228ad740d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:32.294720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-23b05323-65f2-4c10-b95b-efcab19f7b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb223c7bde44aedba68e73c85533537'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:32.295386 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-23b05323-65f2-4c10-b95b-efcab19f7b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb223c7bde44aedba68e73c85533537'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:32.295847 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a25b7-93fb-42ed-a09e-6228ad740d0f admin admin] PATH_INFO: `/v3/projects/5fa43e76d313421ca2ea897390f2556f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:32.299918 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a25b7-93fb-42ed-a09e-6228ad740d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa43e76d313421ca2ea897390f2556f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:32.305066 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a25b7-93fb-42ed-a09e-6228ad740d0f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:32.316483 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 945/1880] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:31 2022] DELETE /identity/v3/users/5fb223c7bde44aedba68e73c85533537 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:32.324113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f700ad6-f778-4802-acfb-a343b9b0e2e1 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:32.327498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f700ad6-f778-4802-acfb-a343b9b0e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:32.328065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f700ad6-f778-4802-acfb-a343b9b0e2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:32.355268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:32.400479 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-0f700ad6-f778-4802-acfb-a343b9b0e2e1 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:32.402922 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0f700ad6-f778-4802-acfb-a343b9b0e2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:32.590149 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c04a25b7-93fb-42ed-a09e-6228ad740d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa43e76d313421ca2ea897390f2556f', 'request_id': 'req-c04a25b7-93fb-42ed-a09e-6228ad740d0f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:32.606912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c04a25b7-93fb-42ed-a09e-6228ad740d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa43e76d313421ca2ea897390f2556f', 'request_id': 'req-c04a25b7-93fb-42ed-a09e-6228ad740d0f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:32.623317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c04a25b7-93fb-42ed-a09e-6228ad740d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa43e76d313421ca2ea897390f2556f', 'request_id': 'req-c04a25b7-93fb-42ed-a09e-6228ad740d0f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:32.637130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 946/1881] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:21:32.652198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f700ad6-f778-4802-acfb-a343b9b0e2e1 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:32.655061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0f700ad6-f778-4802-acfb-a343b9b0e2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:32.768085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c04a25b7-93fb-42ed-a09e-6228ad740d0f admin admin] The token cache is being invalidate because project 5fa43e76d313421ca2ea897390f2556f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:32.769680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c04a25b7-93fb-42ed-a09e-6228ad740d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:32.780104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c04a25b7-93fb-42ed-a09e-6228ad740d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:32.782924 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f700ad6-f778-4802-acfb-a343b9b0e2e1 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:32.802300 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 936/1882] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:32 2022] DELETE /identity/v3/projects/5fa43e76d313421ca2ea897390f2556f => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:32.808954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a25b7-93fb-42ed-a09e-6228ad740d0f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:32.815310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c04a25b7-93fb-42ed-a09e-6228ad740d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:32.918734 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf5f2a-2cc1-4163-89f6-ae6c3adf5950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:32.920068 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf5f2a-2cc1-4163-89f6-ae6c3adf5950 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:32.920598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf5f2a-2cc1-4163-89f6-ae6c3adf5950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:32.921022 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf5f2a-2cc1-4163-89f6-ae6c3adf5950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:32.924868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-87cf5f2a-2cc1-4163-89f6-ae6c3adf5950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:33.033182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a25b7-93fb-42ed-a09e-6228ad740d0f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:33.075516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d7f5a-e4c3-4633-b72f-b7bf30285f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:33.076686 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d7f5a-e4c3-4633-b72f-b7bf30285f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:33.077159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d7f5a-e4c3-4633-b72f-b7bf30285f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:33.077561 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d7f5a-e4c3-4633-b72f-b7bf30285f65 admin admin] PATH_INFO: `/v3/users/abcd8dd39e14458f856df264052faf12` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:33.083764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d7f5a-e4c3-4633-b72f-b7bf30285f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abcd8dd39e14458f856df264052faf12)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:33.084458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf5f2a-2cc1-4163-89f6-ae6c3adf5950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:33.088049 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf5f2a-2cc1-4163-89f6-ae6c3adf5950 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:33.088746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d7f5a-e4c3-4633-b72f-b7bf30285f65 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:33.127231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 947/1883] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:21:33.133045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf5f2a-2cc1-4163-89f6-ae6c3adf5950 service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:33.134186 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-87cf5f2a-2cc1-4163-89f6-ae6c3adf5950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:33.192850 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf5f2a-2cc1-4163-89f6-ae6c3adf5950 service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:33.213159 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34810aec-34cf-4b95-aab1-8ce98507ab5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:33.216847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34810aec-34cf-4b95-aab1-8ce98507ab5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:33.217691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34810aec-34cf-4b95-aab1-8ce98507ab5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:33.218400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34810aec-34cf-4b95-aab1-8ce98507ab5e admin admin] PATH_INFO: `/v3/users/e886241e6ac94ebdbbfd32370acd5e85` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:33.222988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34810aec-34cf-4b95-aab1-8ce98507ab5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e886241e6ac94ebdbbfd32370acd5e85)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:33.229335 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34810aec-34cf-4b95-aab1-8ce98507ab5e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:33.271984 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:33.551541 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e84d7f5a-e4c3-4633-b72f-b7bf30285f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abcd8dd39e14458f856df264052faf12'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:33.557167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e84d7f5a-e4c3-4633-b72f-b7bf30285f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abcd8dd39e14458f856df264052faf12'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:33.575901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e84d7f5a-e4c3-4633-b72f-b7bf30285f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abcd8dd39e14458f856df264052faf12'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:33.577108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e84d7f5a-e4c3-4633-b72f-b7bf30285f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abcd8dd39e14458f856df264052faf12'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:33.657548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-34810aec-34cf-4b95-aab1-8ce98507ab5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e886241e6ac94ebdbbfd32370acd5e85'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:33.658806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-34810aec-34cf-4b95-aab1-8ce98507ab5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e886241e6ac94ebdbbfd32370acd5e85'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:33.687290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-34810aec-34cf-4b95-aab1-8ce98507ab5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e886241e6ac94ebdbbfd32370acd5e85'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:33.736623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e84d7f5a-e4c3-4633-b72f-b7bf30285f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abcd8dd39e14458f856df264052faf12'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:33.774015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 937/1884] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:32 2022] DELETE /identity/v3/users/abcd8dd39e14458f856df264052faf12 => generated 0 bytes in 966 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:33.832915 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-34810aec-34cf-4b95-aab1-8ce98507ab5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e886241e6ac94ebdbbfd32370acd5e85'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:33.834209 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-34810aec-34cf-4b95-aab1-8ce98507ab5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e886241e6ac94ebdbbfd32370acd5e85'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:33.885656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 948/1885] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:33 2022] DELETE /identity/v3/users/e886241e6ac94ebdbbfd32370acd5e85 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:33.891975 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22168b79-c9ee-4f28-9b8c-e4d283215643 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:33.892917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22168b79-c9ee-4f28-9b8c-e4d283215643 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:33.893556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22168b79-c9ee-4f28-9b8c-e4d283215643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:33.945818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-22168b79-c9ee-4f28-9b8c-e4d283215643 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:33.945818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-22168b79-c9ee-4f28-9b8c-e4d283215643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:33.984336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34810aec-34cf-4b95-aab1-8ce98507ab5e admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:33.987669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-34810aec-34cf-4b95-aab1-8ce98507ab5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:34.160034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 938/1886] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:34.176580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22168b79-c9ee-4f28-9b8c-e4d283215643 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:34.182176 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-22168b79-c9ee-4f28-9b8c-e4d283215643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:34.217728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34810aec-34cf-4b95-aab1-8ce98507ab5e admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:34.227614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342bd1e-0645-40b1-aeb8-b69c1477c32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:34.228699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342bd1e-0645-40b1-aeb8-b69c1477c32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:34.229169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342bd1e-0645-40b1-aeb8-b69c1477c32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:34.229643 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342bd1e-0645-40b1-aeb8-b69c1477c32a admin admin] PATH_INFO: `/v3/projects/c27c6acaefa246599a6aed3d26d94474` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:34.243921 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342bd1e-0645-40b1-aeb8-b69c1477c32a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c27c6acaefa246599a6aed3d26d94474)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:34.252210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342bd1e-0645-40b1-aeb8-b69c1477c32a admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:34.336339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:34.359084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22168b79-c9ee-4f28-9b8c-e4d283215643 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:34.364014 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64070457-6d81-44f2-89af-4a6390c70b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:34.364844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070457-6d81-44f2-89af-4a6390c70b27 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:34.365208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070457-6d81-44f2-89af-4a6390c70b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:34.365579 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070457-6d81-44f2-89af-4a6390c70b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:34.387294 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64070457-6d81-44f2-89af-4a6390c70b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:34.390654 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64070457-6d81-44f2-89af-4a6390c70b27 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:34.415554 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 939/1887] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:34.499164 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3342bd1e-0645-40b1-aeb8-b69c1477c32a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27c6acaefa246599a6aed3d26d94474', 'request_id': 'req-3342bd1e-0645-40b1-aeb8-b69c1477c32a'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:34.607622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3342bd1e-0645-40b1-aeb8-b69c1477c32a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27c6acaefa246599a6aed3d26d94474', 'request_id': 'req-3342bd1e-0645-40b1-aeb8-b69c1477c32a'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:34.631553 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3342bd1e-0645-40b1-aeb8-b69c1477c32a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27c6acaefa246599a6aed3d26d94474', 'request_id': 'req-3342bd1e-0645-40b1-aeb8-b69c1477c32a'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:34.683892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3342bd1e-0645-40b1-aeb8-b69c1477c32a admin admin] The token cache is being invalidate because project c27c6acaefa246599a6aed3d26d94474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:34.684510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3342bd1e-0645-40b1-aeb8-b69c1477c32a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:34.695677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3342bd1e-0645-40b1-aeb8-b69c1477c32a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:34.702613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64070457-6d81-44f2-89af-4a6390c70b27 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:34.702613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-64070457-6d81-44f2-89af-4a6390c70b27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:34.715999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 949/1888] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:33 2022] DELETE /identity/v3/projects/c27c6acaefa246599a6aed3d26d94474 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:34.740489 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc63ed9-8239-4526-8e75-ddd668278416 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:34.742180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64070457-6d81-44f2-89af-4a6390c70b27 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:34.742391 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc63ed9-8239-4526-8e75-ddd668278416 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:34.742784 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc63ed9-8239-4526-8e75-ddd668278416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:34.785379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-6dc63ed9-8239-4526-8e75-ddd668278416 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:34.788901 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6dc63ed9-8239-4526-8e75-ddd668278416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:34.926509 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 950/1889] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:34.931315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc63ed9-8239-4526-8e75-ddd668278416 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:34.931315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6dc63ed9-8239-4526-8e75-ddd668278416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:34.970605 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc63ed9-8239-4526-8e75-ddd668278416 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:34.971089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae992f-f67d-44c8-a8bc-4dd7daa7c692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:34.971089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae992f-f67d-44c8-a8bc-4dd7daa7c692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:34.971089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae992f-f67d-44c8-a8bc-4dd7daa7c692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:34.971089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae992f-f67d-44c8-a8bc-4dd7daa7c692 admin admin] PATH_INFO: `/v3/users/01f2143454964b14991ef51271375b10` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:34.972022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae992f-f67d-44c8-a8bc-4dd7daa7c692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f2143454964b14991ef51271375b10)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:34.974973 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae992f-f67d-44c8-a8bc-4dd7daa7c692 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:34.978775 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773dd46-c2fe-4b59-b662-1c2f5c4d3561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:34.980780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773dd46-c2fe-4b59-b662-1c2f5c4d3561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:34.981655 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773dd46-c2fe-4b59-b662-1c2f5c4d3561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:34.982181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773dd46-c2fe-4b59-b662-1c2f5c4d3561 admin admin] PATH_INFO: `/v3/projects/259306ae6f4b47e6833dc816644601bc` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:34.986664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773dd46-c2fe-4b59-b662-1c2f5c4d3561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=259306ae6f4b47e6833dc816644601bc)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:34.991297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773dd46-c2fe-4b59-b662-1c2f5c4d3561 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:35.367646 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d773dd46-c2fe-4b59-b662-1c2f5c4d3561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '259306ae6f4b47e6833dc816644601bc', 'request_id': 'req-d773dd46-c2fe-4b59-b662-1c2f5c4d3561'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:35.370545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21ae992f-f67d-44c8-a8bc-4dd7daa7c692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f2143454964b14991ef51271375b10'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:35.372312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21ae992f-f67d-44c8-a8bc-4dd7daa7c692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f2143454964b14991ef51271375b10'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:35.400751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21ae992f-f67d-44c8-a8bc-4dd7daa7c692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f2143454964b14991ef51271375b10'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:35.402175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21ae992f-f67d-44c8-a8bc-4dd7daa7c692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f2143454964b14991ef51271375b10'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:35.438414 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:35.483078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d773dd46-c2fe-4b59-b662-1c2f5c4d3561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '259306ae6f4b47e6833dc816644601bc', 'request_id': 'req-d773dd46-c2fe-4b59-b662-1c2f5c4d3561'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:35.493161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d773dd46-c2fe-4b59-b662-1c2f5c4d3561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '259306ae6f4b47e6833dc816644601bc', 'request_id': 'req-d773dd46-c2fe-4b59-b662-1c2f5c4d3561'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:35.515656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d773dd46-c2fe-4b59-b662-1c2f5c4d3561 admin admin] The token cache is being invalidate because project 259306ae6f4b47e6833dc816644601bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:35.516175 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d773dd46-c2fe-4b59-b662-1c2f5c4d3561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:35.517431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d773dd46-c2fe-4b59-b662-1c2f5c4d3561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:35.520231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 951/1890] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:34 2022] DELETE /identity/v3/projects/259306ae6f4b47e6833dc816644601bc => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:35.523540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e982f-4188-4505-96cf-db5902c0042c None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:35.524303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e982f-4188-4505-96cf-db5902c0042c None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:35.524822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e982f-4188-4505-96cf-db5902c0042c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:35.558678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-3a2e982f-4188-4505-96cf-db5902c0042c None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:35.560187 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3a2e982f-4188-4505-96cf-db5902c0042c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:35.653602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 952/1891] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:35.655410 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad633d-4f08-4a85-a00d-592f317bfade None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:35.655872 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad633d-4f08-4a85-a00d-592f317bfade None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:35.656317 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad633d-4f08-4a85-a00d-592f317bfade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:35.657245 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21ae992f-f67d-44c8-a8bc-4dd7daa7c692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f2143454964b14991ef51271375b10'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:35.678081 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-ebad633d-4f08-4a85-a00d-592f317bfade None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:35.679403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ebad633d-4f08-4a85-a00d-592f317bfade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:35.681862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 940/1892] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:34 2022] DELETE /identity/v3/users/01f2143454964b14991ef51271375b10 => generated 0 bytes in 985 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:35.683463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae992f-f67d-44c8-a8bc-4dd7daa7c692 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:35.685970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-21ae992f-f67d-44c8-a8bc-4dd7daa7c692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:35.803538 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 953/1893] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:35.807378 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad633d-4f08-4a85-a00d-592f317bfade None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:35.830029 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad633d-4f08-4a85-a00d-592f317bfade None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:35.833583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae992f-f67d-44c8-a8bc-4dd7daa7c692 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:35.843203 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:35.844169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:35.844639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:35.845214 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb admin admin] PATH_INFO: `/v3/projects/d617254cfa6543ffa5d36a0516b4c6d9` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:35.847393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76846041-2e8d-419d-9b8d-7e45d4b47290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:35.847870 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d617254cfa6543ffa5d36a0516b4c6d9)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:35.848734 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76846041-2e8d-419d-9b8d-7e45d4b47290 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:35.849251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76846041-2e8d-419d-9b8d-7e45d4b47290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:35.849747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76846041-2e8d-419d-9b8d-7e45d4b47290 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:35.865389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:35.865616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76846041-2e8d-419d-9b8d-7e45d4b47290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:21:35.865616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76846041-2e8d-419d-9b8d-7e45d4b47290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:35.865616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76846041-2e8d-419d-9b8d-7e45d4b47290 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:35.889449 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 954/1894] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:21:35.893138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96065b4-824d-4073-87f0-0cd048923530 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:35.894215 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96065b4-824d-4073-87f0-0cd048923530 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:35.895025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96065b4-824d-4073-87f0-0cd048923530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:35.934528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a96065b4-824d-4073-87f0-0cd048923530 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:35.935803 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a96065b4-824d-4073-87f0-0cd048923530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:35.956118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 955/1895] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:35.958556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f2f7c-b87b-46fa-a5fd-74b646a01de5 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:35.959093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f2f7c-b87b-46fa-a5fd-74b646a01de5 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:35.960498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f2f7c-b87b-46fa-a5fd-74b646a01de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:36.039215 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d44f2f7c-b87b-46fa-a5fd-74b646a01de5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:36.041693 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d44f2f7c-b87b-46fa-a5fd-74b646a01de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:36.094694 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd617254cfa6543ffa5d36a0516b4c6d9', 'request_id': 'req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:36.112776 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd617254cfa6543ffa5d36a0516b4c6d9', 'request_id': 'req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:36.147237 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd617254cfa6543ffa5d36a0516b4c6d9', 'request_id': 'req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:36.210494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 956/1896] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:36.212174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f2f7c-b87b-46fa-a5fd-74b646a01de5 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:36.240291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f2f7c-b87b-46fa-a5fd-74b646a01de5 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:36.251064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df8450-4b15-4811-b9df-2fcfbab0c1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:36.262395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df8450-4b15-4811-b9df-2fcfbab0c1cd admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:36.262395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df8450-4b15-4811-b9df-2fcfbab0c1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:36.262395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df8450-4b15-4811-b9df-2fcfbab0c1cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:36.262395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df8450-4b15-4811-b9df-2fcfbab0c1cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:36.262395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df8450-4b15-4811-b9df-2fcfbab0c1cd admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:36.267366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb admin admin] The token cache is being invalidate because project d617254cfa6543ffa5d36a0516b4c6d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:36.267366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:36.267837 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:36.271555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 941/1897] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:35 2022] DELETE /identity/v3/projects/d617254cfa6543ffa5d36a0516b4c6d9 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:36.277369 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:36.279582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:36.377996 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6efe4-40b0-4641-a70d-9cbe0c4f00cb admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:36.383626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9832a-2e28-4c06-967d-21dfe9c30126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:36.384565 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9832a-2e28-4c06-967d-21dfe9c30126 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:36.384943 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9832a-2e28-4c06-967d-21dfe9c30126 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:36.385318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9832a-2e28-4c06-967d-21dfe9c30126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:36.387703 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-48c9832a-2e28-4c06-967d-21dfe9c30126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:36.408373 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 957/1898] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:36 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:36.408373 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df8450-4b15-4811-b9df-2fcfbab0c1cd admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:36.412207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9832a-2e28-4c06-967d-21dfe9c30126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:36.414779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9832a-2e28-4c06-967d-21dfe9c30126 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:36.423241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-53df8450-4b15-4811-b9df-2fcfbab0c1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:36.428341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 942/1899] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:36.430861 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9832a-2e28-4c06-967d-21dfe9c30126 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:36.433331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-48c9832a-2e28-4c06-967d-21dfe9c30126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:36.469075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9832a-2e28-4c06-967d-21dfe9c30126 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:36.568371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df8450-4b15-4811-b9df-2fcfbab0c1cd admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:36.575423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfa2eb-8190-43a8-b83a-ad448fc3e070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:36.576062 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfa2eb-8190-43a8-b83a-ad448fc3e070 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:36.576348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfa2eb-8190-43a8-b83a-ad448fc3e070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:36.576627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfa2eb-8190-43a8-b83a-ad448fc3e070 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:36.577379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfa2eb-8190-43a8-b83a-ad448fc3e070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:21:36.577688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfa2eb-8190-43a8-b83a-ad448fc3e070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:36.579628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfa2eb-8190-43a8-b83a-ad448fc3e070 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:36.597045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 958/1900] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:21:36.598275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfa2eb-8190-43a8-b83a-ad448fc3e070 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:36.605004 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c5cfa2eb-8190-43a8-b83a-ad448fc3e070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:36.609419 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee488d-3e4c-4f81-b6f3-63f5942614cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:36.610214 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee488d-3e4c-4f81-b6f3-63f5942614cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:36.610603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee488d-3e4c-4f81-b6f3-63f5942614cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:36.610951 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee488d-3e4c-4f81-b6f3-63f5942614cb admin admin] PATH_INFO: `/v3/users/9b1c227746df4e2d9c94f50492651d11` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:36.612595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee488d-3e4c-4f81-b6f3-63f5942614cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b1c227746df4e2d9c94f50492651d11)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:36.614982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee488d-3e4c-4f81-b6f3-63f5942614cb admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:36.627202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfa2eb-8190-43a8-b83a-ad448fc3e070 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:36.634791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a995ed2-5fc6-4739-bbd4-63f93d63618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:36.639176 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a995ed2-5fc6-4739-bbd4-63f93d63618e admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:36.639176 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a995ed2-5fc6-4739-bbd4-63f93d63618e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:36.639176 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a995ed2-5fc6-4739-bbd4-63f93d63618e admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:36.639176 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a995ed2-5fc6-4739-bbd4-63f93d63618e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:36.639176 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a995ed2-5fc6-4739-bbd4-63f93d63618e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:36.906400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 959/1901] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:36 2022] POST /identity/v3/users => generated 293 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:36.906400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a995ed2-5fc6-4739-bbd4-63f93d63618e admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:36.929853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a995ed2-5fc6-4739-bbd4-63f93d63618e admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:36.936931 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0293b-16ef-4cf7-bc43-3b73b75be2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:36.937837 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0293b-16ef-4cf7-bc43-3b73b75be2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:36.938269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0293b-16ef-4cf7-bc43-3b73b75be2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:36.938742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0293b-16ef-4cf7-bc43-3b73b75be2a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:36.939801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0293b-16ef-4cf7-bc43-3b73b75be2a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:36.942494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0293b-16ef-4cf7-bc43-3b73b75be2a0 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:37.053706 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-20ee488d-3e4c-4f81-b6f3-63f5942614cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b1c227746df4e2d9c94f50492651d11'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:37.055693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-20ee488d-3e4c-4f81-b6f3-63f5942614cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b1c227746df4e2d9c94f50492651d11'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:37.077232 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 960/1902] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:36 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:37.078237 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0293b-16ef-4cf7-bc43-3b73b75be2a0 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:37.081521 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-68c0293b-16ef-4cf7-bc43-3b73b75be2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:37.105512 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-20ee488d-3e4c-4f81-b6f3-63f5942614cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b1c227746df4e2d9c94f50492651d11'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:37.113066 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-20ee488d-3e4c-4f81-b6f3-63f5942614cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b1c227746df4e2d9c94f50492651d11'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:37.174006 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0293b-16ef-4cf7-bc43-3b73b75be2a0 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:37.180305 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3be46-6466-4d68-8bdf-531d334b49c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:37.180979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3be46-6466-4d68-8bdf-531d334b49c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:37.181267 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3be46-6466-4d68-8bdf-531d334b49c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:37.181546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3be46-6466-4d68-8bdf-531d334b49c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:37.182273 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3be46-6466-4d68-8bdf-531d334b49c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:37.184044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3be46-6466-4d68-8bdf-531d334b49c8 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:37.198811 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 961/1903] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:37.199533 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3be46-6466-4d68-8bdf-531d334b49c8 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:37.201573 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2db3be46-6466-4d68-8bdf-531d334b49c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:37.217014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3be46-6466-4d68-8bdf-531d334b49c8 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:37.223181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196a056-e219-46bc-adf3-5d321cb6be85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:37.223881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196a056-e219-46bc-adf3-5d321cb6be85 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:37.224169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196a056-e219-46bc-adf3-5d321cb6be85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:37.224453 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196a056-e219-46bc-adf3-5d321cb6be85 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:37.225153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196a056-e219-46bc-adf3-5d321cb6be85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:37.227604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196a056-e219-46bc-adf3-5d321cb6be85 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:37.265634 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-20ee488d-3e4c-4f81-b6f3-63f5942614cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b1c227746df4e2d9c94f50492651d11'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:37.285815 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 943/1904] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:36 2022] DELETE /identity/v3/users/9b1c227746df4e2d9c94f50492651d11 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:37.286535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee488d-3e4c-4f81-b6f3-63f5942614cb admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:37.356945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 962/1905] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:37 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:37.356945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196a056-e219-46bc-adf3-5d321cb6be85 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:37.359234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a196a056-e219-46bc-adf3-5d321cb6be85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:37.388259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:37.392512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196a056-e219-46bc-adf3-5d321cb6be85 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:37.407151 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:37.407841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee488d-3e4c-4f81-b6f3-63f5942614cb admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:37.408229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:37.408802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:37.409633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89 admin admin] PATH_INFO: `/v3/projects/457a947c451149409b6d28cc349e1928` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:37.411663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=457a947c451149409b6d28cc349e1928)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:37.427052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:37.432148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb86586-8be7-4912-8a78-b04a0662d720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:37.433091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb86586-8be7-4912-8a78-b04a0662d720 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:37.433591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb86586-8be7-4912-8a78-b04a0662d720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:37.434096 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb86586-8be7-4912-8a78-b04a0662d720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:37.435142 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb86586-8be7-4912-8a78-b04a0662d720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:37.437188 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb86586-8be7-4912-8a78-b04a0662d720 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:37.453845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 944/1906] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:37.460407 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb86586-8be7-4912-8a78-b04a0662d720 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:37.464689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-fdb86586-8be7-4912-8a78-b04a0662d720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:37.483307 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:37.490094 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb86586-8be7-4912-8a78-b04a0662d720 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:37.500602 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b86a96-7f71-49b7-8a68-de4290df8dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:37.501729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b86a96-7f71-49b7-8a68-de4290df8dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:37.502314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b86a96-7f71-49b7-8a68-de4290df8dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:37.503077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b86a96-7f71-49b7-8a68-de4290df8dd8 admin admin] PATH_INFO: `/v3/users/bab147156f1a4d66847329ff60038042` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:37.505099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b86a96-7f71-49b7-8a68-de4290df8dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab147156f1a4d66847329ff60038042)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:37.509679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b86a96-7f71-49b7-8a68-de4290df8dd8 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:37.608078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457a947c451149409b6d28cc349e1928', 'request_id': 'req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:37.764054 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457a947c451149409b6d28cc349e1928', 'request_id': 'req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:37.775779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457a947c451149409b6d28cc349e1928', 'request_id': 'req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:37.793275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89 admin admin] The token cache is being invalidate because project 457a947c451149409b6d28cc349e1928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:37.793782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:37.794643 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:37.796438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 963/1907] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:37 2022] DELETE /identity/v3/projects/457a947c451149409b6d28cc349e1928 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:37.797524 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:37.798613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-90b86a96-7f71-49b7-8a68-de4290df8dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab147156f1a4d66847329ff60038042'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:37.799002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:37.799814 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-90b86a96-7f71-49b7-8a68-de4290df8dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab147156f1a4d66847329ff60038042'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:37.829219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-90b86a96-7f71-49b7-8a68-de4290df8dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab147156f1a4d66847329ff60038042'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:37.830964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-90b86a96-7f71-49b7-8a68-de4290df8dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab147156f1a4d66847329ff60038042'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:37.896253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7a9f6-a96e-4745-8d7d-fe88c409cf89 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:37.903394 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770292c5-ab1b-4fd7-a034-02977f613e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:37.904285 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770292c5-ab1b-4fd7-a034-02977f613e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:37.904745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770292c5-ab1b-4fd7-a034-02977f613e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:37.905142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770292c5-ab1b-4fd7-a034-02977f613e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:37.906712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770292c5-ab1b-4fd7-a034-02977f613e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:37.908201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770292c5-ab1b-4fd7-a034-02977f613e81 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:37.923667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 964/1908] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:37.925926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770292c5-ab1b-4fd7-a034-02977f613e81 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:37.928220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-770292c5-ab1b-4fd7-a034-02977f613e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:37.950761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770292c5-ab1b-4fd7-a034-02977f613e81 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:37.952762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-90b86a96-7f71-49b7-8a68-de4290df8dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab147156f1a4d66847329ff60038042'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:37.960393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142af3b-66e5-44cc-8057-f6750b562991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:37.961767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142af3b-66e5-44cc-8057-f6750b562991 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:37.962025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142af3b-66e5-44cc-8057-f6750b562991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:37.962555 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142af3b-66e5-44cc-8057-f6750b562991 admin admin] PATH_INFO: `/v3/projects/db587411c4ea494d8e20574bcabd8a89/users/94c8ea6466384ccd97415e2bf7d9f0e7/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:37.986598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 945/1909] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:37 2022] DELETE /identity/v3/users/bab147156f1a4d66847329ff60038042 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:37.986598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b86a96-7f71-49b7-8a68-de4290df8dd8 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:37.994100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-90b86a96-7f71-49b7-8a68-de4290df8dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:37.994661 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142af3b-66e5-44cc-8057-f6750b562991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db587411c4ea494d8e20574bcabd8a89, user_id=94c8ea6466384ccd97415e2bf7d9f0e7, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:37.999916 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142af3b-66e5-44cc-8057-f6750b562991 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:38.158716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b86a96-7f71-49b7-8a68-de4290df8dd8 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:38.160840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 965/1910] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:37 2022] PUT /identity/v3/projects/db587411c4ea494d8e20574bcabd8a89/users/94c8ea6466384ccd97415e2bf7d9f0e7/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:38.164622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142af3b-66e5-44cc-8057-f6750b562991 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:38.173021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3142af3b-66e5-44cc-8057-f6750b562991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:38.291835 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113e5d5-1d29-4189-b606-3435f55cfafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:38.293026 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113e5d5-1d29-4189-b606-3435f55cfafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:38.293214 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113e5d5-1d29-4189-b606-3435f55cfafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:38.293577 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113e5d5-1d29-4189-b606-3435f55cfafa admin admin] PATH_INFO: `/v3/users/6fd811e436be4793837a545f8171d4e9` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:38.295097 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113e5d5-1d29-4189-b606-3435f55cfafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd811e436be4793837a545f8171d4e9)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:38.297464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113e5d5-1d29-4189-b606-3435f55cfafa admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:38.321080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142af3b-66e5-44cc-8057-f6750b562991 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:38.341693 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bb9a3-db0d-421e-9153-fbdbac3de127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:38.342946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bb9a3-db0d-421e-9153-fbdbac3de127 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:38.343458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bb9a3-db0d-421e-9153-fbdbac3de127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:38.344213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bb9a3-db0d-421e-9153-fbdbac3de127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:38.345990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bb9a3-db0d-421e-9153-fbdbac3de127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:38.352661 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bb9a3-db0d-421e-9153-fbdbac3de127 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:38.379599 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 966/1911] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:38.382904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaed182-d356-4785-8b87-dfdb33bd30d7 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:38.383784 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaed182-d356-4785-8b87-dfdb33bd30d7 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:38.384225 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaed182-d356-4785-8b87-dfdb33bd30d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:38.455754 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-cfaed182-d356-4785-8b87-dfdb33bd30d7 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:38.457909 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-cfaed182-d356-4785-8b87-dfdb33bd30d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:38.488335 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 967/1912] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:38.491382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711867e-15c2-42e6-a48f-2b2643b0755a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:38.492288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711867e-15c2-42e6-a48f-2b2643b0755a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:38.493501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711867e-15c2-42e6-a48f-2b2643b0755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:38.543465 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a711867e-15c2-42e6-a48f-2b2643b0755a None None] MFA Rules not processed for user `94c8ea6466384ccd97415e2bf7d9f0e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:38.547101 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a711867e-15c2-42e6-a48f-2b2643b0755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:38.629331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2113e5d5-1d29-4189-b606-3435f55cfafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd811e436be4793837a545f8171d4e9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:38.631803 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2113e5d5-1d29-4189-b606-3435f55cfafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd811e436be4793837a545f8171d4e9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:38.640857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 968/1913] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:38.646802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711867e-15c2-42e6-a48f-2b2643b0755a None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:38.653139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2113e5d5-1d29-4189-b606-3435f55cfafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd811e436be4793837a545f8171d4e9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:38.654054 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2113e5d5-1d29-4189-b606-3435f55cfafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd811e436be4793837a545f8171d4e9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:38.660168 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711867e-15c2-42e6-a48f-2b2643b0755a None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:38.671879 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229538d-3d15-4573-b32a-4ac80f745136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:38.672737 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229538d-3d15-4573-b32a-4ac80f745136 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:38.673131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229538d-3d15-4573-b32a-4ac80f745136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:38.673486 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229538d-3d15-4573-b32a-4ac80f745136 admin admin] PATH_INFO: `/v3/projects/1db2913e718a4b4383e4a946d1e664f4/users/7c81da893e8b48d0850217b1ef1ac11a/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:38.702271 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229538d-3d15-4573-b32a-4ac80f745136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db2913e718a4b4383e4a946d1e664f4, user_id=7c81da893e8b48d0850217b1ef1ac11a, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:38.708198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229538d-3d15-4573-b32a-4ac80f745136 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:38.826168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2113e5d5-1d29-4189-b606-3435f55cfafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd811e436be4793837a545f8171d4e9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:38.852132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 946/1914] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:37 2022] DELETE /identity/v3/users/6fd811e436be4793837a545f8171d4e9 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:38.852952 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113e5d5-1d29-4189-b606-3435f55cfafa admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:38.854655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2113e5d5-1d29-4189-b606-3435f55cfafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:38.878875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 969/1915] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:38 2022] PUT /identity/v3/projects/1db2913e718a4b4383e4a946d1e664f4/users/7c81da893e8b48d0850217b1ef1ac11a/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:38.880478 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229538d-3d15-4573-b32a-4ac80f745136 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:38.890498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0229538d-3d15-4573-b32a-4ac80f745136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:39.015945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229538d-3d15-4573-b32a-4ac80f745136 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:39.020521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113e5d5-1d29-4189-b606-3435f55cfafa admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:39.025512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b776c0-5314-459e-90b4-d2b1cdeb6c13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:39.026669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b776c0-5314-459e-90b4-d2b1cdeb6c13 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:39.029401 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b776c0-5314-459e-90b4-d2b1cdeb6c13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:39.032189 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b776c0-5314-459e-90b4-d2b1cdeb6c13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:39.042147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c0b776c0-5314-459e-90b4-d2b1cdeb6c13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:39.084039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:39.143697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:39.160418 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a69f9-2e34-4613-aa47-4d71703e7189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:39.162092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a69f9-2e34-4613-aa47-4d71703e7189 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:39.162681 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a69f9-2e34-4613-aa47-4d71703e7189 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:39.163736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a69f9-2e34-4613-aa47-4d71703e7189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:39.168828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a81a69f9-2e34-4613-aa47-4d71703e7189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:39.196108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b776c0-5314-459e-90b4-d2b1cdeb6c13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:39.202460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b776c0-5314-459e-90b4-d2b1cdeb6c13 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:39.229274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 970/1916] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:39.242732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b776c0-5314-459e-90b4-d2b1cdeb6c13 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:39.253714 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c0b776c0-5314-459e-90b4-d2b1cdeb6c13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:39.389165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a69f9-2e34-4613-aa47-4d71703e7189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:39.411840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a69f9-2e34-4613-aa47-4d71703e7189 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:39.458136 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 947/1917] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:39.460613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e62858-f653-497c-8b50-744a8d486622 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:39.462163 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e62858-f653-497c-8b50-744a8d486622 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:39.464429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e62858-f653-497c-8b50-744a8d486622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:39.547588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d9e62858-f653-497c-8b50-744a8d486622 None None] MFA Rules not processed for user `7c81da893e8b48d0850217b1ef1ac11a`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:39.548929 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d9e62858-f653-497c-8b50-744a8d486622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:39.613411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b776c0-5314-459e-90b4-d2b1cdeb6c13 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:39.635805 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a134d3-bed8-4317-b8e4-7bc25aa4f11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:39.636289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a134d3-bed8-4317-b8e4-7bc25aa4f11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:39.636794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a134d3-bed8-4317-b8e4-7bc25aa4f11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:39.637513 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a134d3-bed8-4317-b8e4-7bc25aa4f11b admin admin] PATH_INFO: `/v3/projects/e678b5a41191478ba853939a18b6528d` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:39.642765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a134d3-bed8-4317-b8e4-7bc25aa4f11b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e678b5a41191478ba853939a18b6528d)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:39.645572 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a134d3-bed8-4317-b8e4-7bc25aa4f11b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:39.715638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 948/1918] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:39.726532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e62858-f653-497c-8b50-744a8d486622 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:39.731302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d9e62858-f653-497c-8b50-744a8d486622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:39.757897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e62858-f653-497c-8b50-744a8d486622 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:39.767740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca56683-2267-479c-9466-47a6c7e9c032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:39.768947 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca56683-2267-479c-9466-47a6c7e9c032 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:39.769378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca56683-2267-479c-9466-47a6c7e9c032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:39.769813 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca56683-2267-479c-9466-47a6c7e9c032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:39.770788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca56683-2267-479c-9466-47a6c7e9c032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:39.774840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca56683-2267-479c-9466-47a6c7e9c032 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:39.910787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-40a134d3-bed8-4317-b8e4-7bc25aa4f11b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e678b5a41191478ba853939a18b6528d', 'request_id': 'req-40a134d3-bed8-4317-b8e4-7bc25aa4f11b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:39.982283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 949/1919] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:39 2022] POST /identity/v3/projects => generated 367 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:21:39.987162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca56683-2267-479c-9466-47a6c7e9c032 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:40.044539 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-40a134d3-bed8-4317-b8e4-7bc25aa4f11b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e678b5a41191478ba853939a18b6528d', 'request_id': 'req-40a134d3-bed8-4317-b8e4-7bc25aa4f11b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:40.057726 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-40a134d3-bed8-4317-b8e4-7bc25aa4f11b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e678b5a41191478ba853939a18b6528d', 'request_id': 'req-40a134d3-bed8-4317-b8e4-7bc25aa4f11b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:40.079668 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-40a134d3-bed8-4317-b8e4-7bc25aa4f11b admin admin] The token cache is being invalidate because project e678b5a41191478ba853939a18b6528d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:40.080130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-40a134d3-bed8-4317-b8e4-7bc25aa4f11b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:40.081561 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-40a134d3-bed8-4317-b8e4-7bc25aa4f11b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:40.084797 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 971/1920] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:39 2022] DELETE /identity/v3/projects/e678b5a41191478ba853939a18b6528d => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:40.092485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70187d34-4dce-46cb-9387-0875c507a403 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:40.092962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70187d34-4dce-46cb-9387-0875c507a403 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:40.094226 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70187d34-4dce-46cb-9387-0875c507a403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:40.130009 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca56683-2267-479c-9466-47a6c7e9c032 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:40.139988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-70187d34-4dce-46cb-9387-0875c507a403 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:40.142661 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-70187d34-4dce-46cb-9387-0875c507a403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:40.160728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 972/1921] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:21:40.164937 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70187d34-4dce-46cb-9387-0875c507a403 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:40.168555 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-70187d34-4dce-46cb-9387-0875c507a403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:40.171906 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f32bcc-f2ef-4d27-98bd-b3bf608b0da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:40.172865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f32bcc-f2ef-4d27-98bd-b3bf608b0da7 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:40.174503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f32bcc-f2ef-4d27-98bd-b3bf608b0da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:40.174503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f32bcc-f2ef-4d27-98bd-b3bf608b0da7 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:40.179360 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f32bcc-f2ef-4d27-98bd-b3bf608b0da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:40.186301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f32bcc-f2ef-4d27-98bd-b3bf608b0da7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:40.198911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70187d34-4dce-46cb-9387-0875c507a403 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:40.209560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:40.211903 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:40.212680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:40.213381 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d admin admin] PATH_INFO: `/v3/projects/9233038461624a8184183a75692d5f8a` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:40.216394 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9233038461624a8184183a75692d5f8a)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:40.221074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:40.307583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:40.410438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 950/1922] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:39 2022] POST /identity/v3/users => generated 290 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:40.412586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f6dd1-6893-4d2b-bbd5-f24cb078a845 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:40.413146 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f6dd1-6893-4d2b-bbd5-f24cb078a845 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:40.413616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f6dd1-6893-4d2b-bbd5-f24cb078a845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:40.460998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9233038461624a8184183a75692d5f8a', 'request_id': 'req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:40.465286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-586f6dd1-6893-4d2b-bbd5-f24cb078a845 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:40.467959 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-586f6dd1-6893-4d2b-bbd5-f24cb078a845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:40.578133 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 951/1923] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:40.579517 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f6dd1-6893-4d2b-bbd5-f24cb078a845 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:40.583260 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-586f6dd1-6893-4d2b-bbd5-f24cb078a845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:40.587437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9233038461624a8184183a75692d5f8a', 'request_id': 'req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:40.596696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9233038461624a8184183a75692d5f8a', 'request_id': 'req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:40.613390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d admin admin] The token cache is being invalidate because project 9233038461624a8184183a75692d5f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:40.614345 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:40.616042 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:40.617181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f6dd1-6893-4d2b-bbd5-f24cb078a845 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:40.619851 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 973/1924] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:40 2022] DELETE /identity/v3/projects/9233038461624a8184183a75692d5f8a => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:40.623874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:40.625932 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:40.627148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e04478-2719-4b2d-a3d1-d944b0604616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:40.627867 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e04478-2719-4b2d-a3d1-d944b0604616 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:40.628359 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e04478-2719-4b2d-a3d1-d944b0604616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:40.628832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e04478-2719-4b2d-a3d1-d944b0604616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:40.630109 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e04478-2719-4b2d-a3d1-d944b0604616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:40.633405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e04478-2719-4b2d-a3d1-d944b0604616 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:40.646164 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b78159-3dcf-45cb-b1cd-bd6486962c5d admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:40.660336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 952/1925] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:40.660336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e04478-2719-4b2d-a3d1-d944b0604616 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:40.660336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-13e04478-2719-4b2d-a3d1-d944b0604616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:40.660783 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ec2ab-5801-4952-9570-3ceb12d1beb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:40.660783 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ec2ab-5801-4952-9570-3ceb12d1beb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:40.660783 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ec2ab-5801-4952-9570-3ceb12d1beb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:40.664788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ec2ab-5801-4952-9570-3ceb12d1beb4 admin admin] PATH_INFO: `/v3/projects/7c069fbe29db4e45beb3f9b988f6ded5` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:40.664788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ec2ab-5801-4952-9570-3ceb12d1beb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c069fbe29db4e45beb3f9b988f6ded5)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:40.666269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ec2ab-5801-4952-9570-3ceb12d1beb4 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:40.674311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e04478-2719-4b2d-a3d1-d944b0604616 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:40.686706 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055ce05-99c7-432e-bdcb-2f1d2ef5efd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:40.687978 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055ce05-99c7-432e-bdcb-2f1d2ef5efd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:40.688507 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055ce05-99c7-432e-bdcb-2f1d2ef5efd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:40.688966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055ce05-99c7-432e-bdcb-2f1d2ef5efd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:40.691159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055ce05-99c7-432e-bdcb-2f1d2ef5efd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:21:40.691591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055ce05-99c7-432e-bdcb-2f1d2ef5efd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:40.695334 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055ce05-99c7-432e-bdcb-2f1d2ef5efd1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:40.719364 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 953/1926] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:21:40.721337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46727e1c-c122-4255-91e0-68ed043cd6cd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:40.721668 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46727e1c-c122-4255-91e0-68ed043cd6cd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:40.721931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46727e1c-c122-4255-91e0-68ed043cd6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:40.750053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-46727e1c-c122-4255-91e0-68ed043cd6cd None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:40.751535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-46727e1c-c122-4255-91e0-68ed043cd6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:40.762714 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 954/1927] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:40.763783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46727e1c-c122-4255-91e0-68ed043cd6cd None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:40.765721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-46727e1c-c122-4255-91e0-68ed043cd6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:40.797865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46727e1c-c122-4255-91e0-68ed043cd6cd None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:40.807436 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f980c-2ac6-44e7-bce5-f9dc97518da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:40.808526 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f980c-2ac6-44e7-bce5-f9dc97518da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:40.809027 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f980c-2ac6-44e7-bce5-f9dc97518da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:40.809492 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f980c-2ac6-44e7-bce5-f9dc97518da0 admin admin] PATH_INFO: `/v3/projects/f942f55dd7874344a0e3579314481975/users/958b77ea9a034a4191015a5b144c3201/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:40.840758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f980c-2ac6-44e7-bce5-f9dc97518da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f942f55dd7874344a0e3579314481975, user_id=958b77ea9a034a4191015a5b144c3201, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:40.854736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f980c-2ac6-44e7-bce5-f9dc97518da0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:40.872003 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-2b8ec2ab-5801-4952-9570-3ceb12d1beb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c069fbe29db4e45beb3f9b988f6ded5', 'request_id': 'req-2b8ec2ab-5801-4952-9570-3ceb12d1beb4'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:40.940909 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 955/1928] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:40 2022] PUT /identity/v3/projects/f942f55dd7874344a0e3579314481975/users/958b77ea9a034a4191015a5b144c3201/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:40.942297 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f980c-2ac6-44e7-bce5-f9dc97518da0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:41.021898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-2b8ec2ab-5801-4952-9570-3ceb12d1beb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c069fbe29db4e45beb3f9b988f6ded5', 'request_id': 'req-2b8ec2ab-5801-4952-9570-3ceb12d1beb4'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:41.033781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-2b8ec2ab-5801-4952-9570-3ceb12d1beb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c069fbe29db4e45beb3f9b988f6ded5', 'request_id': 'req-2b8ec2ab-5801-4952-9570-3ceb12d1beb4'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:41.055442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-2b8ec2ab-5801-4952-9570-3ceb12d1beb4 admin admin] The token cache is being invalidate because project 7c069fbe29db4e45beb3f9b988f6ded5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:41.055814 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-2b8ec2ab-5801-4952-9570-3ceb12d1beb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:41.063039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-2b8ec2ab-5801-4952-9570-3ceb12d1beb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:41.063039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 974/1929] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:40 2022] DELETE /identity/v3/projects/7c069fbe29db4e45beb3f9b988f6ded5 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:41.063039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b5faf-7911-4d1e-ae43-7644af27f501 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:41.063039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b5faf-7911-4d1e-ae43-7644af27f501 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:41.063039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b5faf-7911-4d1e-ae43-7644af27f501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:41.079485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f980c-2ac6-44e7-bce5-f9dc97518da0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:41.090157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca5a26-041a-4d57-91d1-83b3e845bbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:41.091312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca5a26-041a-4d57-91d1-83b3e845bbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:41.092137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca5a26-041a-4d57-91d1-83b3e845bbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:41.094159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:41.094918 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca5a26-041a-4d57-91d1-83b3e845bbc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:41.096490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca5a26-041a-4d57-91d1-83b3e845bbc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:41.099923 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca5a26-041a-4d57-91d1-83b3e845bbc4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:41.108997 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-ff4b5faf-7911-4d1e-ae43-7644af27f501 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:41.111690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ff4b5faf-7911-4d1e-ae43-7644af27f501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:41.151145 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 975/1930] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:41.151145 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b5faf-7911-4d1e-ae43-7644af27f501 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:41.165587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ff4b5faf-7911-4d1e-ae43-7644af27f501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:41.189173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b5faf-7911-4d1e-ae43-7644af27f501 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:41.201740 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46928208-d861-4c83-aef6-3e336e140a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:41.202804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46928208-d861-4c83-aef6-3e336e140a90 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:41.203284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46928208-d861-4c83-aef6-3e336e140a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:41.203749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46928208-d861-4c83-aef6-3e336e140a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:41.205005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46928208-d861-4c83-aef6-3e336e140a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:41.208110 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46928208-d861-4c83-aef6-3e336e140a90 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:41.230420 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 976/1931] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:41.231774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46928208-d861-4c83-aef6-3e336e140a90 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:41.237152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-46928208-d861-4c83-aef6-3e336e140a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:41.263136 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46928208-d861-4c83-aef6-3e336e140a90 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:41.271686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f3fc4-3707-45fe-9b2d-75fffdee84cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:41.273419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f3fc4-3707-45fe-9b2d-75fffdee84cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:41.273419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f3fc4-3707-45fe-9b2d-75fffdee84cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:41.273419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f3fc4-3707-45fe-9b2d-75fffdee84cc admin admin] PATH_INFO: `/v3/users/a8df4e48979d4854aae91b2545b22bf4` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:41.275398 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f3fc4-3707-45fe-9b2d-75fffdee84cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8df4e48979d4854aae91b2545b22bf4)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:41.279303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f3fc4-3707-45fe-9b2d-75fffdee84cc admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:41.289464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 956/1932] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:40 2022] POST /identity/v3/projects => generated 365 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:41.289464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca5a26-041a-4d57-91d1-83b3e845bbc4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:41.383339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca5a26-041a-4d57-91d1-83b3e845bbc4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:41.392011 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36d288-70bb-45af-a064-1baf7ddd53cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:41.393033 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36d288-70bb-45af-a064-1baf7ddd53cf admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:41.393528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36d288-70bb-45af-a064-1baf7ddd53cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:41.394015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36d288-70bb-45af-a064-1baf7ddd53cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:41.395440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36d288-70bb-45af-a064-1baf7ddd53cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:21:41.395987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36d288-70bb-45af-a064-1baf7ddd53cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:41.399412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36d288-70bb-45af-a064-1baf7ddd53cf admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:41.421812 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 957/1933] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:21:41.423324 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36d288-70bb-45af-a064-1baf7ddd53cf admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:41.443031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36d288-70bb-45af-a064-1baf7ddd53cf admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:41.451137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd61f5-ae24-403c-9293-79c10804feda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:41.453485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd61f5-ae24-403c-9293-79c10804feda admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:41.453948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd61f5-ae24-403c-9293-79c10804feda admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:41.458583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd61f5-ae24-403c-9293-79c10804feda admin admin] PATH_INFO: `/v3/projects/f942f55dd7874344a0e3579314481975/users/958b77ea9a034a4191015a5b144c3201/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:41.458583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd61f5-ae24-403c-9293-79c10804feda admin admin] RBAC: Authorizing `identity:create_grant(project_id=f942f55dd7874344a0e3579314481975, user_id=958b77ea9a034a4191015a5b144c3201, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:41.462123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd61f5-ae24-403c-9293-79c10804feda admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:41.477634 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 958/1934] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:41 2022] PUT /identity/v3/projects/f942f55dd7874344a0e3579314481975/users/958b77ea9a034a4191015a5b144c3201/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:41.479005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd61f5-ae24-403c-9293-79c10804feda admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:41.481197 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e2bd61f5-ae24-403c-9293-79c10804feda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:41.597975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b51f3fc4-3707-45fe-9b2d-75fffdee84cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8df4e48979d4854aae91b2545b22bf4'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:41.599437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b51f3fc4-3707-45fe-9b2d-75fffdee84cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8df4e48979d4854aae91b2545b22bf4'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:41.636864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b51f3fc4-3707-45fe-9b2d-75fffdee84cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8df4e48979d4854aae91b2545b22bf4'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:41.665164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd61f5-ae24-403c-9293-79c10804feda admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:41.674684 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aab84c-58e6-4509-96e7-726deff968e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:41.676120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aab84c-58e6-4509-96e7-726deff968e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:41.676878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aab84c-58e6-4509-96e7-726deff968e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:41.677511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aab84c-58e6-4509-96e7-726deff968e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:41.678942 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aab84c-58e6-4509-96e7-726deff968e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:41.684218 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aab84c-58e6-4509-96e7-726deff968e5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:41.724836 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b51f3fc4-3707-45fe-9b2d-75fffdee84cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8df4e48979d4854aae91b2545b22bf4'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:41.728114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-b51f3fc4-3707-45fe-9b2d-75fffdee84cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8df4e48979d4854aae91b2545b22bf4'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:41.769195 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 977/1935] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:41 2022] DELETE /identity/v3/users/a8df4e48979d4854aae91b2545b22bf4 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:41.769867 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f3fc4-3707-45fe-9b2d-75fffdee84cc admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:41.780277 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b51f3fc4-3707-45fe-9b2d-75fffdee84cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:41.929619 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 959/1936] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:41 2022] POST /identity/v3/users => generated 283 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:41.935142 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2de212-babe-4588-9484-5e694fb597f0 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:41.936059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2de212-babe-4588-9484-5e694fb597f0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:41.937041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2de212-babe-4588-9484-5e694fb597f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:41.995503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f3fc4-3707-45fe-9b2d-75fffdee84cc admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:42.001064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8f755-4b56-4971-b67e-26b34d6d332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:42.001765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8f755-4b56-4971-b67e-26b34d6d332a admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:42.002137 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8f755-4b56-4971-b67e-26b34d6d332a admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:42.002504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8f755-4b56-4971-b67e-26b34d6d332a admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:42.003939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8f755-4b56-4971-b67e-26b34d6d332a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:42.005954 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8f755-4b56-4971-b67e-26b34d6d332a admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:42.010199 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2b2de212-babe-4588-9484-5e694fb597f0 None None] MFA Rules not processed for user `958b77ea9a034a4191015a5b144c3201`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:42.012926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2b2de212-babe-4588-9484-5e694fb597f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:42.174985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 960/1937] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:42.176479 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2de212-babe-4588-9484-5e694fb597f0 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:42.183362 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2b2de212-babe-4588-9484-5e694fb597f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:42.215558 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2de212-babe-4588-9484-5e694fb597f0 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:42.227336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12deece4-9dd3-4eb5-bf76-9193130b1aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:42.228794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deece4-9dd3-4eb5-bf76-9193130b1aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:42.229372 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deece4-9dd3-4eb5-bf76-9193130b1aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:42.230184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deece4-9dd3-4eb5-bf76-9193130b1aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:42.231699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12deece4-9dd3-4eb5-bf76-9193130b1aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:42.235760 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12deece4-9dd3-4eb5-bf76-9193130b1aa5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:42.239444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 978/1938] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:41 2022] POST /identity/v3/projects => generated 365 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:42.243791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8f755-4b56-4971-b67e-26b34d6d332a admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:42.247337 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-64d8f755-4b56-4971-b67e-26b34d6d332a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:42.283205 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 961/1939] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:42.285023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12deece4-9dd3-4eb5-bf76-9193130b1aa5 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:42.341197 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12deece4-9dd3-4eb5-bf76-9193130b1aa5 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:42.426548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8f755-4b56-4971-b67e-26b34d6d332a admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:42.441593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b776f9-2dfa-4c77-9b43-887567e0aa03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:42.442510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b776f9-2dfa-4c77-9b43-887567e0aa03 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:42.443019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b776f9-2dfa-4c77-9b43-887567e0aa03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:42.443498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b776f9-2dfa-4c77-9b43-887567e0aa03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:42.533046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af5407-9248-4391-a942-5400d3063aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:42.534298 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af5407-9248-4391-a942-5400d3063aed admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:42.534952 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af5407-9248-4391-a942-5400d3063aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:42.535518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af5407-9248-4391-a942-5400d3063aed admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:42.536920 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af5407-9248-4391-a942-5400d3063aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:42.541636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af5407-9248-4391-a942-5400d3063aed admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:42.605357 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:42.627506 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b776f9-2dfa-4c77-9b43-887567e0aa03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:42.629310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b776f9-2dfa-4c77-9b43-887567e0aa03 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:42.646904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 979/1940] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:42.648852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b776f9-2dfa-4c77-9b43-887567e0aa03 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:42.684416 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b776f9-2dfa-4c77-9b43-887567e0aa03 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:42.694801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0ec94-e25d-4407-af57-24cd827872f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:42.697150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0ec94-e25d-4407-af57-24cd827872f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:42.698126 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0ec94-e25d-4407-af57-24cd827872f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:42.698894 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0ec94-e25d-4407-af57-24cd827872f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:42.700959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0ec94-e25d-4407-af57-24cd827872f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:42.704338 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0ec94-e25d-4407-af57-24cd827872f9 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:42.728683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 980/1941] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:42.734664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0ec94-e25d-4407-af57-24cd827872f9 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:42.775090 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 962/1942] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:42 2022] POST /identity/v3/users => generated 283 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:42.778396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af5407-9248-4391-a942-5400d3063aed admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:42.778567 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0ec94-e25d-4407-af57-24cd827872f9 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:42.780671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d8af5407-9248-4391-a942-5400d3063aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:42.791330 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2dc8d9-b982-4fb1-80cc-6e606d3829a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:42.792783 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dc8d9-b982-4fb1-80cc-6e606d3829a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:42.794462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dc8d9-b982-4fb1-80cc-6e606d3829a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:42.794462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dc8d9-b982-4fb1-80cc-6e606d3829a6 admin admin] PATH_INFO: `/v3/projects/0bb90c45cbcd499eaa032239aa661625/users/c0e3ed889b524d768202b10475af3b35/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:42.832494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2dc8d9-b982-4fb1-80cc-6e606d3829a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bb90c45cbcd499eaa032239aa661625, user_id=c0e3ed889b524d768202b10475af3b35, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:42.838881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2dc8d9-b982-4fb1-80cc-6e606d3829a6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:42.839893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af5407-9248-4391-a942-5400d3063aed admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:42.850007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68ba14-b945-47e0-ad29-a0480a66e36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:42.852368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68ba14-b945-47e0-ad29-a0480a66e36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:42.853162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68ba14-b945-47e0-ad29-a0480a66e36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:42.857434 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68ba14-b945-47e0-ad29-a0480a66e36f admin admin] PATH_INFO: `/v3/projects/29b498a8fcda42e0a18743ce91f784fa` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:42.857434 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68ba14-b945-47e0-ad29-a0480a66e36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b498a8fcda42e0a18743ce91f784fa)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:42.860712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68ba14-b945-47e0-ad29-a0480a66e36f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:42.993128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 981/1943] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:42 2022] PUT /identity/v3/projects/0bb90c45cbcd499eaa032239aa661625/users/c0e3ed889b524d768202b10475af3b35/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:42.994818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2dc8d9-b982-4fb1-80cc-6e606d3829a6 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:43.109142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2dc8d9-b982-4fb1-80cc-6e606d3829a6 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:43.114792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078094af-b703-4d9c-b963-78a376a19936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:43.115473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078094af-b703-4d9c-b963-78a376a19936 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:43.115853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078094af-b703-4d9c-b963-78a376a19936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:43.116556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078094af-b703-4d9c-b963-78a376a19936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:43.117780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078094af-b703-4d9c-b963-78a376a19936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:43.119640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078094af-b703-4d9c-b963-78a376a19936 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:43.143363 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 982/1944] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:43.145665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc87cb-223e-49fd-b25f-2b3055a5df22 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:43.146138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc87cb-223e-49fd-b25f-2b3055a5df22 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:43.147056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc87cb-223e-49fd-b25f-2b3055a5df22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:43.166616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:43.201632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-21bc87cb-223e-49fd-b25f-2b3055a5df22 None None] MFA Rules not processed for user `c0e3ed889b524d768202b10475af3b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:43.203114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-21bc87cb-223e-49fd-b25f-2b3055a5df22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:43.204031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1d68ba14-b945-47e0-ad29-a0480a66e36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b498a8fcda42e0a18743ce91f784fa', 'request_id': 'req-1d68ba14-b945-47e0-ad29-a0480a66e36f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:43.219708 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1d68ba14-b945-47e0-ad29-a0480a66e36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b498a8fcda42e0a18743ce91f784fa', 'request_id': 'req-1d68ba14-b945-47e0-ad29-a0480a66e36f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:43.234428 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1d68ba14-b945-47e0-ad29-a0480a66e36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b498a8fcda42e0a18743ce91f784fa', 'request_id': 'req-1d68ba14-b945-47e0-ad29-a0480a66e36f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:43.361500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1d68ba14-b945-47e0-ad29-a0480a66e36f admin admin] The token cache is being invalidate because project 29b498a8fcda42e0a18743ce91f784fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:43.362191 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1d68ba14-b945-47e0-ad29-a0480a66e36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:43.369691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 983/1945] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:43.369691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc87cb-223e-49fd-b25f-2b3055a5df22 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:43.370099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1d68ba14-b945-47e0-ad29-a0480a66e36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:43.377759 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 963/1946] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:42 2022] DELETE /identity/v3/projects/29b498a8fcda42e0a18743ce91f784fa => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:43.377759 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68ba14-b945-47e0-ad29-a0480a66e36f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:43.380139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1d68ba14-b945-47e0-ad29-a0480a66e36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:43.473818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc87cb-223e-49fd-b25f-2b3055a5df22 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:43.481931 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c9629-71b5-4df4-b22c-ecec6f0787c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:43.483053 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c9629-71b5-4df4-b22c-ecec6f0787c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:43.483544 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c9629-71b5-4df4-b22c-ecec6f0787c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:43.484034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c9629-71b5-4df4-b22c-ecec6f0787c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:43.490449 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-877c9629-71b5-4df4-b22c-ecec6f0787c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:43.512801 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68ba14-b945-47e0-ad29-a0480a66e36f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:43.522932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab995db2-804b-45e3-8467-8b6419645c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:43.533009 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab995db2-804b-45e3-8467-8b6419645c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:43.533419 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab995db2-804b-45e3-8467-8b6419645c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:43.534699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab995db2-804b-45e3-8467-8b6419645c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:43.535013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab995db2-804b-45e3-8467-8b6419645c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:43.538418 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab995db2-804b-45e3-8467-8b6419645c1c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:43.557497 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 964/1947] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:43.558844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab995db2-804b-45e3-8467-8b6419645c1c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:43.561567 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ab995db2-804b-45e3-8467-8b6419645c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:43.591117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab995db2-804b-45e3-8467-8b6419645c1c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:43.599663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb833f70-f993-4893-87ce-82743de736d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:43.602045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb833f70-f993-4893-87ce-82743de736d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:43.602837 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb833f70-f993-4893-87ce-82743de736d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:43.603549 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb833f70-f993-4893-87ce-82743de736d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:43.604733 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb833f70-f993-4893-87ce-82743de736d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:43.608737 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb833f70-f993-4893-87ce-82743de736d0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:43.628928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c9629-71b5-4df4-b22c-ecec6f0787c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:43.631995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c9629-71b5-4df4-b22c-ecec6f0787c4 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:43.656639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 984/1948] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:43.658593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c04520-da6d-4473-b9cd-f90fd610f980 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:43.658794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c04520-da6d-4473-b9cd-f90fd610f980 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:43.659050 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c04520-da6d-4473-b9cd-f90fd610f980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:43.697731 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-98c04520-da6d-4473-b9cd-f90fd610f980 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:43.700118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-98c04520-da6d-4473-b9cd-f90fd610f980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:43.718788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 985/1949] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:43.721730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c04520-da6d-4473-b9cd-f90fd610f980 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:43.759267 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c04520-da6d-4473-b9cd-f90fd610f980 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:43.762945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 965/1950] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:43 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:43.766224 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89885cf-af4c-4074-abe3-635e636d5ece None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:43.770792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89885cf-af4c-4074-abe3-635e636d5ece None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:43.772953 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89885cf-af4c-4074-abe3-635e636d5ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:43.851164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d89885cf-af4c-4074-abe3-635e636d5ece None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:43.853752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d89885cf-af4c-4074-abe3-635e636d5ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:43.922490 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86dfe1-46ae-425c-9d45-fda40b97cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:43.924595 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86dfe1-46ae-425c-9d45-fda40b97cbb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:43.925172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86dfe1-46ae-425c-9d45-fda40b97cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:43.925969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86dfe1-46ae-425c-9d45-fda40b97cbb1 admin admin] PATH_INFO: `/v3/projects/12e7d4708995413a87f036a7b70e20ac/users/00f28c4c1ba547bfbdcafa162608b92f/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:43.967592 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86dfe1-46ae-425c-9d45-fda40b97cbb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e7d4708995413a87f036a7b70e20ac, user_id=00f28c4c1ba547bfbdcafa162608b92f, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:43.973319 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86dfe1-46ae-425c-9d45-fda40b97cbb1 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:44.045047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 966/1951] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:44.046675 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89885cf-af4c-4074-abe3-635e636d5ece None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:44.064293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89885cf-af4c-4074-abe3-635e636d5ece None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:44.072554 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621ea98-9b4f-45f9-a096-98ac348cd276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:44.073362 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621ea98-9b4f-45f9-a096-98ac348cd276 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:44.073653 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621ea98-9b4f-45f9-a096-98ac348cd276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:44.073932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621ea98-9b4f-45f9-a096-98ac348cd276 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:44.075486 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621ea98-9b4f-45f9-a096-98ac348cd276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:44.077535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621ea98-9b4f-45f9-a096-98ac348cd276 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:44.155275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 986/1952] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:43 2022] PUT /identity/v3/projects/12e7d4708995413a87f036a7b70e20ac/users/00f28c4c1ba547bfbdcafa162608b92f/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:44.155275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86dfe1-46ae-425c-9d45-fda40b97cbb1 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:44.225076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 967/1953] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:44 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:44.227564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0803ed2-6951-41c5-acc3-3c560bf2d8d4 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:44.228302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0803ed2-6951-41c5-acc3-3c560bf2d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:44.228970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0803ed2-6951-41c5-acc3-3c560bf2d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:44.257816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:44.296869 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f0803ed2-6951-41c5-acc3-3c560bf2d8d4 None None] MFA Rules not processed for user `00f28c4c1ba547bfbdcafa162608b92f`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:44.298194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f0803ed2-6951-41c5-acc3-3c560bf2d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:44.311084 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86dfe1-46ae-425c-9d45-fda40b97cbb1 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:44.327288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb403cdd-e2a1-440d-8bfa-d29d111636bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:44.328359 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb403cdd-e2a1-440d-8bfa-d29d111636bd admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:44.328848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb403cdd-e2a1-440d-8bfa-d29d111636bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:44.329334 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb403cdd-e2a1-440d-8bfa-d29d111636bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:44.330780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb403cdd-e2a1-440d-8bfa-d29d111636bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:21:44.331303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb403cdd-e2a1-440d-8bfa-d29d111636bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:44.338964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb403cdd-e2a1-440d-8bfa-d29d111636bd admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:44.361253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 987/1954] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:21:44.363026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb403cdd-e2a1-440d-8bfa-d29d111636bd admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:44.382537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb403cdd-e2a1-440d-8bfa-d29d111636bd admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:44.391241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb93f33-a65e-473e-bd2e-76ce0ee3d329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:44.392643 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb93f33-a65e-473e-bd2e-76ce0ee3d329 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:44.393056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb93f33-a65e-473e-bd2e-76ce0ee3d329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:44.393853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb93f33-a65e-473e-bd2e-76ce0ee3d329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:44.395403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb93f33-a65e-473e-bd2e-76ce0ee3d329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:44.397864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb93f33-a65e-473e-bd2e-76ce0ee3d329 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:44.429018 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 968/1955] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:44.430568 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0803ed2-6951-41c5-acc3-3c560bf2d8d4 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:44.438803 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 988/1956] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:44.439763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb93f33-a65e-473e-bd2e-76ce0ee3d329 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:44.455002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb93f33-a65e-473e-bd2e-76ce0ee3d329 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:44.465774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f98c3-c3a4-475d-a456-a93beaeb50ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:44.467116 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f98c3-c3a4-475d-a456-a93beaeb50ba admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:44.467818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f98c3-c3a4-475d-a456-a93beaeb50ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:44.468276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0803ed2-6951-41c5-acc3-3c560bf2d8d4 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:44.468421 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f98c3-c3a4-475d-a456-a93beaeb50ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:44.469655 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f98c3-c3a4-475d-a456-a93beaeb50ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:44.473501 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f98c3-c3a4-475d-a456-a93beaeb50ba admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:44.477629 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fda23-bc3c-40e5-8959-bd5543050f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:44.478737 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fda23-bc3c-40e5-8959-bd5543050f05 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:44.479135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fda23-bc3c-40e5-8959-bd5543050f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:44.479518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fda23-bc3c-40e5-8959-bd5543050f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:44.480439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fda23-bc3c-40e5-8959-bd5543050f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:44.482828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fda23-bc3c-40e5-8959-bd5543050f05 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:44.507072 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:44.660089 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 989/1957] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:44 2022] POST /identity/v3/projects => generated 363 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:44.660089 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f98c3-c3a4-475d-a456-a93beaeb50ba admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:44.661069 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 969/1958] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:44 2022] POST /identity/v3/projects => generated 401 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:44.661920 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fda23-bc3c-40e5-8959-bd5543050f05 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:44.802753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fda23-bc3c-40e5-8959-bd5543050f05 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:44.815416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6df775-2608-45ad-a295-99271ef474ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:44.816862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6df775-2608-45ad-a295-99271ef474ba admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:44.817349 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6df775-2608-45ad-a295-99271ef474ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:44.817824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6df775-2608-45ad-a295-99271ef474ba admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:44.819810 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6df775-2608-45ad-a295-99271ef474ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:44.825162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6df775-2608-45ad-a295-99271ef474ba admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:44.826531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f98c3-c3a4-475d-a456-a93beaeb50ba admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:44.836351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b966a6-3eb3-4b9a-8521-9b8d8824942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:44.837746 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b966a6-3eb3-4b9a-8521-9b8d8824942d admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:44.838155 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b966a6-3eb3-4b9a-8521-9b8d8824942d admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:44.838685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b966a6-3eb3-4b9a-8521-9b8d8824942d admin admin] PATH_INFO: `/v3/projects/48f4260eb20d4ef897f671318f8a3ebd/users/4e3722f8eb854da7b8e4203ba3b3dea0/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:44.876355 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b966a6-3eb3-4b9a-8521-9b8d8824942d admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f4260eb20d4ef897f671318f8a3ebd, user_id=4e3722f8eb854da7b8e4203ba3b3dea0, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:44.896340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b966a6-3eb3-4b9a-8521-9b8d8824942d admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:45.023407 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 970/1959] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:44 2022] POST /identity/v3/users => generated 288 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:45.024512 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6df775-2608-45ad-a295-99271ef474ba admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:45.038109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 990/1960] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:44 2022] PUT /identity/v3/projects/48f4260eb20d4ef897f671318f8a3ebd/users/4e3722f8eb854da7b8e4203ba3b3dea0/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:45.039037 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b966a6-3eb3-4b9a-8521-9b8d8824942d admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:45.054248 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6df775-2608-45ad-a295-99271ef474ba admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:45.151503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b966a6-3eb3-4b9a-8521-9b8d8824942d admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:45.161485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd42e92-16c0-4469-90c3-69d557ef3d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:45.162164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1b356-1bf0-4c2e-924a-3472f98c208c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:45.162869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd42e92-16c0-4469-90c3-69d557ef3d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:45.163248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd42e92-16c0-4469-90c3-69d557ef3d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:45.167434 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1b356-1bf0-4c2e-924a-3472f98c208c admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:45.167756 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd42e92-16c0-4469-90c3-69d557ef3d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:45.167950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1b356-1bf0-4c2e-924a-3472f98c208c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:45.167950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1b356-1bf0-4c2e-924a-3472f98c208c admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:45.168256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd42e92-16c0-4469-90c3-69d557ef3d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:45.168433 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1b356-1bf0-4c2e-924a-3472f98c208c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:45.168608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd42e92-16c0-4469-90c3-69d557ef3d59 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:45.170894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1b356-1bf0-4c2e-924a-3472f98c208c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:45.181621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 991/1961] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:45.182716 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd42e92-16c0-4469-90c3-69d557ef3d59 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:45.209439 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd42e92-16c0-4469-90c3-69d557ef3d59 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:45.217670 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b462ff-64a7-43fc-a38b-05fede96a803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:45.218757 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b462ff-64a7-43fc-a38b-05fede96a803 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:45.219214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b462ff-64a7-43fc-a38b-05fede96a803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:45.219645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b462ff-64a7-43fc-a38b-05fede96a803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:45.220827 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b462ff-64a7-43fc-a38b-05fede96a803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:45.223520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b462ff-64a7-43fc-a38b-05fede96a803 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:45.244860 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 992/1962] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:45.246704 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b462ff-64a7-43fc-a38b-05fede96a803 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:45.282800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b462ff-64a7-43fc-a38b-05fede96a803 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:45.297980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7171ff-9a25-42bf-96b1-d12d1cd23b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:45.298885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7171ff-9a25-42bf-96b1-d12d1cd23b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:45.306947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7171ff-9a25-42bf-96b1-d12d1cd23b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:45.308903 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7171ff-9a25-42bf-96b1-d12d1cd23b5e admin admin] PATH_INFO: `/v3/projects/2b7b5ff4c7df4952b94c75d205db728e/users/43fa4b2816ac4fb4b5cb6dbccc33f2b2/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:45.316635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 971/1963] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:45 2022] POST /identity/v3/users => generated 301 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:45.316635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1b356-1bf0-4c2e-924a-3472f98c208c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:45.342971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1b356-1bf0-4c2e-924a-3472f98c208c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:45.363246 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d59da3-fac1-4ca9-82e0-e2f8d9489c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:45.364210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7171ff-9a25-42bf-96b1-d12d1cd23b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7b5ff4c7df4952b94c75d205db728e, user_id=43fa4b2816ac4fb4b5cb6dbccc33f2b2, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:45.365453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d59da3-fac1-4ca9-82e0-e2f8d9489c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:45.366773 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d59da3-fac1-4ca9-82e0-e2f8d9489c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:45.367241 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d59da3-fac1-4ca9-82e0-e2f8d9489c49 admin admin] PATH_INFO: `/v3/projects/48f4260eb20d4ef897f671318f8a3ebd/users/4e3722f8eb854da7b8e4203ba3b3dea0/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:45.370054 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d59da3-fac1-4ca9-82e0-e2f8d9489c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f4260eb20d4ef897f671318f8a3ebd, user_id=4e3722f8eb854da7b8e4203ba3b3dea0, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:45.371069 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7171ff-9a25-42bf-96b1-d12d1cd23b5e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:45.375802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d59da3-fac1-4ca9-82e0-e2f8d9489c49 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:45.396120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 972/1964] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:45 2022] PUT /identity/v3/projects/48f4260eb20d4ef897f671318f8a3ebd/users/4e3722f8eb854da7b8e4203ba3b3dea0/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:45.399112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d59da3-fac1-4ca9-82e0-e2f8d9489c49 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:45.482472 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 993/1965] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:45 2022] PUT /identity/v3/projects/2b7b5ff4c7df4952b94c75d205db728e/users/43fa4b2816ac4fb4b5cb6dbccc33f2b2/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:45.483846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55f770-517a-4818-9341-b11b82573410 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:45.484299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55f770-517a-4818-9341-b11b82573410 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:45.484755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55f770-517a-4818-9341-b11b82573410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:45.576540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:45.588199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-4b55f770-517a-4818-9341-b11b82573410 None None] MFA Rules not processed for user `4e3722f8eb854da7b8e4203ba3b3dea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:45.591633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4b55f770-517a-4818-9341-b11b82573410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:45.640065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d59da3-fac1-4ca9-82e0-e2f8d9489c49 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:45.773425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 994/1966] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:45.773425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55f770-517a-4818-9341-b11b82573410 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:45.817734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26daa4-b0e1-4cf1-96e7-52d1fb3f7255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:45.819216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26daa4-b0e1-4cf1-96e7-52d1fb3f7255 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:45.824603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26daa4-b0e1-4cf1-96e7-52d1fb3f7255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:45.824603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26daa4-b0e1-4cf1-96e7-52d1fb3f7255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:45.824603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26daa4-b0e1-4cf1-96e7-52d1fb3f7255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:45.841744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26daa4-b0e1-4cf1-96e7-52d1fb3f7255 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:45.864775 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 973/1967] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:45.864775 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26daa4-b0e1-4cf1-96e7-52d1fb3f7255 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:45.864775 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8a26daa4-b0e1-4cf1-96e7-52d1fb3f7255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:45.946014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55f770-517a-4818-9341-b11b82573410 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:45.960065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dc68c-27ad-46be-8ff8-d6fda23e5f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:45.961085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dc68c-27ad-46be-8ff8-d6fda23e5f8b admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:45.961690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dc68c-27ad-46be-8ff8-d6fda23e5f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:45.962260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dc68c-27ad-46be-8ff8-d6fda23e5f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:45.963738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dc68c-27ad-46be-8ff8-d6fda23e5f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:45.967269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dc68c-27ad-46be-8ff8-d6fda23e5f8b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:45.987697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 995/1968] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:45.989096 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dc68c-27ad-46be-8ff8-d6fda23e5f8b admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:46.002272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:46.004214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dc68c-27ad-46be-8ff8-d6fda23e5f8b admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:46.012639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa11433-beb1-4130-a10c-e53d539b7aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:46.013963 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa11433-beb1-4130-a10c-e53d539b7aed admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:46.014466 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa11433-beb1-4130-a10c-e53d539b7aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:46.014934 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa11433-beb1-4130-a10c-e53d539b7aed admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:46.016190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa11433-beb1-4130-a10c-e53d539b7aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:46.018633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa11433-beb1-4130-a10c-e53d539b7aed admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:46.049828 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 996/1969] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:46.049828 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa11433-beb1-4130-a10c-e53d539b7aed admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:46.061522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26daa4-b0e1-4cf1-96e7-52d1fb3f7255 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:46.066008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e9dc9-7eb5-4555-a49a-da1f74b9150d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:46.066724 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e9dc9-7eb5-4555-a49a-da1f74b9150d service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:46.067013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e9dc9-7eb5-4555-a49a-da1f74b9150d service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:46.067293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e9dc9-7eb5-4555-a49a-da1f74b9150d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:46.076485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa11433-beb1-4130-a10c-e53d539b7aed admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:46.083420 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e9dc9-7eb5-4555-a49a-da1f74b9150d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:46.086805 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e9dc9-7eb5-4555-a49a-da1f74b9150d service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:46.090929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c800d75-1d2e-4baa-b9cf-72e767c8635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:46.093149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c800d75-1d2e-4baa-b9cf-72e767c8635e admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:46.093817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c800d75-1d2e-4baa-b9cf-72e767c8635e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:46.094349 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c800d75-1d2e-4baa-b9cf-72e767c8635e admin admin] PATH_INFO: `/v3/projects/2b7b5ff4c7df4952b94c75d205db728e/users/43fa4b2816ac4fb4b5cb6dbccc33f2b2/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:46.098659 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c800d75-1d2e-4baa-b9cf-72e767c8635e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7b5ff4c7df4952b94c75d205db728e, user_id=43fa4b2816ac4fb4b5cb6dbccc33f2b2, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:46.102731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 974/1970] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:46.103872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e9dc9-7eb5-4555-a49a-da1f74b9150d service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:46.108785 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c800d75-1d2e-4baa-b9cf-72e767c8635e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:46.129563 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e9dc9-7eb5-4555-a49a-da1f74b9150d service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:46.141699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 997/1971] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:46 2022] PUT /identity/v3/projects/2b7b5ff4c7df4952b94c75d205db728e/users/43fa4b2816ac4fb4b5cb6dbccc33f2b2/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:46.170080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1949b-1320-4c53-8876-d9cce5660835 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:46.171574 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1949b-1320-4c53-8876-d9cce5660835 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:46.172585 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1949b-1320-4c53-8876-d9cce5660835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:46.216405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-15d1949b-1320-4c53-8876-d9cce5660835 None None] MFA Rules not processed for user `43fa4b2816ac4fb4b5cb6dbccc33f2b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:46.217855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-15d1949b-1320-4c53-8876-d9cce5660835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:46.284723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea38a9-36e7-404a-91f6-4b0a80b54148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:46.286295 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea38a9-36e7-404a-91f6-4b0a80b54148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:46.287058 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea38a9-36e7-404a-91f6-4b0a80b54148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:46.288219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea38a9-36e7-404a-91f6-4b0a80b54148 admin admin] PATH_INFO: `/v3/projects/48288c712aed478cadd0ec770abbb13b/users/6f7537fd8ffb4f5bbde012e1938720b2/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:46.352859 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea38a9-36e7-404a-91f6-4b0a80b54148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48288c712aed478cadd0ec770abbb13b, user_id=6f7537fd8ffb4f5bbde012e1938720b2, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:46.367488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea38a9-36e7-404a-91f6-4b0a80b54148 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:46.415204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 998/1972] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:21:46.515291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 975/1973] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:46 2022] PUT /identity/v3/projects/48288c712aed478cadd0ec770abbb13b/users/6f7537fd8ffb4f5bbde012e1938720b2/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:46.534581 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5356b-37eb-4d22-a90d-45d682e8d553 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:46.534922 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5356b-37eb-4d22-a90d-45d682e8d553 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:46.535165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5356b-37eb-4d22-a90d-45d682e8d553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:46.593172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d4e5356b-37eb-4d22-a90d-45d682e8d553 None None] MFA Rules not processed for user `6f7537fd8ffb4f5bbde012e1938720b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:46.593785 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d4e5356b-37eb-4d22-a90d-45d682e8d553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:46.705541 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea38a9-36e7-404a-91f6-4b0a80b54148 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:46.708701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0bea38a9-36e7-404a-91f6-4b0a80b54148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:46.722792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=88,keystone:INSERT=8,keystone:DELETE=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:46.781379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 999/1974] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:46.783066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5356b-37eb-4d22-a90d-45d682e8d553 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:46.842908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea38a9-36e7-404a-91f6-4b0a80b54148 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:46.849228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f836a5-1e3c-4c0f-9541-18711bce3a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:46.849228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f836a5-1e3c-4c0f-9541-18711bce3a05 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:46.849228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f836a5-1e3c-4c0f-9541-18711bce3a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:46.849228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f836a5-1e3c-4c0f-9541-18711bce3a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:46.923857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5356b-37eb-4d22-a90d-45d682e8d553 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:46.930657 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bfd07-8336-4cc1-bd89-3ef111d343ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:46.931388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bfd07-8336-4cc1-bd89-3ef111d343ed admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:46.931589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bfd07-8336-4cc1-bd89-3ef111d343ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:46.932013 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bfd07-8336-4cc1-bd89-3ef111d343ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:46.933225 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bfd07-8336-4cc1-bd89-3ef111d343ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:46.936839 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bfd07-8336-4cc1-bd89-3ef111d343ed admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:46.971530 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f836a5-1e3c-4c0f-9541-18711bce3a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:46.974698 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f836a5-1e3c-4c0f-9541-18711bce3a05 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:46.995816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 976/1975] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:46 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:47.054053 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1000/1976] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:46 2022] POST /identity/v3/projects => generated 401 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:47.059198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f836a5-1e3c-4c0f-9541-18711bce3a05 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:47.106398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f836a5-1e3c-4c0f-9541-18711bce3a05 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:47.135104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:47.189884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bfd07-8336-4cc1-bd89-3ef111d343ed admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:47.264320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bfd07-8336-4cc1-bd89-3ef111d343ed admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:47.269360 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7ba31-3a6b-4fbd-b447-55e80455fb4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:47.270015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7ba31-3a6b-4fbd-b447-55e80455fb4a service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:47.270303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7ba31-3a6b-4fbd-b447-55e80455fb4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:47.273632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa659c1-ada3-4539-8666-d454496e209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:47.273632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa659c1-ada3-4539-8666-d454496e209e admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:47.274011 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa659c1-ada3-4539-8666-d454496e209e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:47.274251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7ba31-3a6b-4fbd-b447-55e80455fb4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:47.275064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa659c1-ada3-4539-8666-d454496e209e admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:47.276527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa659c1-ada3-4539-8666-d454496e209e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:47.278092 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c7b7ba31-3a6b-4fbd-b447-55e80455fb4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:47.284966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa659c1-ada3-4539-8666-d454496e209e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:47.369548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7ba31-3a6b-4fbd-b447-55e80455fb4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:47.371224 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7ba31-3a6b-4fbd-b447-55e80455fb4a service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:47.383655 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1001/1977] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:21:47.417462 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 977/1978] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:47 2022] POST /identity/v3/users => generated 307 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:47.424624 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7ba31-3a6b-4fbd-b447-55e80455fb4a service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:47.450794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7ba31-3a6b-4fbd-b447-55e80455fb4a service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:47.462526 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a65e30-80c7-4b57-ad27-e4b9562d37b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:47.462526 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a65e30-80c7-4b57-ad27-e4b9562d37b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:47.462526 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a65e30-80c7-4b57-ad27-e4b9562d37b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:47.463082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a65e30-80c7-4b57-ad27-e4b9562d37b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:47.464089 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a65e30-80c7-4b57-ad27-e4b9562d37b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:47.465596 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a65e30-80c7-4b57-ad27-e4b9562d37b2 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:47.489110 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1002/1979] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:47.497369 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa659c1-ada3-4539-8666-d454496e209e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:47.516632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa659c1-ada3-4539-8666-d454496e209e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:47.527541 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87591643-711d-477c-ba7e-a05b91e95274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:47.528767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87591643-711d-477c-ba7e-a05b91e95274 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:47.529262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87591643-711d-477c-ba7e-a05b91e95274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:47.529771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87591643-711d-477c-ba7e-a05b91e95274 admin admin] PATH_INFO: `/v3/projects/72dc44456417438388be738a2e96ba7a/users/78558300304646c3819f75d6c960b41c/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:47.581537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87591643-711d-477c-ba7e-a05b91e95274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72dc44456417438388be738a2e96ba7a, user_id=78558300304646c3819f75d6c960b41c, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:47.589457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87591643-711d-477c-ba7e-a05b91e95274 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:47.626435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:47.750824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 978/1980] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:47 2022] PUT /identity/v3/projects/72dc44456417438388be738a2e96ba7a/users/78558300304646c3819f75d6c960b41c/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:47.755919 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a65e30-80c7-4b57-ad27-e4b9562d37b2 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:47.772693 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a65e30-80c7-4b57-ad27-e4b9562d37b2 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:47.879153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb30eff-30a0-4104-b067-8f7bdb243b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:47.880177 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb30eff-30a0-4104-b067-8f7bdb243b5b admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:47.880177 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb30eff-30a0-4104-b067-8f7bdb243b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:47.880456 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb30eff-30a0-4104-b067-8f7bdb243b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:47.881844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb30eff-30a0-4104-b067-8f7bdb243b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:47.883545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb30eff-30a0-4104-b067-8f7bdb243b5b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:47.895665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1003/1981] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:47.903486 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87591643-711d-477c-ba7e-a05b91e95274 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:47.922034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87591643-711d-477c-ba7e-a05b91e95274 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:47.931247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c1f93-558b-408b-bc04-1fe88d5ba71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:47.932357 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c1f93-558b-408b-bc04-1fe88d5ba71e admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:47.932845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c1f93-558b-408b-bc04-1fe88d5ba71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:47.933331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c1f93-558b-408b-bc04-1fe88d5ba71e admin admin] PATH_INFO: `/v3/projects/72dc44456417438388be738a2e96ba7a/users/78558300304646c3819f75d6c960b41c/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:47.937514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c1f93-558b-408b-bc04-1fe88d5ba71e admin admin] RBAC: Authorizing `identity:create_grant(project_id=72dc44456417438388be738a2e96ba7a, user_id=78558300304646c3819f75d6c960b41c, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:47.943213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c1f93-558b-408b-bc04-1fe88d5ba71e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:47.971723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 979/1982] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:47 2022] PUT /identity/v3/projects/72dc44456417438388be738a2e96ba7a/users/78558300304646c3819f75d6c960b41c/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:48.000595 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0e831-568d-4276-95a6-3dffa26e0b86 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:48.001082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0e831-568d-4276-95a6-3dffa26e0b86 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:48.004339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0e831-568d-4276-95a6-3dffa26e0b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:48.052539 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:48.056548 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c1f93-558b-408b-bc04-1fe88d5ba71e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:48.098947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-15c0e831-568d-4276-95a6-3dffa26e0b86 None None] MFA Rules not processed for user `78558300304646c3819f75d6c960b41c`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:48.102824 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-15c0e831-568d-4276-95a6-3dffa26e0b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:48.162350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c1f93-558b-408b-bc04-1fe88d5ba71e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:48.168123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9089a-9687-4100-9e8a-51a72876f4fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:48.169558 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9089a-9687-4100-9e8a-51a72876f4fa service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:48.174449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9089a-9687-4100-9e8a-51a72876f4fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:48.174449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9089a-9687-4100-9e8a-51a72876f4fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:48.251320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1004/1983] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:47 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:48.300312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9089a-9687-4100-9e8a-51a72876f4fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:48.301986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9089a-9687-4100-9e8a-51a72876f4fa service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:48.316179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 980/1984] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:48.418603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0e831-568d-4276-95a6-3dffa26e0b86 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:48.435810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0e831-568d-4276-95a6-3dffa26e0b86 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:48.442627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3582f-ac66-4f5c-8af7-c7462d96f151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:48.444402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3582f-ac66-4f5c-8af7-c7462d96f151 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:48.444974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3582f-ac66-4f5c-8af7-c7462d96f151 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:48.455468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3582f-ac66-4f5c-8af7-c7462d96f151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:48.468742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:48.475389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3582f-ac66-4f5c-8af7-c7462d96f151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:48.479209 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3582f-ac66-4f5c-8af7-c7462d96f151 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:48.497137 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1005/1985] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:48 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:48.980626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:49.180010 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9089a-9687-4100-9e8a-51a72876f4fa service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:49.191726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9089a-9687-4100-9e8a-51a72876f4fa service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:49.198633 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7393cd-e89f-472a-9268-a437843cb355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:49.199342 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7393cd-e89f-472a-9268-a437843cb355 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:49.199719 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7393cd-e89f-472a-9268-a437843cb355 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:49.200056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7393cd-e89f-472a-9268-a437843cb355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:49.203843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=77,keystone:DELETE=20,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:49.292691 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7393cd-e89f-472a-9268-a437843cb355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:49.294292 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7393cd-e89f-472a-9268-a437843cb355 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:49.310016 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 981/1986] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:49.374637 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:49.620955 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:49.775439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:50.679677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:50.895801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:51.621511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:51.758483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:52.385903 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:52.412985 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3582f-ac66-4f5c-8af7-c7462d96f151 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:52.415115 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b0b3582f-ac66-4f5c-8af7-c7462d96f151 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:52.497638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3582f-ac66-4f5c-8af7-c7462d96f151 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:52.502655 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93cb87-b0d2-466e-95fd-77d7e76fe0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:52.503465 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93cb87-b0d2-466e-95fd-77d7e76fe0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:52.503783 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93cb87-b0d2-466e-95fd-77d7e76fe0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:52.504067 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93cb87-b0d2-466e-95fd-77d7e76fe0cd admin admin] PATH_INFO: `/v3/users/94c8ea6466384ccd97415e2bf7d9f0e7` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:52.505323 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93cb87-b0d2-466e-95fd-77d7e76fe0cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c8ea6466384ccd97415e2bf7d9f0e7)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:52.508322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93cb87-b0d2-466e-95fd-77d7e76fe0cd admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:52.689832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:52.793253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ea93cb87-b0d2-466e-95fd-77d7e76fe0cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c8ea6466384ccd97415e2bf7d9f0e7'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:52.793986 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ea93cb87-b0d2-466e-95fd-77d7e76fe0cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c8ea6466384ccd97415e2bf7d9f0e7'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:52.810405 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ea93cb87-b0d2-466e-95fd-77d7e76fe0cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c8ea6466384ccd97415e2bf7d9f0e7'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:52.952460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ea93cb87-b0d2-466e-95fd-77d7e76fe0cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c8ea6466384ccd97415e2bf7d9f0e7'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:52.953673 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ea93cb87-b0d2-466e-95fd-77d7e76fe0cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c8ea6466384ccd97415e2bf7d9f0e7'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:52.978643 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1006/1987] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:52 2022] DELETE /identity/v3/users/94c8ea6466384ccd97415e2bf7d9f0e7 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:52.984434 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa92a16-047b-49b3-8e10-1cf91bfb41af None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:52.985248 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa92a16-047b-49b3-8e10-1cf91bfb41af None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:52.985555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa92a16-047b-49b3-8e10-1cf91bfb41af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:53.014548 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-faa92a16-047b-49b3-8e10-1cf91bfb41af None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:53.016482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-faa92a16-047b-49b3-8e10-1cf91bfb41af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:53.128998 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 982/1988] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:53.143353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93cb87-b0d2-466e-95fd-77d7e76fe0cd admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:53.145461 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ea93cb87-b0d2-466e-95fd-77d7e76fe0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:53.254441 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93cb87-b0d2-466e-95fd-77d7e76fe0cd admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:53.260281 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb742c-7ab1-4c72-85fe-bdf364fd16af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:53.261473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb742c-7ab1-4c72-85fe-bdf364fd16af service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:53.261655 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb742c-7ab1-4c72-85fe-bdf364fd16af service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:53.262160 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb742c-7ab1-4c72-85fe-bdf364fd16af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:53.274676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb742c-7ab1-4c72-85fe-bdf364fd16af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:53.276163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb742c-7ab1-4c72-85fe-bdf364fd16af service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:53.287709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1007/1989] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:53.741513 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:53.979246 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:54.009569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa92a16-047b-49b3-8e10-1cf91bfb41af None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:54.014223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-faa92a16-047b-49b3-8e10-1cf91bfb41af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:54.028569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa92a16-047b-49b3-8e10-1cf91bfb41af None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:54.036589 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c35fd-7cf7-45b2-8541-06c09d5ce078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:54.038088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c35fd-7cf7-45b2-8541-06c09d5ce078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:54.038088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c35fd-7cf7-45b2-8541-06c09d5ce078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:54.038420 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c35fd-7cf7-45b2-8541-06c09d5ce078 admin admin] PATH_INFO: `/v3/users/00f28c4c1ba547bfbdcafa162608b92f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:54.040005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c35fd-7cf7-45b2-8541-06c09d5ce078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00f28c4c1ba547bfbdcafa162608b92f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:54.042224 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c35fd-7cf7-45b2-8541-06c09d5ce078 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:54.138031 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb742c-7ab1-4c72-85fe-bdf364fd16af service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:54.139811 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d2fb742c-7ab1-4c72-85fe-bdf364fd16af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:54.157024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb742c-7ab1-4c72-85fe-bdf364fd16af service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:54.164679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e841761-bb42-4000-afb8-dce0ae2dee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:54.164679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e841761-bb42-4000-afb8-dce0ae2dee77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:54.164679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e841761-bb42-4000-afb8-dce0ae2dee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:54.165835 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e841761-bb42-4000-afb8-dce0ae2dee77 admin admin] PATH_INFO: `/v3/projects/db587411c4ea494d8e20574bcabd8a89` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:54.167677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e841761-bb42-4000-afb8-dce0ae2dee77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db587411c4ea494d8e20574bcabd8a89)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:54.170031 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e841761-bb42-4000-afb8-dce0ae2dee77 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:54.312883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3e0c35fd-7cf7-45b2-8541-06c09d5ce078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00f28c4c1ba547bfbdcafa162608b92f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:54.313676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3e0c35fd-7cf7-45b2-8541-06c09d5ce078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00f28c4c1ba547bfbdcafa162608b92f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:54.332840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3e0c35fd-7cf7-45b2-8541-06c09d5ce078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00f28c4c1ba547bfbdcafa162608b92f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:54.342081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3e0c35fd-7cf7-45b2-8541-06c09d5ce078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00f28c4c1ba547bfbdcafa162608b92f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:54.353043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4e841761-bb42-4000-afb8-dce0ae2dee77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db587411c4ea494d8e20574bcabd8a89', 'request_id': 'req-4e841761-bb42-4000-afb8-dce0ae2dee77'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:54.465540 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3e0c35fd-7cf7-45b2-8541-06c09d5ce078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00f28c4c1ba547bfbdcafa162608b92f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:54.488222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 983/1990] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:54 2022] DELETE /identity/v3/users/00f28c4c1ba547bfbdcafa162608b92f => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:54.495276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3dae2-f3c7-4d56-907f-337008a9fbf4 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:54.496022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3dae2-f3c7-4d56-907f-337008a9fbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:54.497039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3dae2-f3c7-4d56-907f-337008a9fbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:54.523763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-62d3dae2-f3c7-4d56-907f-337008a9fbf4 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:54.525327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-62d3dae2-f3c7-4d56-907f-337008a9fbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:54.587896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4e841761-bb42-4000-afb8-dce0ae2dee77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db587411c4ea494d8e20574bcabd8a89', 'request_id': 'req-4e841761-bb42-4000-afb8-dce0ae2dee77'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:54.613146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4e841761-bb42-4000-afb8-dce0ae2dee77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db587411c4ea494d8e20574bcabd8a89', 'request_id': 'req-4e841761-bb42-4000-afb8-dce0ae2dee77'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:54.617415 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 984/1991] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:54.629206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3dae2-f3c7-4d56-907f-337008a9fbf4 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:54.631836 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-62d3dae2-f3c7-4d56-907f-337008a9fbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:54.651418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4e841761-bb42-4000-afb8-dce0ae2dee77 admin admin] The token cache is being invalidate because project db587411c4ea494d8e20574bcabd8a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:54.651418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4e841761-bb42-4000-afb8-dce0ae2dee77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:54.651418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4e841761-bb42-4000-afb8-dce0ae2dee77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:54.661104 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1008/1992] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:54 2022] DELETE /identity/v3/projects/db587411c4ea494d8e20574bcabd8a89 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:54.668860 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0d9a8-48c7-4096-8fc3-26b37ed6b259 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:54.669429 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0d9a8-48c7-4096-8fc3-26b37ed6b259 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:54.669860 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0d9a8-48c7-4096-8fc3-26b37ed6b259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:54.701342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-61e0d9a8-48c7-4096-8fc3-26b37ed6b259 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:54.702910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-61e0d9a8-48c7-4096-8fc3-26b37ed6b259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:54.726093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1009/1993] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:54.729141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1447a1-ef85-41ca-9e21-c984ada9ee51 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:54.732893 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1447a1-ef85-41ca-9e21-c984ada9ee51 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:54.732893 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1447a1-ef85-41ca-9e21-c984ada9ee51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:54.765024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-ce1447a1-ef85-41ca-9e21-c984ada9ee51 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:54.767270 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3dae2-f3c7-4d56-907f-337008a9fbf4 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:54.768717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ce1447a1-ef85-41ca-9e21-c984ada9ee51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:54.775058 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf77ddb-f1a2-4600-bf3a-de88f6305e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:54.776163 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf77ddb-f1a2-4600-bf3a-de88f6305e14 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:54.776805 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf77ddb-f1a2-4600-bf3a-de88f6305e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:54.777353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf77ddb-f1a2-4600-bf3a-de88f6305e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:54.785399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1010/1994] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:54.785650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1bf77ddb-f1a2-4600-bf3a-de88f6305e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:54.787199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1447a1-ef85-41ca-9e21-c984ada9ee51 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:54.799681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1447a1-ef85-41ca-9e21-c984ada9ee51 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:54.811283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf77ddb-f1a2-4600-bf3a-de88f6305e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:54.813018 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81942eff-f8a4-44f1-8b4c-01f7b60efa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:54.813863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf77ddb-f1a2-4600-bf3a-de88f6305e14 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:54.813995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81942eff-f8a4-44f1-8b4c-01f7b60efa2d admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:54.814377 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81942eff-f8a4-44f1-8b4c-01f7b60efa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:54.814973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81942eff-f8a4-44f1-8b4c-01f7b60efa2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:54.816017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81942eff-f8a4-44f1-8b4c-01f7b60efa2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:21:54.816415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81942eff-f8a4-44f1-8b4c-01f7b60efa2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:54.819629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81942eff-f8a4-44f1-8b4c-01f7b60efa2d admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:54.844050 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1011/1995] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:21:54.845265 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 985/1996] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:21:54.860044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81942eff-f8a4-44f1-8b4c-01f7b60efa2d admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:54.879038 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81942eff-f8a4-44f1-8b4c-01f7b60efa2d admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:54.897284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07fdcd-4883-4baa-8fdf-acfabc0244b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:54.897284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07fdcd-4883-4baa-8fdf-acfabc0244b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:54.897284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07fdcd-4883-4baa-8fdf-acfabc0244b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:54.897284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07fdcd-4883-4baa-8fdf-acfabc0244b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:54.897857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07fdcd-4883-4baa-8fdf-acfabc0244b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:54.910916 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07fdcd-4883-4baa-8fdf-acfabc0244b3 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:55.131119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1012/1997] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:54 2022] POST /identity/v3/projects => generated 385 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:55.132252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf77ddb-f1a2-4600-bf3a-de88f6305e14 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:55.156448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07fdcd-4883-4baa-8fdf-acfabc0244b3 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:55.159612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf77ddb-f1a2-4600-bf3a-de88f6305e14 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:55.164155 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3a07fdcd-4883-4baa-8fdf-acfabc0244b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:55.272562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:55.288410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a9a93-83cf-4cff-9537-025a46f1cac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:55.289689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a9a93-83cf-4cff-9537-025a46f1cac7 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:55.290148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a9a93-83cf-4cff-9537-025a46f1cac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:55.290488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a9a93-83cf-4cff-9537-025a46f1cac7 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:55.291242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a9a93-83cf-4cff-9537-025a46f1cac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:55.293389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a9a93-83cf-4cff-9537-025a46f1cac7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:55.312836 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07fdcd-4883-4baa-8fdf-acfabc0244b3 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:55.319875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff537b-ec5e-4292-bb11-6555e8584596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:55.320572 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff537b-ec5e-4292-bb11-6555e8584596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:55.320861 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff537b-ec5e-4292-bb11-6555e8584596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:55.321139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff537b-ec5e-4292-bb11-6555e8584596 admin admin] PATH_INFO: `/v3/users/7c81da893e8b48d0850217b1ef1ac11a` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:55.322493 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff537b-ec5e-4292-bb11-6555e8584596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c81da893e8b48d0850217b1ef1ac11a)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:55.324503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff537b-ec5e-4292-bb11-6555e8584596 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:55.435061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 986/1998] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:55 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:21:55.439910 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a9a93-83cf-4cff-9537-025a46f1cac7 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:55.458654 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a9a93-83cf-4cff-9537-025a46f1cac7 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:55.468203 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f51fc-8b15-4ed0-8927-eb9b029abe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:55.469920 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f51fc-8b15-4ed0-8927-eb9b029abe6a admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:55.471372 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f51fc-8b15-4ed0-8927-eb9b029abe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:55.477826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f51fc-8b15-4ed0-8927-eb9b029abe6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:55.477826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f51fc-8b15-4ed0-8927-eb9b029abe6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:55.477826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f51fc-8b15-4ed0-8927-eb9b029abe6a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:55.488704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 987/1999] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:21:55.493964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f51fc-8b15-4ed0-8927-eb9b029abe6a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:55.504795 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f51fc-8b15-4ed0-8927-eb9b029abe6a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:55.510231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc027974-f604-4646-833b-c5164765922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:55.522747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc027974-f604-4646-833b-c5164765922d admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:55.522747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc027974-f604-4646-833b-c5164765922d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:55.522747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc027974-f604-4646-833b-c5164765922d admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:55.522747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc027974-f604-4646-833b-c5164765922d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:55.522747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc027974-f604-4646-833b-c5164765922d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:55.527064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 988/2000] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:21:55.531811 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc027974-f604-4646-833b-c5164765922d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:55.543385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc027974-f604-4646-833b-c5164765922d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:55.549134 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053045d3-b74e-4481-9cee-e43e90feeb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:55.555779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053045d3-b74e-4481-9cee-e43e90feeb5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:55.555779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053045d3-b74e-4481-9cee-e43e90feeb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:55.555779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053045d3-b74e-4481-9cee-e43e90feeb5f admin admin] PATH_INFO: `/v3/projects/ec046218cd32479388ff34b8110d8dc5/users/6a835792557248a9aa3293ca80ac55fb/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:55.569580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053045d3-b74e-4481-9cee-e43e90feeb5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec046218cd32479388ff34b8110d8dc5, user_id=6a835792557248a9aa3293ca80ac55fb, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:55.572824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053045d3-b74e-4481-9cee-e43e90feeb5f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:55.606549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f5ff537b-ec5e-4292-bb11-6555e8584596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c81da893e8b48d0850217b1ef1ac11a'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:55.607793 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f5ff537b-ec5e-4292-bb11-6555e8584596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c81da893e8b48d0850217b1ef1ac11a'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:55.624877 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f5ff537b-ec5e-4292-bb11-6555e8584596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c81da893e8b48d0850217b1ef1ac11a'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:55.678103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:55.711481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 989/2001] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:55 2022] PUT /identity/v3/projects/ec046218cd32479388ff34b8110d8dc5/users/6a835792557248a9aa3293ca80ac55fb/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:21:55.711481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053045d3-b74e-4481-9cee-e43e90feeb5f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:55.711481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-053045d3-b74e-4481-9cee-e43e90feeb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:55.790106 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053045d3-b74e-4481-9cee-e43e90feeb5f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:55.796198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c47177-e067-4c1d-80f2-9bd717d01ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:55.798578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c47177-e067-4c1d-80f2-9bd717d01ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:55.798578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c47177-e067-4c1d-80f2-9bd717d01ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:55.798578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c47177-e067-4c1d-80f2-9bd717d01ee2 admin admin] PATH_INFO: `/v3/projects/12e7d4708995413a87f036a7b70e20ac` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:55.799678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c47177-e067-4c1d-80f2-9bd717d01ee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e7d4708995413a87f036a7b70e20ac)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:55.802521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c47177-e067-4c1d-80f2-9bd717d01ee2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:55.819878 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f5ff537b-ec5e-4292-bb11-6555e8584596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c81da893e8b48d0850217b1ef1ac11a'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:55.825557 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f5ff537b-ec5e-4292-bb11-6555e8584596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c81da893e8b48d0850217b1ef1ac11a'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:55.848851 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1013/2002] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:55 2022] DELETE /identity/v3/users/7c81da893e8b48d0850217b1ef1ac11a => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:55.852847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796444ba-2ddb-4d73-8ad3-c358ddbbf71d None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:55.853664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796444ba-2ddb-4d73-8ad3-c358ddbbf71d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:55.855173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796444ba-2ddb-4d73-8ad3-c358ddbbf71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:55.898683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-796444ba-2ddb-4d73-8ad3-c358ddbbf71d None None] MFA Rules not processed for user `6a835792557248a9aa3293ca80ac55fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:55.900077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-796444ba-2ddb-4d73-8ad3-c358ddbbf71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:56.004318 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1014/2003] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:56.006509 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083aa438-3e66-45e2-a394-34e98990e1c7 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:56.006893 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083aa438-3e66-45e2-a394-34e98990e1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:56.007239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083aa438-3e66-45e2-a394-34e98990e1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:56.029951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-083aa438-3e66-45e2-a394-34e98990e1c7 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:56.031679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-083aa438-3e66-45e2-a394-34e98990e1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:56.063615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21c47177-e067-4c1d-80f2-9bd717d01ee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e7d4708995413a87f036a7b70e20ac', 'request_id': 'req-21c47177-e067-4c1d-80f2-9bd717d01ee2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:56.074863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21c47177-e067-4c1d-80f2-9bd717d01ee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e7d4708995413a87f036a7b70e20ac', 'request_id': 'req-21c47177-e067-4c1d-80f2-9bd717d01ee2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:56.086131 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21c47177-e067-4c1d-80f2-9bd717d01ee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e7d4708995413a87f036a7b70e20ac', 'request_id': 'req-21c47177-e067-4c1d-80f2-9bd717d01ee2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:56.151666 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1015/2004] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:56.153222 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083aa438-3e66-45e2-a394-34e98990e1c7 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:56.155710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-083aa438-3e66-45e2-a394-34e98990e1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:56.176626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083aa438-3e66-45e2-a394-34e98990e1c7 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:56.187620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21c47177-e067-4c1d-80f2-9bd717d01ee2 admin admin] The token cache is being invalidate because project 12e7d4708995413a87f036a7b70e20ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:56.188226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21c47177-e067-4c1d-80f2-9bd717d01ee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:56.190301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21c47177-e067-4c1d-80f2-9bd717d01ee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:56.200895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 990/2005] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:55 2022] DELETE /identity/v3/projects/12e7d4708995413a87f036a7b70e20ac => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:56.200895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c47177-e067-4c1d-80f2-9bd717d01ee2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:56.204921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-21c47177-e067-4c1d-80f2-9bd717d01ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:56.283305 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e2e16-045e-4f71-8e22-be0b3f54266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:56.286073 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e2e16-045e-4f71-8e22-be0b3f54266c admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:56.286073 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e2e16-045e-4f71-8e22-be0b3f54266c admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:56.286073 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e2e16-045e-4f71-8e22-be0b3f54266c admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:56.286903 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e2e16-045e-4f71-8e22-be0b3f54266c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:56.292974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e2e16-045e-4f71-8e22-be0b3f54266c admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:56.319400 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c47177-e067-4c1d-80f2-9bd717d01ee2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:56.329724 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828c9ab-67fe-43a4-98f4-eed3c394329e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:56.331517 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c9ab-67fe-43a4-98f4-eed3c394329e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:56.332061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c9ab-67fe-43a4-98f4-eed3c394329e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:56.333385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c9ab-67fe-43a4-98f4-eed3c394329e admin admin] PATH_INFO: `/v3/users/6f7537fd8ffb4f5bbde012e1938720b2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:56.336279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828c9ab-67fe-43a4-98f4-eed3c394329e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7537fd8ffb4f5bbde012e1938720b2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:56.338631 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828c9ab-67fe-43a4-98f4-eed3c394329e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:56.508316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1016/2006] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:56 2022] POST /identity/v3/projects => generated 385 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:56.510454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e2e16-045e-4f71-8e22-be0b3f54266c admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:56.513911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3d1e2e16-045e-4f71-8e22-be0b3f54266c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:56.599037 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:56.615249 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e2e16-045e-4f71-8e22-be0b3f54266c admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:56.623928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34215fba-5538-4264-a487-fc34fde0b6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:56.625821 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215fba-5538-4264-a487-fc34fde0b6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:56.626476 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215fba-5538-4264-a487-fc34fde0b6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:56.627066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215fba-5538-4264-a487-fc34fde0b6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:56.631068 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-34215fba-5538-4264-a487-fc34fde0b6d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:56.643956 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d828c9ab-67fe-43a4-98f4-eed3c394329e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7537fd8ffb4f5bbde012e1938720b2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:56.644654 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d828c9ab-67fe-43a4-98f4-eed3c394329e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7537fd8ffb4f5bbde012e1938720b2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:56.659246 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d828c9ab-67fe-43a4-98f4-eed3c394329e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7537fd8ffb4f5bbde012e1938720b2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:56.660028 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d828c9ab-67fe-43a4-98f4-eed3c394329e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7537fd8ffb4f5bbde012e1938720b2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:56.734860 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34215fba-5538-4264-a487-fc34fde0b6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:56.736352 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34215fba-5538-4264-a487-fc34fde0b6d9 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:56.747724 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1017/2007] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:56.751128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34215fba-5538-4264-a487-fc34fde0b6d9 service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:56.752624 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-34215fba-5538-4264-a487-fc34fde0b6d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:56.775323 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34215fba-5538-4264-a487-fc34fde0b6d9 service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:56.780413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709035f4-a517-415c-8185-1b477ede9488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:56.781093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709035f4-a517-415c-8185-1b477ede9488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:56.781499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709035f4-a517-415c-8185-1b477ede9488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:56.781787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709035f4-a517-415c-8185-1b477ede9488 admin admin] PATH_INFO: `/v3/users/43fa4b2816ac4fb4b5cb6dbccc33f2b2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:56.783497 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709035f4-a517-415c-8185-1b477ede9488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43fa4b2816ac4fb4b5cb6dbccc33f2b2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:56.785503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709035f4-a517-415c-8185-1b477ede9488 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:56.820497 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d828c9ab-67fe-43a4-98f4-eed3c394329e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7537fd8ffb4f5bbde012e1938720b2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:56.863500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 991/2008] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:56 2022] DELETE /identity/v3/users/6f7537fd8ffb4f5bbde012e1938720b2 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:56.866460 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828c9ab-67fe-43a4-98f4-eed3c394329e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:56.869547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d828c9ab-67fe-43a4-98f4-eed3c394329e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:57.019293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828c9ab-67fe-43a4-98f4-eed3c394329e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:57.028200 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb9b9c-6aad-47e6-9087-7dfca057f40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:57.029537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb9b9c-6aad-47e6-9087-7dfca057f40a admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:57.030033 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb9b9c-6aad-47e6-9087-7dfca057f40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:57.030645 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb9b9c-6aad-47e6-9087-7dfca057f40a admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:57.043273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb9b9c-6aad-47e6-9087-7dfca057f40a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:57.043273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb9b9c-6aad-47e6-9087-7dfca057f40a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:57.095477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:57.101201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-709035f4-a517-415c-8185-1b477ede9488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43fa4b2816ac4fb4b5cb6dbccc33f2b2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:57.102262 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-709035f4-a517-415c-8185-1b477ede9488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43fa4b2816ac4fb4b5cb6dbccc33f2b2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:57.124876 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-709035f4-a517-415c-8185-1b477ede9488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43fa4b2816ac4fb4b5cb6dbccc33f2b2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:57.192784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 992/2009] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:56 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:57.194239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78894a2-0b5a-40dd-8da5-d6d5f917cb40 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:57.195073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78894a2-0b5a-40dd-8da5-d6d5f917cb40 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:57.195432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78894a2-0b5a-40dd-8da5-d6d5f917cb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:57.219866 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b78894a2-0b5a-40dd-8da5-d6d5f917cb40 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:57.221102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b78894a2-0b5a-40dd-8da5-d6d5f917cb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:57.231178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 993/2010] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:57.233463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78894a2-0b5a-40dd-8da5-d6d5f917cb40 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:57.235788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b78894a2-0b5a-40dd-8da5-d6d5f917cb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:57.254022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78894a2-0b5a-40dd-8da5-d6d5f917cb40 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:57.259548 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dee90-1d81-485f-a6a3-7bcbf47095b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:57.260228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dee90-1d81-485f-a6a3-7bcbf47095b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:57.260549 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dee90-1d81-485f-a6a3-7bcbf47095b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:57.260829 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dee90-1d81-485f-a6a3-7bcbf47095b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:57.261789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278dee90-1d81-485f-a6a3-7bcbf47095b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:57.263662 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278dee90-1d81-485f-a6a3-7bcbf47095b1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:57.270691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-709035f4-a517-415c-8185-1b477ede9488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43fa4b2816ac4fb4b5cb6dbccc33f2b2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:57.271880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-709035f4-a517-415c-8185-1b477ede9488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43fa4b2816ac4fb4b5cb6dbccc33f2b2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:57.277243 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 994/2011] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:57.285391 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dee90-1d81-485f-a6a3-7bcbf47095b1 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:57.285391 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-278dee90-1d81-485f-a6a3-7bcbf47095b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:57.294908 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1018/2012] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:56 2022] DELETE /identity/v3/users/43fa4b2816ac4fb4b5cb6dbccc33f2b2 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:57.296312 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709035f4-a517-415c-8185-1b477ede9488 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:57.313085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:57.382835 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dee90-1d81-485f-a6a3-7bcbf47095b1 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:57.425389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709035f4-a517-415c-8185-1b477ede9488 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:57.437114 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa593e8-a6c2-46a3-a916-78ca482e2c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:57.437959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa593e8-a6c2-46a3-a916-78ca482e2c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:57.438528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa593e8-a6c2-46a3-a916-78ca482e2c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:57.439210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa593e8-a6c2-46a3-a916-78ca482e2c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:57.440699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa593e8-a6c2-46a3-a916-78ca482e2c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:57.445568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa593e8-a6c2-46a3-a916-78ca482e2c6e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:57.463274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1019/2013] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:57.468679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa593e8-a6c2-46a3-a916-78ca482e2c6e admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:57.488062 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33384611-b3e7-4ae9-9e00-0ec0ac5e4872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:57.489683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa593e8-a6c2-46a3-a916-78ca482e2c6e admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:57.490535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33384611-b3e7-4ae9-9e00-0ec0ac5e4872 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:57.490535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33384611-b3e7-4ae9-9e00-0ec0ac5e4872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:57.491745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33384611-b3e7-4ae9-9e00-0ec0ac5e4872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:57.507259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0aa2c0-31c9-498a-a6b4-533a12654bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:57.507629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aa2c0-31c9-498a-a6b4-533a12654bca admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:57.508781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aa2c0-31c9-498a-a6b4-533a12654bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:57.508781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aa2c0-31c9-498a-a6b4-533a12654bca admin admin] PATH_INFO: `/v3/projects/6c9e291b57d04e6da573d1d401ab850d/users/1126cd8dca9e48c18429cc04bf134eb7/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:57.510009 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33384611-b3e7-4ae9-9e00-0ec0ac5e4872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:57.513268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33384611-b3e7-4ae9-9e00-0ec0ac5e4872 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:57.534652 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 995/2014] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:21:57.537659 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0aa2c0-31c9-498a-a6b4-533a12654bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9e291b57d04e6da573d1d401ab850d, user_id=1126cd8dca9e48c18429cc04bf134eb7, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:57.545192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0aa2c0-31c9-498a-a6b4-533a12654bca admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:57.661579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1020/2015] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:21:57 2022] PUT /identity/v3/projects/6c9e291b57d04e6da573d1d401ab850d/users/1126cd8dca9e48c18429cc04bf134eb7/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:57.675751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48710769-7096-440d-beec-48c04f9740c0 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:57.676076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48710769-7096-440d-beec-48c04f9740c0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:57.676413 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48710769-7096-440d-beec-48c04f9740c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:57.742427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-48710769-7096-440d-beec-48c04f9740c0 None None] MFA Rules not processed for user `1126cd8dca9e48c18429cc04bf134eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:21:57.745061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-48710769-7096-440d-beec-48c04f9740c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:57.844250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0aa2c0-31c9-498a-a6b4-533a12654bca admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:57.847075 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2c0aa2c0-31c9-498a-a6b4-533a12654bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:57.858002 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 996/2016] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:21:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:21:57.863690 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48710769-7096-440d-beec-48c04f9740c0 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:57.973890 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48710769-7096-440d-beec-48c04f9740c0 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:57.988395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0aa2c0-31c9-498a-a6b4-533a12654bca admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:57.993347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c84ebc-41ec-4048-817d-490fa8ab85f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:57.994416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c84ebc-41ec-4048-817d-490fa8ab85f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:57.994910 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c84ebc-41ec-4048-817d-490fa8ab85f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:57.996216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c84ebc-41ec-4048-817d-490fa8ab85f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:57.997422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c84ebc-41ec-4048-817d-490fa8ab85f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:57.997853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64b2e1-23ba-4b97-a308-b10d5f535910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:57.998953 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64b2e1-23ba-4b97-a308-b10d5f535910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:57.999607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64b2e1-23ba-4b97-a308-b10d5f535910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:58.000437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64b2e1-23ba-4b97-a308-b10d5f535910 admin admin] PATH_INFO: `/v3/projects/1db2913e718a4b4383e4a946d1e664f4` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:58.002588 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64b2e1-23ba-4b97-a308-b10d5f535910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db2913e718a4b4383e4a946d1e664f4)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:58.003480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c84ebc-41ec-4048-817d-490fa8ab85f8 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:58.007604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64b2e1-23ba-4b97-a308-b10d5f535910 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:58.189385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 997/2017] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:21:57 2022] POST /identity/v3/projects => generated 385 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:21:58.194780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c84ebc-41ec-4048-817d-490fa8ab85f8 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:58.235222 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ae64b2e1-23ba-4b97-a308-b10d5f535910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db2913e718a4b4383e4a946d1e664f4', 'request_id': 'req-ae64b2e1-23ba-4b97-a308-b10d5f535910'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:58.308754 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c84ebc-41ec-4048-817d-490fa8ab85f8 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:58.429556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d37bfa-ab17-4a5f-a348-2a45494e5f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:58.430438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d37bfa-ab17-4a5f-a348-2a45494e5f57 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:58.430563 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d37bfa-ab17-4a5f-a348-2a45494e5f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:58.430828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d37bfa-ab17-4a5f-a348-2a45494e5f57 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:58.432019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d37bfa-ab17-4a5f-a348-2a45494e5f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:58.436644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d37bfa-ab17-4a5f-a348-2a45494e5f57 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:58.460740 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:58.597146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ae64b2e1-23ba-4b97-a308-b10d5f535910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db2913e718a4b4383e4a946d1e664f4', 'request_id': 'req-ae64b2e1-23ba-4b97-a308-b10d5f535910'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:58.608442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ae64b2e1-23ba-4b97-a308-b10d5f535910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db2913e718a4b4383e4a946d1e664f4', 'request_id': 'req-ae64b2e1-23ba-4b97-a308-b10d5f535910'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:58.625165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ae64b2e1-23ba-4b97-a308-b10d5f535910 admin admin] The token cache is being invalidate because project 1db2913e718a4b4383e4a946d1e664f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:58.625525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ae64b2e1-23ba-4b97-a308-b10d5f535910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:58.626385 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ae64b2e1-23ba-4b97-a308-b10d5f535910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:58.632433 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1021/2018] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:57 2022] DELETE /identity/v3/projects/1db2913e718a4b4383e4a946d1e664f4 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:21:58.633620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64b2e1-23ba-4b97-a308-b10d5f535910 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:58.635919 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ae64b2e1-23ba-4b97-a308-b10d5f535910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:58.661975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64b2e1-23ba-4b97-a308-b10d5f535910 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:58.667303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6685ea9-2eb7-416e-ba21-42696c167fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:58.667984 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6685ea9-2eb7-416e-ba21-42696c167fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:58.668272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6685ea9-2eb7-416e-ba21-42696c167fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:58.668560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6685ea9-2eb7-416e-ba21-42696c167fa8 admin admin] PATH_INFO: `/v3/users/958b77ea9a034a4191015a5b144c3201` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:58.670028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6685ea9-2eb7-416e-ba21-42696c167fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=958b77ea9a034a4191015a5b144c3201)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:58.672159 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6685ea9-2eb7-416e-ba21-42696c167fa8 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:58.690959 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 998/2019] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:21:58 2022] POST /identity/v3/users => generated 299 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:21:58.692587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d37bfa-ab17-4a5f-a348-2a45494e5f57 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:58.697063 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-55d37bfa-ab17-4a5f-a348-2a45494e5f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:58.720508 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d37bfa-ab17-4a5f-a348-2a45494e5f57 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:58.728774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8b3ba-ef11-4526-a385-77e9496ef000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:58.729912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8b3ba-ef11-4526-a385-77e9496ef000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:58.743983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8b3ba-ef11-4526-a385-77e9496ef000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:58.743983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8b3ba-ef11-4526-a385-77e9496ef000 admin admin] PATH_INFO: `/v3/projects/48288c712aed478cadd0ec770abbb13b` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:58.743983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8b3ba-ef11-4526-a385-77e9496ef000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48288c712aed478cadd0ec770abbb13b)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:58.743983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8b3ba-ef11-4526-a385-77e9496ef000 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:59.212868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f6685ea9-2eb7-416e-ba21-42696c167fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '958b77ea9a034a4191015a5b144c3201'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:59.214150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f6685ea9-2eb7-416e-ba21-42696c167fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '958b77ea9a034a4191015a5b144c3201'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:59.223527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5aa8b3ba-ef11-4526-a385-77e9496ef000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48288c712aed478cadd0ec770abbb13b', 'request_id': 'req-5aa8b3ba-ef11-4526-a385-77e9496ef000'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:59.236562 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5aa8b3ba-ef11-4526-a385-77e9496ef000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48288c712aed478cadd0ec770abbb13b', 'request_id': 'req-5aa8b3ba-ef11-4526-a385-77e9496ef000'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:59.243247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f6685ea9-2eb7-416e-ba21-42696c167fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '958b77ea9a034a4191015a5b144c3201'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:59.271134 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5aa8b3ba-ef11-4526-a385-77e9496ef000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48288c712aed478cadd0ec770abbb13b', 'request_id': 'req-5aa8b3ba-ef11-4526-a385-77e9496ef000'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:59.362130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f6685ea9-2eb7-416e-ba21-42696c167fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '958b77ea9a034a4191015a5b144c3201'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:59.363141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f6685ea9-2eb7-416e-ba21-42696c167fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '958b77ea9a034a4191015a5b144c3201'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:59.406506 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1022/2020] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:58 2022] DELETE /identity/v3/users/958b77ea9a034a4191015a5b144c3201 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:59.408568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6685ea9-2eb7-416e-ba21-42696c167fa8 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:59.426284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f6685ea9-2eb7-416e-ba21-42696c167fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:59.488933 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5aa8b3ba-ef11-4526-a385-77e9496ef000 admin admin] The token cache is being invalidate because project 48288c712aed478cadd0ec770abbb13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:21:59.489217 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5aa8b3ba-ef11-4526-a385-77e9496ef000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:59.490178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5aa8b3ba-ef11-4526-a385-77e9496ef000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:59.498744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 999/2021] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:58 2022] DELETE /identity/v3/projects/48288c712aed478cadd0ec770abbb13b => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:21:59.499806 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8b3ba-ef11-4526-a385-77e9496ef000 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:59.501735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5aa8b3ba-ef11-4526-a385-77e9496ef000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:59.614300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6685ea9-2eb7-416e-ba21-42696c167fa8 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:59.621638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e3cda-0a98-4be3-bbb3-1a01a0c1b3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:59.621638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e3cda-0a98-4be3-bbb3-1a01a0c1b3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:59.622551 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e3cda-0a98-4be3-bbb3-1a01a0c1b3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:59.622551 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e3cda-0a98-4be3-bbb3-1a01a0c1b3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:59.623513 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e3cda-0a98-4be3-bbb3-1a01a0c1b3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:59.625558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e3cda-0a98-4be3-bbb3-1a01a0c1b3a5 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:59.642740 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1023/2022] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:21:59.647815 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e3cda-0a98-4be3-bbb3-1a01a0c1b3a5 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:21:59.654412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-1a2e3cda-0a98-4be3-bbb3-1a01a0c1b3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:21:59.682708 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8b3ba-ef11-4526-a385-77e9496ef000 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:59.687332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e3cda-0a98-4be3-bbb3-1a01a0c1b3a5 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:21:59.693499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6ede-b884-49ff-a8e0-13a677c862b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:59.695245 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6ede-b884-49ff-a8e0-13a677c862b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:59.696161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bf7c7-fbf2-4719-8a1a-d06be1635c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:21:59.697081 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf7c7-fbf2-4719-8a1a-d06be1635c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:21:59.697602 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6ede-b884-49ff-a8e0-13a677c862b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:59.697839 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf7c7-fbf2-4719-8a1a-d06be1635c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:21:59.698194 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf7c7-fbf2-4719-8a1a-d06be1635c00 admin admin] PATH_INFO: `/v3/users/78558300304646c3819f75d6c960b41c` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:59.698408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6ede-b884-49ff-a8e0-13a677c862b0 admin admin] PATH_INFO: `/v3/projects/2b7b5ff4c7df4952b94c75d205db728e` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:21:59.700223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef6ede-b884-49ff-a8e0-13a677c862b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7b5ff4c7df4952b94c75d205db728e)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:59.701025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bf7c7-fbf2-4719-8a1a-d06be1635c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78558300304646c3819f75d6c960b41c)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:21:59.702790 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef6ede-b884-49ff-a8e0-13a677c862b0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:59.704927 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bf7c7-fbf2-4719-8a1a-d06be1635c00 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:21:59.855960 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:59.910753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-39ef6ede-b884-49ff-a8e0-13a677c862b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7b5ff4c7df4952b94c75d205db728e', 'request_id': 'req-39ef6ede-b884-49ff-a8e0-13a677c862b0'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:59.913473 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-39ef6ede-b884-49ff-a8e0-13a677c862b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7b5ff4c7df4952b94c75d205db728e', 'request_id': 'req-39ef6ede-b884-49ff-a8e0-13a677c862b0'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:21:59.933552 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-39ef6ede-b884-49ff-a8e0-13a677c862b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7b5ff4c7df4952b94c75d205db728e', 'request_id': 'req-39ef6ede-b884-49ff-a8e0-13a677c862b0'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:00.020519 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-867bf7c7-fbf2-4719-8a1a-d06be1635c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78558300304646c3819f75d6c960b41c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:00.023167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-867bf7c7-fbf2-4719-8a1a-d06be1635c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78558300304646c3819f75d6c960b41c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:00.048165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-867bf7c7-fbf2-4719-8a1a-d06be1635c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78558300304646c3819f75d6c960b41c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:00.116070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-39ef6ede-b884-49ff-a8e0-13a677c862b0 admin admin] The token cache is being invalidate because project 2b7b5ff4c7df4952b94c75d205db728e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:00.116521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-39ef6ede-b884-49ff-a8e0-13a677c862b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:00.123158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-39ef6ede-b884-49ff-a8e0-13a677c862b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:00.123158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1000/2023] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:21:59 2022] DELETE /identity/v3/projects/2b7b5ff4c7df4952b94c75d205db728e => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:00.123158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6ede-b884-49ff-a8e0-13a677c862b0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:00.124061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-39ef6ede-b884-49ff-a8e0-13a677c862b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:00.233669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6ede-b884-49ff-a8e0-13a677c862b0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:00.237054 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-867bf7c7-fbf2-4719-8a1a-d06be1635c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78558300304646c3819f75d6c960b41c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:00.238221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-867bf7c7-fbf2-4719-8a1a-d06be1635c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78558300304646c3819f75d6c960b41c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:00.243143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22ef29-6e22-4e2a-ae4e-1311a13caa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:00.244352 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22ef29-6e22-4e2a-ae4e-1311a13caa95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:00.247151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22ef29-6e22-4e2a-ae4e-1311a13caa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:00.247151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22ef29-6e22-4e2a-ae4e-1311a13caa95 admin admin] PATH_INFO: `/v3/projects/fa1211d80e9b4aaa93c6cd929cb911aa/users/605fc9a59a2d4cd687cd0e1919c99316/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:00.273002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1024/2024] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:21:59 2022] DELETE /identity/v3/users/78558300304646c3819f75d6c960b41c => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:00.273002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e339394-3a67-4520-9199-e6c26be768f5 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:00.273002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e339394-3a67-4520-9199-e6c26be768f5 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:00.273968 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e339394-3a67-4520-9199-e6c26be768f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:00.282343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22ef29-6e22-4e2a-ae4e-1311a13caa95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1211d80e9b4aaa93c6cd929cb911aa, user_id=605fc9a59a2d4cd687cd0e1919c99316, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:00.289100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22ef29-6e22-4e2a-ae4e-1311a13caa95 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:00.298944 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-1e339394-3a67-4520-9199-e6c26be768f5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:00.300603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-1e339394-3a67-4520-9199-e6c26be768f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:00.424183 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1025/2025] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:00.428438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c29d1c-8879-46b0-b93d-22b5ddb1db35 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:00.428705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c29d1c-8879-46b0-b93d-22b5ddb1db35 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:00.429208 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c29d1c-8879-46b0-b93d-22b5ddb1db35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:00.460896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1001/2026] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:00 2022] PUT /identity/v3/projects/fa1211d80e9b4aaa93c6cd929cb911aa/users/605fc9a59a2d4cd687cd0e1919c99316/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:00.461063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-13c29d1c-8879-46b0-b93d-22b5ddb1db35 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:00.461063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-13c29d1c-8879-46b0-b93d-22b5ddb1db35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:00.464591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22ef29-6e22-4e2a-ae4e-1311a13caa95 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:00.574426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1026/2027] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:00.576435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c29d1c-8879-46b0-b93d-22b5ddb1db35 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:00.588993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c29d1c-8879-46b0-b93d-22b5ddb1db35 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:00.596988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0847de4-6e5a-47d1-9de5-e9c31430f620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:00.601194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22ef29-6e22-4e2a-ae4e-1311a13caa95 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:00.607995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0847de4-6e5a-47d1-9de5-e9c31430f620 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:00.608436 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0847de4-6e5a-47d1-9de5-e9c31430f620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:00.608842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0847de4-6e5a-47d1-9de5-e9c31430f620 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:00.609629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0847de4-6e5a-47d1-9de5-e9c31430f620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:22:00.610083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0847de4-6e5a-47d1-9de5-e9c31430f620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:00.616970 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0847de4-6e5a-47d1-9de5-e9c31430f620 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:00.633683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d7735-cc42-4ab1-bdf1-9124184c0455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:00.634994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d7735-cc42-4ab1-bdf1-9124184c0455 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:00.635377 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d7735-cc42-4ab1-bdf1-9124184c0455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:00.640603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1027/2028] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:22:00.645518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d7735-cc42-4ab1-bdf1-9124184c0455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:00.645518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d7735-cc42-4ab1-bdf1-9124184c0455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:00.646320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0847de4-6e5a-47d1-9de5-e9c31430f620 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:00.652248 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d7735-cc42-4ab1-bdf1-9124184c0455 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:00.675627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0847de4-6e5a-47d1-9de5-e9c31430f620 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:00.684539 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421031b6-44e9-4eb4-b50d-ced56bd0337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:00.685237 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421031b6-44e9-4eb4-b50d-ced56bd0337c admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:00.685524 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421031b6-44e9-4eb4-b50d-ced56bd0337c admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:00.685800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421031b6-44e9-4eb4-b50d-ced56bd0337c admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:00.686585 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421031b6-44e9-4eb4-b50d-ced56bd0337c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:00.688811 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421031b6-44e9-4eb4-b50d-ced56bd0337c admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:00.697507 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1002/2029] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:00.705050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d7735-cc42-4ab1-bdf1-9124184c0455 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:00.742420 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d7735-cc42-4ab1-bdf1-9124184c0455 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:00.754044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92461bc4-ea33-4f49-a167-24157a5cf51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:00.758674 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92461bc4-ea33-4f49-a167-24157a5cf51a admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:00.761264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92461bc4-ea33-4f49-a167-24157a5cf51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:00.761264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92461bc4-ea33-4f49-a167-24157a5cf51a admin admin] PATH_INFO: `/v3/projects/fa1211d80e9b4aaa93c6cd929cb911aa/users/605fc9a59a2d4cd687cd0e1919c99316/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:00.764035 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92461bc4-ea33-4f49-a167-24157a5cf51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1211d80e9b4aaa93c6cd929cb911aa, user_id=605fc9a59a2d4cd687cd0e1919c99316, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:00.767500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92461bc4-ea33-4f49-a167-24157a5cf51a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:00.798290 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1003/2030] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:00 2022] PUT /identity/v3/projects/fa1211d80e9b4aaa93c6cd929cb911aa/users/605fc9a59a2d4cd687cd0e1919c99316/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:00.808183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92461bc4-ea33-4f49-a167-24157a5cf51a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:00.810101 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-92461bc4-ea33-4f49-a167-24157a5cf51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:00.860331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1028/2031] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:00 2022] POST /identity/v3/projects => generated 387 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:00.865745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d1d19-bf64-4470-a272-24bb98d1655a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:00.866562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d1d19-bf64-4470-a272-24bb98d1655a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:00.868044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:00.868188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d1d19-bf64-4470-a272-24bb98d1655a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:00.951973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b89d1d19-bf64-4470-a272-24bb98d1655a None None] MFA Rules not processed for user `605fc9a59a2d4cd687cd0e1919c99316`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:00.955426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b89d1d19-bf64-4470-a272-24bb98d1655a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:00.956241 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92461bc4-ea33-4f49-a167-24157a5cf51a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:01.147044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:01.148191 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:01.148589 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:01.148970 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d admin admin] PATH_INFO: `/v3/projects/f942f55dd7874344a0e3579314481975` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:01.150320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1029/2032] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:01.151732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d1d19-bf64-4470-a272-24bb98d1655a None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:01.155094 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f942f55dd7874344a0e3579314481975)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:01.159358 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:01.192290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d1d19-bf64-4470-a272-24bb98d1655a None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:01.214135 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aedce0-26f4-4b91-9f58-db8bc9cfc6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:01.215269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aedce0-26f4-4b91-9f58-db8bc9cfc6ce admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:01.215760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aedce0-26f4-4b91-9f58-db8bc9cfc6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:01.216231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aedce0-26f4-4b91-9f58-db8bc9cfc6ce admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:01.219726 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aedce0-26f4-4b91-9f58-db8bc9cfc6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:01.227098 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aedce0-26f4-4b91-9f58-db8bc9cfc6ce admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:01.347418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1030/2033] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:01 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:01.350171 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aedce0-26f4-4b91-9f58-db8bc9cfc6ce admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:01.353901 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-08aedce0-26f4-4b91-9f58-db8bc9cfc6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:01.402653 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f942f55dd7874344a0e3579314481975', 'request_id': 'req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:01.417464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f942f55dd7874344a0e3579314481975', 'request_id': 'req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:01.428138 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f942f55dd7874344a0e3579314481975', 'request_id': 'req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:01.553979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aedce0-26f4-4b91-9f58-db8bc9cfc6ce admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:01.564967 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d admin admin] The token cache is being invalidate because project f942f55dd7874344a0e3579314481975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:01.565286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:01.570005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:01.574274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1004/2034] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:00 2022] DELETE /identity/v3/projects/f942f55dd7874344a0e3579314481975 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:01.576031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:01.578467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:01.663421 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea39dd9-e820-41de-a4a9-c2e6abe16f52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:01.664451 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea39dd9-e820-41de-a4a9-c2e6abe16f52 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:01.664853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea39dd9-e820-41de-a4a9-c2e6abe16f52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:01.665207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea39dd9-e820-41de-a4a9-c2e6abe16f52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:01.667439 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7ea39dd9-e820-41de-a4a9-c2e6abe16f52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:01.744080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec1726-8fba-498d-8ae3-3f61cdc2af5d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:01.753034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd760b4-1f46-478a-9ffa-f0cdb6d74acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:01.754143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd760b4-1f46-478a-9ffa-f0cdb6d74acc admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:01.754690 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd760b4-1f46-478a-9ffa-f0cdb6d74acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:01.755187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd760b4-1f46-478a-9ffa-f0cdb6d74acc admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:01.756430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd760b4-1f46-478a-9ffa-f0cdb6d74acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:01.761929 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd760b4-1f46-478a-9ffa-f0cdb6d74acc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:01.785648 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1005/2035] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:01.787913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd760b4-1f46-478a-9ffa-f0cdb6d74acc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:01.791887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-dfd760b4-1f46-478a-9ffa-f0cdb6d74acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:01.799095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea39dd9-e820-41de-a4a9-c2e6abe16f52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:01.802216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea39dd9-e820-41de-a4a9-c2e6abe16f52 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:01.816262 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:01.817690 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd760b4-1f46-478a-9ffa-f0cdb6d74acc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:01.824166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1031/2036] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:01.825377 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea39dd9-e820-41de-a4a9-c2e6abe16f52 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:01.826197 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdd92d-2334-4eec-8689-a08874b713ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:01.827025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7ea39dd9-e820-41de-a4a9-c2e6abe16f52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:01.827405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdd92d-2334-4eec-8689-a08874b713ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:01.827916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdd92d-2334-4eec-8689-a08874b713ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:01.828457 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdd92d-2334-4eec-8689-a08874b713ef admin admin] PATH_INFO: `/v3/projects/72dc44456417438388be738a2e96ba7a` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:01.830784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdd92d-2334-4eec-8689-a08874b713ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=72dc44456417438388be738a2e96ba7a)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:01.834923 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdd92d-2334-4eec-8689-a08874b713ef admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:01.844329 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea39dd9-e820-41de-a4a9-c2e6abe16f52 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:01.860185 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a8cfd-c900-47cc-a6d5-726c8845c5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:01.861185 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a8cfd-c900-47cc-a6d5-726c8845c5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:01.861576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a8cfd-c900-47cc-a6d5-726c8845c5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:01.861954 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a8cfd-c900-47cc-a6d5-726c8845c5c6 admin admin] PATH_INFO: `/v3/users/c0e3ed889b524d768202b10475af3b35` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:01.863886 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a8cfd-c900-47cc-a6d5-726c8845c5c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e3ed889b524d768202b10475af3b35)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:01.866847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a8cfd-c900-47cc-a6d5-726c8845c5c6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:02.062287 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32cdd92d-2334-4eec-8689-a08874b713ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72dc44456417438388be738a2e96ba7a', 'request_id': 'req-32cdd92d-2334-4eec-8689-a08874b713ef'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:02.069835 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32cdd92d-2334-4eec-8689-a08874b713ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72dc44456417438388be738a2e96ba7a', 'request_id': 'req-32cdd92d-2334-4eec-8689-a08874b713ef'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:02.077584 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32cdd92d-2334-4eec-8689-a08874b713ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72dc44456417438388be738a2e96ba7a', 'request_id': 'req-32cdd92d-2334-4eec-8689-a08874b713ef'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:02.153207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32cdd92d-2334-4eec-8689-a08874b713ef admin admin] The token cache is being invalidate because project 72dc44456417438388be738a2e96ba7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:02.153545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32cdd92d-2334-4eec-8689-a08874b713ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:02.155398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32cdd92d-2334-4eec-8689-a08874b713ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:02.166876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1006/2037] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:01 2022] DELETE /identity/v3/projects/72dc44456417438388be738a2e96ba7a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:02.166876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfe562-c3b5-4418-9da4-83a58e9a4776 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:02.166876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfe562-c3b5-4418-9da4-83a58e9a4776 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:02.166876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfe562-c3b5-4418-9da4-83a58e9a4776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:02.196755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-07dfe562-c3b5-4418-9da4-83a58e9a4776 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:02.198036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-07dfe562-c3b5-4418-9da4-83a58e9a4776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:02.281041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-481a8cfd-c900-47cc-a6d5-726c8845c5c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e3ed889b524d768202b10475af3b35'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:02.285782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-481a8cfd-c900-47cc-a6d5-726c8845c5c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e3ed889b524d768202b10475af3b35'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:02.323734 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-481a8cfd-c900-47cc-a6d5-726c8845c5c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e3ed889b524d768202b10475af3b35'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:02.335363 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1007/2038] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:02.337397 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfe562-c3b5-4418-9da4-83a58e9a4776 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:02.339845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-07dfe562-c3b5-4418-9da4-83a58e9a4776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:02.368000 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfe562-c3b5-4418-9da4-83a58e9a4776 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:02.378767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9179d9a-ee84-4298-8ad5-c91ba4fe9b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:02.380821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9179d9a-ee84-4298-8ad5-c91ba4fe9b1c admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:02.381496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9179d9a-ee84-4298-8ad5-c91ba4fe9b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:02.381962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9179d9a-ee84-4298-8ad5-c91ba4fe9b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:02.383262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9179d9a-ee84-4298-8ad5-c91ba4fe9b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:02.386399 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9179d9a-ee84-4298-8ad5-c91ba4fe9b1c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:02.415600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1008/2039] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:02.415600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0eb9d-c2d9-46ee-94e3-ae533e4f0dd5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:02.415600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0eb9d-c2d9-46ee-94e3-ae533e4f0dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:02.416789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0eb9d-c2d9-46ee-94e3-ae533e4f0dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:02.438134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-481a8cfd-c900-47cc-a6d5-726c8845c5c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e3ed889b524d768202b10475af3b35'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:02.439359 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-481a8cfd-c900-47cc-a6d5-726c8845c5c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e3ed889b524d768202b10475af3b35'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:02.450314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-6ea0eb9d-c2d9-46ee-94e3-ae533e4f0dd5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:02.451781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6ea0eb9d-c2d9-46ee-94e3-ae533e4f0dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:02.462237 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1009/2040] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:02.469925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1032/2041] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:01 2022] DELETE /identity/v3/users/c0e3ed889b524d768202b10475af3b35 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:02.470273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93aac0-a563-473c-897c-8890e2c95c31 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:02.470273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93aac0-a563-473c-897c-8890e2c95c31 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:02.470859 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93aac0-a563-473c-897c-8890e2c95c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:02.477603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a8cfd-c900-47cc-a6d5-726c8845c5c6 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:02.491295 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:02.529172 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ac93aac0-a563-473c-897c-8890e2c95c31 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:02.535959 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ac93aac0-a563-473c-897c-8890e2c95c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:02.629278 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1010/2042] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:02.629278 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23836ba4-29bf-49c9-b703-16b888f2d26c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:02.629278 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23836ba4-29bf-49c9-b703-16b888f2d26c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:02.629278 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23836ba4-29bf-49c9-b703-16b888f2d26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:02.644530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a8cfd-c900-47cc-a6d5-726c8845c5c6 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:02.654332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496df708-a207-467d-942d-4aa8d7509ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:02.655588 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496df708-a207-467d-942d-4aa8d7509ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:02.656100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496df708-a207-467d-942d-4aa8d7509ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:02.656590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496df708-a207-467d-942d-4aa8d7509ef6 admin admin] PATH_INFO: `/v3/projects/7f803f4c903341e2a8c641d9bac1499e/users/aaa916f015e843b99da30c966f472218/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:02.658147 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-23836ba4-29bf-49c9-b703-16b888f2d26c None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:02.660143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-23836ba4-29bf-49c9-b703-16b888f2d26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:02.676002 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1011/2043] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:02.677901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb9752-9980-4b6b-afd5-01b58f37ea70 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:02.679683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb9752-9980-4b6b-afd5-01b58f37ea70 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:02.681348 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb9752-9980-4b6b-afd5-01b58f37ea70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:02.688375 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496df708-a207-467d-942d-4aa8d7509ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f803f4c903341e2a8c641d9bac1499e, user_id=aaa916f015e843b99da30c966f472218, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:02.693514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496df708-a207-467d-942d-4aa8d7509ef6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:02.706066 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9eeb9752-9980-4b6b-afd5-01b58f37ea70 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:02.707342 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9eeb9752-9980-4b6b-afd5-01b58f37ea70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:02.722808 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1012/2044] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:02.724841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb9752-9980-4b6b-afd5-01b58f37ea70 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:02.743954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb9752-9980-4b6b-afd5-01b58f37ea70 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:02.750067 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae55f4-9e12-47dc-bebe-33011f524cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:02.750939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae55f4-9e12-47dc-bebe-33011f524cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:02.751403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae55f4-9e12-47dc-bebe-33011f524cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:02.752319 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae55f4-9e12-47dc-bebe-33011f524cf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:02.753216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae55f4-9e12-47dc-bebe-33011f524cf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:22:02.753808 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae55f4-9e12-47dc-bebe-33011f524cf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:02.755906 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae55f4-9e12-47dc-bebe-33011f524cf0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:02.772504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1013/2045] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:22:02.775380 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae55f4-9e12-47dc-bebe-33011f524cf0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:02.790843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae55f4-9e12-47dc-bebe-33011f524cf0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:02.799135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad11a8-b169-4922-955e-cb167719dffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:02.799834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad11a8-b169-4922-955e-cb167719dffc admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:02.800166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad11a8-b169-4922-955e-cb167719dffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:02.800530 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad11a8-b169-4922-955e-cb167719dffc admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:02.801714 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad11a8-b169-4922-955e-cb167719dffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:22:02.801714 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad11a8-b169-4922-955e-cb167719dffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:02.804026 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad11a8-b169-4922-955e-cb167719dffc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:02.832366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1014/2046] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:22:02.834435 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad11a8-b169-4922-955e-cb167719dffc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:02.837467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8aad11a8-b169-4922-955e-cb167719dffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:02.903801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1033/2047] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:02 2022] PUT /identity/v3/projects/7f803f4c903341e2a8c641d9bac1499e/users/aaa916f015e843b99da30c966f472218/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:02.903801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496df708-a207-467d-942d-4aa8d7509ef6 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:02.979689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad11a8-b169-4922-955e-cb167719dffc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:03.025498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496df708-a207-467d-942d-4aa8d7509ef6 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:03.046639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e85e6-a61e-4889-a3ad-80e906d67b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:03.046639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e85e6-a61e-4889-a3ad-80e906d67b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:03.046639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e85e6-a61e-4889-a3ad-80e906d67b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:03.046639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e85e6-a61e-4889-a3ad-80e906d67b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:03.047427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e85e6-a61e-4889-a3ad-80e906d67b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:03.056906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e85e6-a61e-4889-a3ad-80e906d67b74 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:03.147305 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad927257-ec82-4b2b-945a-ec732a1be76d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:03.148312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad927257-ec82-4b2b-945a-ec732a1be76d service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:03.148758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad927257-ec82-4b2b-945a-ec732a1be76d service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:03.149489 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad927257-ec82-4b2b-945a-ec732a1be76d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:03.169622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad927257-ec82-4b2b-945a-ec732a1be76d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:03.172720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad927257-ec82-4b2b-945a-ec732a1be76d service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:03.197039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1015/2048] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:03.198951 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad927257-ec82-4b2b-945a-ec732a1be76d service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:03.214639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad927257-ec82-4b2b-945a-ec732a1be76d service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:03.227760 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bf12f-2394-4901-a6fa-fe300c827a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:03.228330 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1034/2049] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:02 2022] POST /identity/v3/projects => generated 387 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:03.229560 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bf12f-2394-4901-a6fa-fe300c827a0d admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:03.230283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bf12f-2394-4901-a6fa-fe300c827a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:03.231091 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d54e8-bd68-4703-9308-59c048053c28 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:03.231430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bf12f-2394-4901-a6fa-fe300c827a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:03.231860 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d54e8-bd68-4703-9308-59c048053c28 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:03.232856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d54e8-bd68-4703-9308-59c048053c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:03.233675 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bf12f-2394-4901-a6fa-fe300c827a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:03.238458 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bf12f-2394-4901-a6fa-fe300c827a0d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:03.289456 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-ea3d54e8-bd68-4703-9308-59c048053c28 None None] MFA Rules not processed for user `aaa916f015e843b99da30c966f472218`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:03.291880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ea3d54e8-bd68-4703-9308-59c048053c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:03.381954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1016/2050] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:03 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:03.381954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bf12f-2394-4901-a6fa-fe300c827a0d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:03.417989 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1035/2051] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:03.417989 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d54e8-bd68-4703-9308-59c048053c28 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:03.527489 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bf12f-2394-4901-a6fa-fe300c827a0d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:03.538037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fedac-48d6-4cbc-a525-3c6609a78786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:03.539550 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fedac-48d6-4cbc-a525-3c6609a78786 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:03.540064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fedac-48d6-4cbc-a525-3c6609a78786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:03.540535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fedac-48d6-4cbc-a525-3c6609a78786 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:03.541840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fedac-48d6-4cbc-a525-3c6609a78786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:03.546051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fedac-48d6-4cbc-a525-3c6609a78786 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:03.556187 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d54e8-bd68-4703-9308-59c048053c28 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:03.563070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4d282-6f87-468c-80a5-1b60883142ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:03.564673 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d282-6f87-468c-80a5-1b60883142ac admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:03.566500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d282-6f87-468c-80a5-1b60883142ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:03.567039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d282-6f87-468c-80a5-1b60883142ac admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:03.576341 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4d282-6f87-468c-80a5-1b60883142ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:03.582216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4d282-6f87-468c-80a5-1b60883142ac admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:03.731408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1017/2052] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:03 2022] POST /identity/v3/users => generated 294 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:03.732539 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fedac-48d6-4cbc-a525-3c6609a78786 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:03.748530 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fedac-48d6-4cbc-a525-3c6609a78786 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:03.754313 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef3192-67af-4ff4-a95e-0e31acde2e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:03.755268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef3192-67af-4ff4-a95e-0e31acde2e3f admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:03.755569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef3192-67af-4ff4-a95e-0e31acde2e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:03.755986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef3192-67af-4ff4-a95e-0e31acde2e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:03.756865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef3192-67af-4ff4-a95e-0e31acde2e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:03.759230 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef3192-67af-4ff4-a95e-0e31acde2e3f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:03.795511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1036/2053] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:03 2022] POST /identity/v3/users => generated 290 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:03.797389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4d282-6f87-468c-80a5-1b60883142ac admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:03.827330 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4d282-6f87-468c-80a5-1b60883142ac admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:03.853173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07e625-0cbf-4f29-af7e-338799b4909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:03.854854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07e625-0cbf-4f29-af7e-338799b4909a admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:03.857151 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07e625-0cbf-4f29-af7e-338799b4909a admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:03.857151 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07e625-0cbf-4f29-af7e-338799b4909a admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:03.857577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07e625-0cbf-4f29-af7e-338799b4909a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:03.861639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07e625-0cbf-4f29-af7e-338799b4909a admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:03.890897 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:03.905018 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1037/2054] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:03.907028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07e625-0cbf-4f29-af7e-338799b4909a admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:03.927151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1018/2055] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:03 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:03.935019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef3192-67af-4ff4-a95e-0e31acde2e3f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:03.950672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07e625-0cbf-4f29-af7e-338799b4909a admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:04.066024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9508914-5227-464e-9cc7-625de29dcb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:04.066710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9508914-5227-464e-9cc7-625de29dcb60 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:04.067007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9508914-5227-464e-9cc7-625de29dcb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:04.068580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9508914-5227-464e-9cc7-625de29dcb60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:04.069685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9508914-5227-464e-9cc7-625de29dcb60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:04.071573 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9508914-5227-464e-9cc7-625de29dcb60 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:04.088635 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1038/2056] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:04.089764 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9508914-5227-464e-9cc7-625de29dcb60 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:04.111773 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef3192-67af-4ff4-a95e-0e31acde2e3f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:04.116187 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9508914-5227-464e-9cc7-625de29dcb60 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:04.131363 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211801e-227a-4c9a-9d3c-96f3b5d982dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:04.131952 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d1177-dfdf-44fe-ae1d-da2096022389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:04.132682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211801e-227a-4c9a-9d3c-96f3b5d982dc admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:04.132682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211801e-227a-4c9a-9d3c-96f3b5d982dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:04.132977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d1177-dfdf-44fe-ae1d-da2096022389 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:04.132977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d1177-dfdf-44fe-ae1d-da2096022389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:04.133380 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d1177-dfdf-44fe-ae1d-da2096022389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:04.133539 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211801e-227a-4c9a-9d3c-96f3b5d982dc admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:04.134027 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d1177-dfdf-44fe-ae1d-da2096022389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:04.137518 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211801e-227a-4c9a-9d3c-96f3b5d982dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:04.138128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d1177-dfdf-44fe-ae1d-da2096022389 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:04.140391 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211801e-227a-4c9a-9d3c-96f3b5d982dc admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:04.163068 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1019/2057] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:04.164909 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d1177-dfdf-44fe-ae1d-da2096022389 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:04.197064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d1177-dfdf-44fe-ae1d-da2096022389 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:04.205306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63284c30-2a67-40ce-8f6c-189c520ec144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:04.206499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63284c30-2a67-40ce-8f6c-189c520ec144 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:04.206945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63284c30-2a67-40ce-8f6c-189c520ec144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:04.207326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63284c30-2a67-40ce-8f6c-189c520ec144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:04.208206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63284c30-2a67-40ce-8f6c-189c520ec144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:04.211386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63284c30-2a67-40ce-8f6c-189c520ec144 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:04.230620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1020/2058] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:04.232643 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63284c30-2a67-40ce-8f6c-189c520ec144 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:04.235536 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-63284c30-2a67-40ce-8f6c-189c520ec144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:04.260677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63284c30-2a67-40ce-8f6c-189c520ec144 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:04.269229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392be58-0203-4e4a-bb57-8626c1114f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:04.270489 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392be58-0203-4e4a-bb57-8626c1114f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:04.271546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392be58-0203-4e4a-bb57-8626c1114f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:04.272037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392be58-0203-4e4a-bb57-8626c1114f48 admin admin] PATH_INFO: `/v3/projects/0bb90c45cbcd499eaa032239aa661625` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:04.274343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392be58-0203-4e4a-bb57-8626c1114f48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bb90c45cbcd499eaa032239aa661625)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:04.278741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392be58-0203-4e4a-bb57-8626c1114f48 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:04.290546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1039/2059] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:04 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:04.292558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211801e-227a-4c9a-9d3c-96f3b5d982dc admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:04.321742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211801e-227a-4c9a-9d3c-96f3b5d982dc admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:04.328161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f886a8-eba4-461c-bd00-8f92c99b0093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:04.330915 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f886a8-eba4-461c-bd00-8f92c99b0093 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:04.332024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f886a8-eba4-461c-bd00-8f92c99b0093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:04.332524 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f886a8-eba4-461c-bd00-8f92c99b0093 admin admin] PATH_INFO: `/v3/projects/5777cd64b48f422797e2fc5da643b02c/users/846c28fdeb1e4fb68a78bd0b3cb9f344/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:04.373591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f886a8-eba4-461c-bd00-8f92c99b0093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5777cd64b48f422797e2fc5da643b02c, user_id=846c28fdeb1e4fb68a78bd0b3cb9f344, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:04.377583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f886a8-eba4-461c-bd00-8f92c99b0093 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:04.536890 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1040/2060] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:04 2022] PUT /identity/v3/projects/5777cd64b48f422797e2fc5da643b02c/users/846c28fdeb1e4fb68a78bd0b3cb9f344/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:04.538996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f886a8-eba4-461c-bd00-8f92c99b0093 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:04.551441 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c392be58-0203-4e4a-bb57-8626c1114f48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bb90c45cbcd499eaa032239aa661625', 'request_id': 'req-c392be58-0203-4e4a-bb57-8626c1114f48'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:04.565013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c392be58-0203-4e4a-bb57-8626c1114f48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bb90c45cbcd499eaa032239aa661625', 'request_id': 'req-c392be58-0203-4e4a-bb57-8626c1114f48'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:04.574216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c392be58-0203-4e4a-bb57-8626c1114f48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bb90c45cbcd499eaa032239aa661625', 'request_id': 'req-c392be58-0203-4e4a-bb57-8626c1114f48'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:04.648225 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f886a8-eba4-461c-bd00-8f92c99b0093 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:04.702041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c392be58-0203-4e4a-bb57-8626c1114f48 admin admin] The token cache is being invalidate because project 0bb90c45cbcd499eaa032239aa661625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:04.702561 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c392be58-0203-4e4a-bb57-8626c1114f48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:04.703632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c392be58-0203-4e4a-bb57-8626c1114f48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:04.707629 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1021/2061] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:04 2022] DELETE /identity/v3/projects/0bb90c45cbcd499eaa032239aa661625 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:04.709452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392be58-0203-4e4a-bb57-8626c1114f48 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:04.711576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c392be58-0203-4e4a-bb57-8626c1114f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:04.732898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286b8f0-47bc-4616-8536-4833f285525c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:04.733673 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286b8f0-47bc-4616-8536-4833f285525c admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:04.734017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286b8f0-47bc-4616-8536-4833f285525c admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:04.734302 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286b8f0-47bc-4616-8536-4833f285525c admin admin] PATH_INFO: `/v3/projects/6444075fa882460f822a025bc182937f/users/0fe3f34427bd4029bcb54d616c94fac4/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:04.742639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392be58-0203-4e4a-bb57-8626c1114f48 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:04.750629 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9bd9f-bcd9-4382-a2aa-fc52cf960afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:04.753652 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9bd9f-bcd9-4382-a2aa-fc52cf960afd admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:04.753652 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9bd9f-bcd9-4382-a2aa-fc52cf960afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:04.753652 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9bd9f-bcd9-4382-a2aa-fc52cf960afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:04.753652 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9bd9f-bcd9-4382-a2aa-fc52cf960afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:04.754715 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9bd9f-bcd9-4382-a2aa-fc52cf960afd admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:04.759253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286b8f0-47bc-4616-8536-4833f285525c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6444075fa882460f822a025bc182937f, user_id=0fe3f34427bd4029bcb54d616c94fac4, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:04.762285 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286b8f0-47bc-4616-8536-4833f285525c admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:04.769565 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1022/2062] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:04.772230 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077f1a4-91ef-481b-aea8-50e149c4891d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:04.772700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077f1a4-91ef-481b-aea8-50e149c4891d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:04.773168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077f1a4-91ef-481b-aea8-50e149c4891d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:04.807321 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c077f1a4-91ef-481b-aea8-50e149c4891d None None] MFA Rules not processed for user `846c28fdeb1e4fb68a78bd0b3cb9f344`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:04.808833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c077f1a4-91ef-481b-aea8-50e149c4891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:04.860224 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1041/2063] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:04 2022] PUT /identity/v3/projects/6444075fa882460f822a025bc182937f/users/0fe3f34427bd4029bcb54d616c94fac4/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:04.861652 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286b8f0-47bc-4616-8536-4833f285525c admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:04.867686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6286b8f0-47bc-4616-8536-4833f285525c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:04.905125 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1023/2064] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:04.907522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077f1a4-91ef-481b-aea8-50e149c4891d None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:04.909576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c077f1a4-91ef-481b-aea8-50e149c4891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:04.926882 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077f1a4-91ef-481b-aea8-50e149c4891d None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:04.964469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286b8f0-47bc-4616-8536-4833f285525c admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:04.972435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a697b24-35fa-4756-8950-51766c4008fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:04.972435 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a697b24-35fa-4756-8950-51766c4008fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:04.973057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a697b24-35fa-4756-8950-51766c4008fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:04.973230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a697b24-35fa-4756-8950-51766c4008fe admin admin] PATH_INFO: `/v3/users/4e3722f8eb854da7b8e4203ba3b3dea0` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:04.975028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a697b24-35fa-4756-8950-51766c4008fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e3722f8eb854da7b8e4203ba3b3dea0)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:04.977344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a697b24-35fa-4756-8950-51766c4008fe admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:04.980450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:05.022946 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f2616-368f-40bd-a6da-ab6016e2b2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:05.023522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2616-368f-40bd-a6da-ab6016e2b2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:05.023806 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2616-368f-40bd-a6da-ab6016e2b2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:05.024078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2616-368f-40bd-a6da-ab6016e2b2bc admin admin] PATH_INFO: `/v3/users/95fa83a24bee4ea3880749b32d30319f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:05.025435 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f2616-368f-40bd-a6da-ab6016e2b2bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=95fa83a24bee4ea3880749b32d30319f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:05.027472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f2616-368f-40bd-a6da-ab6016e2b2bc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:05.222136 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0a697b24-35fa-4756-8950-51766c4008fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e3722f8eb854da7b8e4203ba3b3dea0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:05.222981 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0a697b24-35fa-4756-8950-51766c4008fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e3722f8eb854da7b8e4203ba3b3dea0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:05.246541 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0a697b24-35fa-4756-8950-51766c4008fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e3722f8eb854da7b8e4203ba3b3dea0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:05.361062 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-315f2616-368f-40bd-a6da-ab6016e2b2bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95fa83a24bee4ea3880749b32d30319f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:05.361929 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-315f2616-368f-40bd-a6da-ab6016e2b2bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95fa83a24bee4ea3880749b32d30319f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:05.369278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0a697b24-35fa-4756-8950-51766c4008fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e3722f8eb854da7b8e4203ba3b3dea0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:05.371000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0a697b24-35fa-4756-8950-51766c4008fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e3722f8eb854da7b8e4203ba3b3dea0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:05.384832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-315f2616-368f-40bd-a6da-ab6016e2b2bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95fa83a24bee4ea3880749b32d30319f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:05.387326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-315f2616-368f-40bd-a6da-ab6016e2b2bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95fa83a24bee4ea3880749b32d30319f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:05.397408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1042/2065] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:04 2022] DELETE /identity/v3/users/4e3722f8eb854da7b8e4203ba3b3dea0 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:05.398722 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a697b24-35fa-4756-8950-51766c4008fe admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:05.401742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0a697b24-35fa-4756-8950-51766c4008fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:05.477406 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-315f2616-368f-40bd-a6da-ab6016e2b2bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95fa83a24bee4ea3880749b32d30319f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:05.527356 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1024/2066] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:04 2022] DELETE /identity/v3/users/95fa83a24bee4ea3880749b32d30319f => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:05.530017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6868cd6-3f29-4693-a28a-6efc94029c60 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:05.551310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6868cd6-3f29-4693-a28a-6efc94029c60 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:05.551310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6868cd6-3f29-4693-a28a-6efc94029c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:05.579899 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a697b24-35fa-4756-8950-51766c4008fe admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:05.602199 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f6868cd6-3f29-4693-a28a-6efc94029c60 None None] MFA Rules not processed for user `0fe3f34427bd4029bcb54d616c94fac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:05.604983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f6868cd6-3f29-4693-a28a-6efc94029c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:05.732120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f166c8e-fd59-4813-84db-3076eb74c482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:05.733220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f166c8e-fd59-4813-84db-3076eb74c482 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:05.733766 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f166c8e-fd59-4813-84db-3076eb74c482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:05.734260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f166c8e-fd59-4813-84db-3076eb74c482 admin admin] PATH_INFO: `/v3/projects/2309ccad0e764a4d8f8745d9ea09eaf4/users/ceb8b82533d5438a84d710fb3a945d80/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:05.751767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1025/2067] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:05.751767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6868cd6-3f29-4693-a28a-6efc94029c60 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:05.752332 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f6868cd6-3f29-4693-a28a-6efc94029c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:05.770481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f166c8e-fd59-4813-84db-3076eb74c482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2309ccad0e764a4d8f8745d9ea09eaf4, user_id=ceb8b82533d5438a84d710fb3a945d80, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:05.777689 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f166c8e-fd59-4813-84db-3076eb74c482 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:05.783302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6868cd6-3f29-4693-a28a-6efc94029c60 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:05.789320 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb937074-5e6b-4830-bad0-696fe8d43fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:05.790429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb937074-5e6b-4830-bad0-696fe8d43fcd admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:05.790950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb937074-5e6b-4830-bad0-696fe8d43fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:05.791874 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb937074-5e6b-4830-bad0-696fe8d43fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:05.792758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb937074-5e6b-4830-bad0-696fe8d43fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:05.796758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb937074-5e6b-4830-bad0-696fe8d43fcd admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:05.922494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1043/2068] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:05 2022] PUT /identity/v3/projects/2309ccad0e764a4d8f8745d9ea09eaf4/users/ceb8b82533d5438a84d710fb3a945d80/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:05.924562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f166c8e-fd59-4813-84db-3076eb74c482 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:05.928469 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2f166c8e-fd59-4813-84db-3076eb74c482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:05.961463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1026/2069] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:05 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:05.961463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb937074-5e6b-4830-bad0-696fe8d43fcd admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:05.963651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bb937074-5e6b-4830-bad0-696fe8d43fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:06.034701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f166c8e-fd59-4813-84db-3076eb74c482 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:06.085687 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb937074-5e6b-4830-bad0-696fe8d43fcd admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:06.095107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6514f-9e9d-47b9-b4dc-ac8ae3103ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:06.095560 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6514f-9e9d-47b9-b4dc-ac8ae3103ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:06.095846 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6514f-9e9d-47b9-b4dc-ac8ae3103ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:06.096125 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6514f-9e9d-47b9-b4dc-ac8ae3103ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:06.100065 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6514f-9e9d-47b9-b4dc-ac8ae3103ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:06.104122 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6514f-9e9d-47b9-b4dc-ac8ae3103ea8 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:06.114876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:06.132175 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c2244-e970-4f72-aa25-0bd13138fe90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:06.132836 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c2244-e970-4f72-aa25-0bd13138fe90 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:06.133348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c2244-e970-4f72-aa25-0bd13138fe90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:06.133696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c2244-e970-4f72-aa25-0bd13138fe90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:06.135951 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-aa3c2244-e970-4f72-aa25-0bd13138fe90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:06.234232 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c2244-e970-4f72-aa25-0bd13138fe90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:06.236156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c2244-e970-4f72-aa25-0bd13138fe90 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:06.248671 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1044/2070] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:06.249543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c2244-e970-4f72-aa25-0bd13138fe90 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:06.252453 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-aa3c2244-e970-4f72-aa25-0bd13138fe90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:06.266978 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c2244-e970-4f72-aa25-0bd13138fe90 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:06.273935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad54633-2660-4749-9885-77ca21cde123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:06.275043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54633-2660-4749-9885-77ca21cde123 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:06.275522 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54633-2660-4749-9885-77ca21cde123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:06.275936 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54633-2660-4749-9885-77ca21cde123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:06.276977 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad54633-2660-4749-9885-77ca21cde123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:06.278925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad54633-2660-4749-9885-77ca21cde123 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:06.294859 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1045/2071] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:06.295690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad54633-2660-4749-9885-77ca21cde123 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:06.311831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad54633-2660-4749-9885-77ca21cde123 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:06.320815 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23973af0-4e60-4035-8d00-cb365ea3c5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:06.321465 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23973af0-4e60-4035-8d00-cb365ea3c5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:06.321836 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23973af0-4e60-4035-8d00-cb365ea3c5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:06.322122 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23973af0-4e60-4035-8d00-cb365ea3c5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:06.322888 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23973af0-4e60-4035-8d00-cb365ea3c5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:06.324884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23973af0-4e60-4035-8d00-cb365ea3c5a4 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:06.330658 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1027/2072] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:05 2022] POST /identity/v3/projects => generated 379 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:06.330658 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6514f-9e9d-47b9-b4dc-ac8ae3103ea8 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:06.335807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-07a6514f-9e9d-47b9-b4dc-ac8ae3103ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:06.445263 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6514f-9e9d-47b9-b4dc-ac8ae3103ea8 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:06.450141 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be287c-5fbe-44e6-b6a8-ef609701da0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:06.450847 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be287c-5fbe-44e6-b6a8-ef609701da0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:06.451139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be287c-5fbe-44e6-b6a8-ef609701da0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:06.451419 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be287c-5fbe-44e6-b6a8-ef609701da0a admin admin] PATH_INFO: `/v3/projects/5e4c2fa08af64077ae3abbe52a551157` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:06.452700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be287c-5fbe-44e6-b6a8-ef609701da0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e4c2fa08af64077ae3abbe52a551157)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:06.454717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be287c-5fbe-44e6-b6a8-ef609701da0a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:06.463189 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1046/2073] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:06 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:06.464838 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23973af0-4e60-4035-8d00-cb365ea3c5a4 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:06.467832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-23973af0-4e60-4035-8d00-cb365ea3c5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:06.484925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23973af0-4e60-4035-8d00-cb365ea3c5a4 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:06.490941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce8bde-341d-4fec-8b7c-5907bbcdfa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:06.491732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce8bde-341d-4fec-8b7c-5907bbcdfa00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:06.492028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce8bde-341d-4fec-8b7c-5907bbcdfa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:06.492315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce8bde-341d-4fec-8b7c-5907bbcdfa00 admin admin] PATH_INFO: `/v3/projects/48f4260eb20d4ef897f671318f8a3ebd` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:06.493620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce8bde-341d-4fec-8b7c-5907bbcdfa00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f4260eb20d4ef897f671318f8a3ebd)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:06.496288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce8bde-341d-4fec-8b7c-5907bbcdfa00 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:06.626734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-27be287c-5fbe-44e6-b6a8-ef609701da0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e4c2fa08af64077ae3abbe52a551157', 'request_id': 'req-27be287c-5fbe-44e6-b6a8-ef609701da0a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:06.635642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-27be287c-5fbe-44e6-b6a8-ef609701da0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e4c2fa08af64077ae3abbe52a551157', 'request_id': 'req-27be287c-5fbe-44e6-b6a8-ef609701da0a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:06.641984 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-efce8bde-341d-4fec-8b7c-5907bbcdfa00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f4260eb20d4ef897f671318f8a3ebd', 'request_id': 'req-efce8bde-341d-4fec-8b7c-5907bbcdfa00'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:06.650618 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-27be287c-5fbe-44e6-b6a8-ef609701da0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e4c2fa08af64077ae3abbe52a551157', 'request_id': 'req-27be287c-5fbe-44e6-b6a8-ef609701da0a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:06.744940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:06.790444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-efce8bde-341d-4fec-8b7c-5907bbcdfa00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f4260eb20d4ef897f671318f8a3ebd', 'request_id': 'req-efce8bde-341d-4fec-8b7c-5907bbcdfa00'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:06.799835 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-efce8bde-341d-4fec-8b7c-5907bbcdfa00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f4260eb20d4ef897f671318f8a3ebd', 'request_id': 'req-efce8bde-341d-4fec-8b7c-5907bbcdfa00'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:06.815560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-efce8bde-341d-4fec-8b7c-5907bbcdfa00 admin admin] The token cache is being invalidate because project 48f4260eb20d4ef897f671318f8a3ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:06.815821 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-efce8bde-341d-4fec-8b7c-5907bbcdfa00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:06.817175 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-efce8bde-341d-4fec-8b7c-5907bbcdfa00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:06.820713 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1047/2074] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:06 2022] DELETE /identity/v3/projects/48f4260eb20d4ef897f671318f8a3ebd => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:06.821774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce8bde-341d-4fec-8b7c-5907bbcdfa00 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:06.823522 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-efce8bde-341d-4fec-8b7c-5907bbcdfa00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:06.909007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-27be287c-5fbe-44e6-b6a8-ef609701da0a admin admin] The token cache is being invalidate because project 5e4c2fa08af64077ae3abbe52a551157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:06.909321 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-27be287c-5fbe-44e6-b6a8-ef609701da0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:06.909990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-27be287c-5fbe-44e6-b6a8-ef609701da0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:06.913334 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1028/2075] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:06 2022] DELETE /identity/v3/projects/5e4c2fa08af64077ae3abbe52a551157 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:06.915439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be287c-5fbe-44e6-b6a8-ef609701da0a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:06.919111 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-27be287c-5fbe-44e6-b6a8-ef609701da0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:06.941180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce8bde-341d-4fec-8b7c-5907bbcdfa00 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:06.950119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487080e1-f862-4432-bbcb-04d26d87265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:06.952045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487080e1-f862-4432-bbcb-04d26d87265a admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:06.958858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487080e1-f862-4432-bbcb-04d26d87265a admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:06.958858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487080e1-f862-4432-bbcb-04d26d87265a admin admin] PATH_INFO: `/v3/projects/2309ccad0e764a4d8f8745d9ea09eaf4/users/ceb8b82533d5438a84d710fb3a945d80/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:06.963087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487080e1-f862-4432-bbcb-04d26d87265a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2309ccad0e764a4d8f8745d9ea09eaf4, user_id=ceb8b82533d5438a84d710fb3a945d80, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:06.968305 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487080e1-f862-4432-bbcb-04d26d87265a admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:06.994447 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1048/2076] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:06 2022] PUT /identity/v3/projects/2309ccad0e764a4d8f8745d9ea09eaf4/users/ceb8b82533d5438a84d710fb3a945d80/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:06.996079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487080e1-f862-4432-bbcb-04d26d87265a admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:06.999234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-487080e1-f862-4432-bbcb-04d26d87265a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:07.015863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be287c-5fbe-44e6-b6a8-ef609701da0a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:07.096860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d138fd-4a57-428e-afcb-32de44bfa319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:07.098070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d138fd-4a57-428e-afcb-32de44bfa319 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.098836 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d138fd-4a57-428e-afcb-32de44bfa319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.109383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d138fd-4a57-428e-afcb-32de44bfa319 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.109383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d138fd-4a57-428e-afcb-32de44bfa319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:07.109383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d138fd-4a57-428e-afcb-32de44bfa319 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:07.114194 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487080e1-f862-4432-bbcb-04d26d87265a admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:07.119284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5158f-f3bf-4fe0-845e-5d83fa62c364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:07.119942 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5158f-f3bf-4fe0-845e-5d83fa62c364 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.120232 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5158f-f3bf-4fe0-845e-5d83fa62c364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.120537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5158f-f3bf-4fe0-845e-5d83fa62c364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.121306 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5158f-f3bf-4fe0-845e-5d83fa62c364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:07.123019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5158f-f3bf-4fe0-845e-5d83fa62c364 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:07.136154 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1049/2077] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:07.137731 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edbcf7-d80e-4200-a79c-dfc557c11f09 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.138036 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edbcf7-d80e-4200-a79c-dfc557c11f09 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.138310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edbcf7-d80e-4200-a79c-dfc557c11f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.162929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-25edbcf7-d80e-4200-a79c-dfc557c11f09 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:07.164190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-25edbcf7-d80e-4200-a79c-dfc557c11f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:07.174621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1050/2078] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:07.175948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9ec0a-6b53-4c78-80ae-ad47fbc29a98 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.176228 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9ec0a-6b53-4c78-80ae-ad47fbc29a98 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.176602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9ec0a-6b53-4c78-80ae-ad47fbc29a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.200292 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-f9d9ec0a-6b53-4c78-80ae-ad47fbc29a98 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:07.205988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f9d9ec0a-6b53-4c78-80ae-ad47fbc29a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:07.217663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1051/2079] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:07.219157 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43358c72-6184-4a5c-9407-7d9a52844832 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.219771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43358c72-6184-4a5c-9407-7d9a52844832 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.219929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43358c72-6184-4a5c-9407-7d9a52844832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.253411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-43358c72-6184-4a5c-9407-7d9a52844832 None None] MFA Rules not processed for user `ceb8b82533d5438a84d710fb3a945d80`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:07.255248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-43358c72-6184-4a5c-9407-7d9a52844832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:07.298230 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1029/2080] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:06 2022] POST /identity/v3/users => generated 290 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:07.298230 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d138fd-4a57-428e-afcb-32de44bfa319 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:07.309460 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d138fd-4a57-428e-afcb-32de44bfa319 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:07.314507 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4a948-aa8e-41bc-abc5-1e1d8d90003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:07.315270 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4a948-aa8e-41bc-abc5-1e1d8d90003b admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.315561 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4a948-aa8e-41bc-abc5-1e1d8d90003b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.315851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4a948-aa8e-41bc-abc5-1e1d8d90003b admin admin] PATH_INFO: `/v3/projects/b9569889a1044cf28f8c94ec922d1b65/users/6faaeee7f178401c8411acefce21928a/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.337008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4a948-aa8e-41bc-abc5-1e1d8d90003b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9569889a1044cf28f8c94ec922d1b65, user_id=6faaeee7f178401c8411acefce21928a, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:07.350131 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4a948-aa8e-41bc-abc5-1e1d8d90003b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:07.363125 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1052/2081] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:07.365586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ffd23-ad0c-4cff-b08e-b686190e9030 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.365586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ffd23-ad0c-4cff-b08e-b686190e9030 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.365586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ffd23-ad0c-4cff-b08e-b686190e9030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.389430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-6d0ffd23-ad0c-4cff-b08e-b686190e9030 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:07.390705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6d0ffd23-ad0c-4cff-b08e-b686190e9030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:07.400583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1053/2082] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:07.402532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197841b-1169-4242-9d74-ea63ba366b87 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.402532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197841b-1169-4242-9d74-ea63ba366b87 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.403018 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197841b-1169-4242-9d74-ea63ba366b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.425701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-5197841b-1169-4242-9d74-ea63ba366b87 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:07.427077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5197841b-1169-4242-9d74-ea63ba366b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:07.436432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1054/2083] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:07.437886 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197841b-1169-4242-9d74-ea63ba366b87 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:07.454411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197841b-1169-4242-9d74-ea63ba366b87 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:07.460941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb89ce-682a-4cc3-9309-c82c7a4fb9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:07.461582 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb89ce-682a-4cc3-9309-c82c7a4fb9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.461870 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb89ce-682a-4cc3-9309-c82c7a4fb9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.462153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb89ce-682a-4cc3-9309-c82c7a4fb9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.462909 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb89ce-682a-4cc3-9309-c82c7a4fb9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:07.464537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb89ce-682a-4cc3-9309-c82c7a4fb9e3 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:07.477078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1055/2084] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:07.477787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb89ce-682a-4cc3-9309-c82c7a4fb9e3 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:07.479682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f7eb89ce-682a-4cc3-9309-c82c7a4fb9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:07.497381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1030/2085] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:07 2022] PUT /identity/v3/projects/b9569889a1044cf28f8c94ec922d1b65/users/6faaeee7f178401c8411acefce21928a/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:07.502138 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4a948-aa8e-41bc-abc5-1e1d8d90003b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:07.570091 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb89ce-682a-4cc3-9309-c82c7a4fb9e3 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:07.612260 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4a948-aa8e-41bc-abc5-1e1d8d90003b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:07.622902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f19ef-df90-4b52-a90d-840f778a2566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:07.622902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f19ef-df90-4b52-a90d-840f778a2566 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.623563 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f19ef-df90-4b52-a90d-840f778a2566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.628567 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f19ef-df90-4b52-a90d-840f778a2566 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.628567 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f19ef-df90-4b52-a90d-840f778a2566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:22:07.628567 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f19ef-df90-4b52-a90d-840f778a2566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:07.629800 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f19ef-df90-4b52-a90d-840f778a2566 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:07.653062 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1031/2086] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:22:07.657464 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668f53f-9437-496f-b5d1-87883c723d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:07.657464 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668f53f-9437-496f-b5d1-87883c723d04 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.657790 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f19ef-df90-4b52-a90d-840f778a2566 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:07.657936 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668f53f-9437-496f-b5d1-87883c723d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.657936 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668f53f-9437-496f-b5d1-87883c723d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.673903 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f19ef-df90-4b52-a90d-840f778a2566 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:07.682801 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9735825-0472-47dd-a523-79c91ad711e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:07.683883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9735825-0472-47dd-a523-79c91ad711e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.684405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9735825-0472-47dd-a523-79c91ad711e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.684916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9735825-0472-47dd-a523-79c91ad711e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.686288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9735825-0472-47dd-a523-79c91ad711e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:22:07.686883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9735825-0472-47dd-a523-79c91ad711e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:07.690288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9735825-0472-47dd-a523-79c91ad711e3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:07.715595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1032/2087] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:22:07.716972 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9735825-0472-47dd-a523-79c91ad711e3 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:07.735270 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9735825-0472-47dd-a523-79c91ad711e3 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:07.744576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae91ea-48c1-425e-9d67-eb99ec52b274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:07.749935 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae91ea-48c1-425e-9d67-eb99ec52b274 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.749935 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae91ea-48c1-425e-9d67-eb99ec52b274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.749935 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae91ea-48c1-425e-9d67-eb99ec52b274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.749935 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae91ea-48c1-425e-9d67-eb99ec52b274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:07.750914 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae91ea-48c1-425e-9d67-eb99ec52b274 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:07.756789 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668f53f-9437-496f-b5d1-87883c723d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:07.758609 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668f53f-9437-496f-b5d1-87883c723d04 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:07.775003 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1056/2088] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:07.777089 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668f53f-9437-496f-b5d1-87883c723d04 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:07.778641 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1033/2089] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:07.781749 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae91ea-48c1-425e-9d67-eb99ec52b274 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:07.806885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668f53f-9437-496f-b5d1-87883c723d04 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:07.813041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cde53c-e8e4-4dec-951a-59b0b3d05d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:07.813764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae91ea-48c1-425e-9d67-eb99ec52b274 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:07.813868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde53c-e8e4-4dec-951a-59b0b3d05d20 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.814181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde53c-e8e4-4dec-951a-59b0b3d05d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.815390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde53c-e8e4-4dec-951a-59b0b3d05d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.816729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cde53c-e8e4-4dec-951a-59b0b3d05d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:07.820149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cde53c-e8e4-4dec-951a-59b0b3d05d20 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:07.836239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb876d-e021-4c9b-8fae-880a47fea2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:07.837288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb876d-e021-4c9b-8fae-880a47fea2db admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.837762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb876d-e021-4c9b-8fae-880a47fea2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.838215 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb876d-e021-4c9b-8fae-880a47fea2db admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.839499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb876d-e021-4c9b-8fae-880a47fea2db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:07.841182 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1057/2090] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:07.844850 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cde53c-e8e4-4dec-951a-59b0b3d05d20 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:07.845453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb876d-e021-4c9b-8fae-880a47fea2db admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:07.860785 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cde53c-e8e4-4dec-951a-59b0b3d05d20 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:07.866608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8853e7d-4162-4871-9596-690a04e8b0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:07.867359 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8853e7d-4162-4871-9596-690a04e8b0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:07.867718 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8853e7d-4162-4871-9596-690a04e8b0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:07.867993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8853e7d-4162-4871-9596-690a04e8b0d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:07.868697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8853e7d-4162-4871-9596-690a04e8b0d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:07.870889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8853e7d-4162-4871-9596-690a04e8b0d6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:08.049536 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1058/2091] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:07 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:08.049536 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8853e7d-4162-4871-9596-690a04e8b0d6 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:08.094255 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1034/2092] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:07 2022] POST /identity/v3/projects => generated 387 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:08.095914 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb876d-e021-4c9b-8fae-880a47fea2db admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:08.171515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8853e7d-4162-4871-9596-690a04e8b0d6 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:08.213513 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb876d-e021-4c9b-8fae-880a47fea2db admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:08.221026 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6836f8-f408-4e92-ae3d-2ff8baf64884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:08.221950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6836f8-f408-4e92-ae3d-2ff8baf64884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:08.222607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6836f8-f408-4e92-ae3d-2ff8baf64884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:08.223328 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6836f8-f408-4e92-ae3d-2ff8baf64884 admin admin] PATH_INFO: `/v3/projects/b9569889a1044cf28f8c94ec922d1b65/users/6faaeee7f178401c8411acefce21928a/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:08.227068 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6836f8-f408-4e92-ae3d-2ff8baf64884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9569889a1044cf28f8c94ec922d1b65, user_id=6faaeee7f178401c8411acefce21928a, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:08.229959 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6836f8-f408-4e92-ae3d-2ff8baf64884 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:08.245229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1035/2093] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:08 2022] PUT /identity/v3/projects/b9569889a1044cf28f8c94ec922d1b65/users/6faaeee7f178401c8411acefce21928a/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:08.246142 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6836f8-f408-4e92-ae3d-2ff8baf64884 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:08.248378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3e6836f8-f408-4e92-ae3d-2ff8baf64884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:08.256280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80187944-7eb5-48e2-a6a6-84a412038c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:08.258321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80187944-7eb5-48e2-a6a6-84a412038c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:08.259086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80187944-7eb5-48e2-a6a6-84a412038c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:08.259751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80187944-7eb5-48e2-a6a6-84a412038c17 admin admin] PATH_INFO: `/v3/projects/ea3599f2780c4d95b2ac215ced2c067d/users/1512b25f55c843e7bf77ee5272bde16b/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:08.286271 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80187944-7eb5-48e2-a6a6-84a412038c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3599f2780c4d95b2ac215ced2c067d, user_id=1512b25f55c843e7bf77ee5272bde16b, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:08.290123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80187944-7eb5-48e2-a6a6-84a412038c17 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:08.351720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6836f8-f408-4e92-ae3d-2ff8baf64884 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:08.357931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3900c82-2821-4f1c-9eae-805dc91ec6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:08.358695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3900c82-2821-4f1c-9eae-805dc91ec6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:08.358990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3900c82-2821-4f1c-9eae-805dc91ec6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:08.359495 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3900c82-2821-4f1c-9eae-805dc91ec6f4 admin admin] PATH_INFO: `/v3/users/aaa916f015e843b99da30c966f472218` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:08.360874 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3900c82-2821-4f1c-9eae-805dc91ec6f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa916f015e843b99da30c966f472218)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:08.363902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3900c82-2821-4f1c-9eae-805dc91ec6f4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:08.374934 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1059/2094] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:08 2022] PUT /identity/v3/projects/ea3599f2780c4d95b2ac215ced2c067d/users/1512b25f55c843e7bf77ee5272bde16b/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:08.375687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80187944-7eb5-48e2-a6a6-84a412038c17 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:08.470928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80187944-7eb5-48e2-a6a6-84a412038c17 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:08.478507 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5bf86-d59d-49b3-ae49-81956e1a183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:08.479157 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5bf86-d59d-49b3-ae49-81956e1a183f admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:08.479452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5bf86-d59d-49b3-ae49-81956e1a183f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:08.479733 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5bf86-d59d-49b3-ae49-81956e1a183f admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:08.480425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5bf86-d59d-49b3-ae49-81956e1a183f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:08.482624 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5bf86-d59d-49b3-ae49-81956e1a183f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:08.580603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1060/2095] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:08 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:08.582656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5bf86-d59d-49b3-ae49-81956e1a183f admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:08.595830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5bf86-d59d-49b3-ae49-81956e1a183f admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:08.605860 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d2049-8da6-43d9-9d80-b7bcd0a13ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:08.606534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d2049-8da6-43d9-9d80-b7bcd0a13ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:08.606816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d2049-8da6-43d9-9d80-b7bcd0a13ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:08.611298 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d2049-8da6-43d9-9d80-b7bcd0a13ba4 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:08.611298 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d2049-8da6-43d9-9d80-b7bcd0a13ba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:08.611298 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d2049-8da6-43d9-9d80-b7bcd0a13ba4 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:08.631762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-f3900c82-2821-4f1c-9eae-805dc91ec6f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa916f015e843b99da30c966f472218'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:08.632503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-f3900c82-2821-4f1c-9eae-805dc91ec6f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa916f015e843b99da30c966f472218'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:08.650026 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-f3900c82-2821-4f1c-9eae-805dc91ec6f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa916f015e843b99da30c966f472218'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:08.650847 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-f3900c82-2821-4f1c-9eae-805dc91ec6f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa916f015e843b99da30c966f472218'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:08.750772 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-f3900c82-2821-4f1c-9eae-805dc91ec6f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa916f015e843b99da30c966f472218'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:08.765077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1061/2096] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:08 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:08.767181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92c7f0-61aa-4a8d-a28c-e7e2b0237a39 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:08.767768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92c7f0-61aa-4a8d-a28c-e7e2b0237a39 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:08.768251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92c7f0-61aa-4a8d-a28c-e7e2b0237a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:08.774272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1036/2097] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:08 2022] DELETE /identity/v3/users/aaa916f015e843b99da30c966f472218 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:08.775950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c301da-9c5b-4b64-a96b-a04327d6ade8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:08.776276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c301da-9c5b-4b64-a96b-a04327d6ade8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:08.776556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c301da-9c5b-4b64-a96b-a04327d6ade8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:08.798275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:08.815019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d6c301da-9c5b-4b64-a96b-a04327d6ade8 None None] MFA Rules not processed for user `1512b25f55c843e7bf77ee5272bde16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:08.816676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d6c301da-9c5b-4b64-a96b-a04327d6ade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:08.828861 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-9b92c7f0-61aa-4a8d-a28c-e7e2b0237a39 None None] MFA Rules not processed for user `6faaeee7f178401c8411acefce21928a`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:08.831199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-9b92c7f0-61aa-4a8d-a28c-e7e2b0237a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:08.920465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1037/2098] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:08.922034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c301da-9c5b-4b64-a96b-a04327d6ade8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:08.924318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d6c301da-9c5b-4b64-a96b-a04327d6ade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:08.929169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:08.953062 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1062/2099] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:08.954074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92c7f0-61aa-4a8d-a28c-e7e2b0237a39 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:08.955912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-9b92c7f0-61aa-4a8d-a28c-e7e2b0237a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:09.048557 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92c7f0-61aa-4a8d-a28c-e7e2b0237a39 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:09.052456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c301da-9c5b-4b64-a96b-a04327d6ade8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:09.056685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e1dcd-c595-436a-835a-7089ee8e19ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:09.057576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1dcd-c595-436a-835a-7089ee8e19ae service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:09.057948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1dcd-c595-436a-835a-7089ee8e19ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:09.058347 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1dcd-c595-436a-835a-7089ee8e19ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:09.059774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb2980-3a9f-424a-a0ad-f55c5427c0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:09.060572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb2980-3a9f-424a-a0ad-f55c5427c0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:09.060747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e51e1dcd-c595-436a-835a-7089ee8e19ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:09.061020 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb2980-3a9f-424a-a0ad-f55c5427c0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:09.061397 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb2980-3a9f-424a-a0ad-f55c5427c0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:09.062844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb2980-3a9f-424a-a0ad-f55c5427c0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:09.065359 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb2980-3a9f-424a-a0ad-f55c5427c0f8 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:09.079992 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1038/2100] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:09.081456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb2980-3a9f-424a-a0ad-f55c5427c0f8 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:09.085038 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0dfb2980-3a9f-424a-a0ad-f55c5427c0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:09.103170 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb2980-3a9f-424a-a0ad-f55c5427c0f8 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:09.109561 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9db2fa-30af-4ea6-b116-92ed0a7ab980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:09.110209 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9db2fa-30af-4ea6-b116-92ed0a7ab980 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:09.110756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9db2fa-30af-4ea6-b116-92ed0a7ab980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:09.111062 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9db2fa-30af-4ea6-b116-92ed0a7ab980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:09.111987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9db2fa-30af-4ea6-b116-92ed0a7ab980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:09.113868 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9db2fa-30af-4ea6-b116-92ed0a7ab980 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:09.130306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1039/2101] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:09.131862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7d0eb-c858-4324-8481-45b8c71ae01a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:09.132161 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7d0eb-c858-4324-8481-45b8c71ae01a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:09.132426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7d0eb-c858-4324-8481-45b8c71ae01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:09.159284 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-deb7d0eb-c858-4324-8481-45b8c71ae01a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:09.161949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-deb7d0eb-c858-4324-8481-45b8c71ae01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:09.176088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1040/2102] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:09.178000 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7d0eb-c858-4324-8481-45b8c71ae01a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:09.180424 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-deb7d0eb-c858-4324-8481-45b8c71ae01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:09.201338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7d0eb-c858-4324-8481-45b8c71ae01a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:09.201614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e1dcd-c595-436a-835a-7089ee8e19ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:09.204356 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e1dcd-c595-436a-835a-7089ee8e19ae service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:09.208254 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f78f7c-85b7-4aad-8fee-4240ba46890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:09.209522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f78f7c-85b7-4aad-8fee-4240ba46890a admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:09.209828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f78f7c-85b7-4aad-8fee-4240ba46890a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:09.210077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f78f7c-85b7-4aad-8fee-4240ba46890a admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:09.211144 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f78f7c-85b7-4aad-8fee-4240ba46890a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:09.214115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f78f7c-85b7-4aad-8fee-4240ba46890a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:09.236939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1063/2103] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:09.239259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e1dcd-c595-436a-835a-7089ee8e19ae service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:09.242298 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e51e1dcd-c595-436a-835a-7089ee8e19ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:09.253699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:09.279612 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e1dcd-c595-436a-835a-7089ee8e19ae service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:09.287918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e059124-521c-46a5-a544-d0d5b0af5473 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:09.289494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e059124-521c-46a5-a544-d0d5b0af5473 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:09.290270 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e059124-521c-46a5-a544-d0d5b0af5473 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:09.291089 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e059124-521c-46a5-a544-d0d5b0af5473 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:09.312322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e059124-521c-46a5-a544-d0d5b0af5473 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:09.315189 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e059124-521c-46a5-a544-d0d5b0af5473 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:09.337337 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1064/2104] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:09.338291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e059124-521c-46a5-a544-d0d5b0af5473 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:09.353774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e059124-521c-46a5-a544-d0d5b0af5473 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:09.370636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aeeaf-f5bc-4fe4-a120-3ee93d40a554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:09.371286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aeeaf-f5bc-4fe4-a120-3ee93d40a554 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:09.371571 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aeeaf-f5bc-4fe4-a120-3ee93d40a554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:09.371880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aeeaf-f5bc-4fe4-a120-3ee93d40a554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:09.372602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561aeeaf-f5bc-4fe4-a120-3ee93d40a554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:09.374290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561aeeaf-f5bc-4fe4-a120-3ee93d40a554 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:09.389790 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1065/2105] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:09.389790 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aeeaf-f5bc-4fe4-a120-3ee93d40a554 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:09.393986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1041/2106] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:09 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:09.395917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f78f7c-85b7-4aad-8fee-4240ba46890a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:09.398753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-49f78f7c-85b7-4aad-8fee-4240ba46890a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:09.402079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aeeaf-f5bc-4fe4-a120-3ee93d40a554 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:09.444623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:09.483532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f78f7c-85b7-4aad-8fee-4240ba46890a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:09.489503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d2074-8026-4b3a-ba45-888e4527c71c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:09.489700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d2074-8026-4b3a-ba45-888e4527c71c service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:09.489833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d2074-8026-4b3a-ba45-888e4527c71c service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:09.490176 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d2074-8026-4b3a-ba45-888e4527c71c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:09.507290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f8ff-f866-440d-baf2-fae954f9b215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:09.508712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f8ff-f866-440d-baf2-fae954f9b215 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:09.509358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f8ff-f866-440d-baf2-fae954f9b215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:09.510258 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f8ff-f866-440d-baf2-fae954f9b215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:09.510506 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d2074-8026-4b3a-ba45-888e4527c71c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:09.512014 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d2074-8026-4b3a-ba45-888e4527c71c service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:09.512657 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67f8ff-f866-440d-baf2-fae954f9b215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:09.515749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67f8ff-f866-440d-baf2-fae954f9b215 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:09.536880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1066/2107] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:09.537380 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f8ff-f866-440d-baf2-fae954f9b215 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:09.540434 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1042/2108] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:09.542096 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d2074-8026-4b3a-ba45-888e4527c71c service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:09.563184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f8ff-f866-440d-baf2-fae954f9b215 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:09.573341 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f7b12-ebd6-409f-932e-2995a26f8360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:09.574656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f7b12-ebd6-409f-932e-2995a26f8360 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:09.575105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f7b12-ebd6-409f-932e-2995a26f8360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:09.575218 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d2074-8026-4b3a-ba45-888e4527c71c service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:09.575564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f7b12-ebd6-409f-932e-2995a26f8360 admin admin] PATH_INFO: `/v3/projects/0affb9ddc4ba46479993542885bfe6e8/users/090eeca8e41c4f24b6337c773e87e00e/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:09.585665 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974667e-a214-4afd-9a15-bf385170255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:09.586068 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974667e-a214-4afd-9a15-bf385170255a admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:09.587494 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974667e-a214-4afd-9a15-bf385170255a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:09.588052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974667e-a214-4afd-9a15-bf385170255a admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:09.589266 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974667e-a214-4afd-9a15-bf385170255a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:09.592899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974667e-a214-4afd-9a15-bf385170255a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:09.606934 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f7b12-ebd6-409f-932e-2995a26f8360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0affb9ddc4ba46479993542885bfe6e8, user_id=090eeca8e41c4f24b6337c773e87e00e, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:09.615928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f7b12-ebd6-409f-932e-2995a26f8360 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:09.780165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1067/2109] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:09 2022] PUT /identity/v3/projects/0affb9ddc4ba46479993542885bfe6e8/users/090eeca8e41c4f24b6337c773e87e00e/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:09.781274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f7b12-ebd6-409f-932e-2995a26f8360 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:09.827710 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1043/2110] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:09 2022] POST /identity/v3/users => generated 295 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:09.829612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470dca9-6e9f-4c7d-a1c4-fec94eecd866 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:09.830019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470dca9-6e9f-4c7d-a1c4-fec94eecd866 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:09.830435 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470dca9-6e9f-4c7d-a1c4-fec94eecd866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:09.870269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f7b12-ebd6-409f-932e-2995a26f8360 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:09.872701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2470dca9-6e9f-4c7d-a1c4-fec94eecd866 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:09.874847 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2470dca9-6e9f-4c7d-a1c4-fec94eecd866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:09.876785 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0cc40-d88e-42f0-b44f-ca92b7fd1491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:09.877857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0cc40-d88e-42f0-b44f-ca92b7fd1491 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:09.878154 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0cc40-d88e-42f0-b44f-ca92b7fd1491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:09.878748 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0cc40-d88e-42f0-b44f-ca92b7fd1491 admin admin] PATH_INFO: `/v3/projects/22cf87d3e41243bd8deefccfb1af4463/users/1670263e2a284602b3c67a91627d6e28/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:09.900268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1044/2111] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:09.901703 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470dca9-6e9f-4c7d-a1c4-fec94eecd866 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:09.920472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470dca9-6e9f-4c7d-a1c4-fec94eecd866 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:09.929026 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd9ce3-ec23-479f-932a-e85c89049c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:09.929748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd9ce3-ec23-479f-932a-e85c89049c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:09.930173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd9ce3-ec23-479f-932a-e85c89049c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:09.930618 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd9ce3-ec23-479f-932a-e85c89049c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:09.931613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd9ce3-ec23-479f-932a-e85c89049c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:09.934142 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd9ce3-ec23-479f-932a-e85c89049c03 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:09.942886 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0cc40-d88e-42f0-b44f-ca92b7fd1491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22cf87d3e41243bd8deefccfb1af4463, user_id=1670263e2a284602b3c67a91627d6e28, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:09.951801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0cc40-d88e-42f0-b44f-ca92b7fd1491 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:09.956162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1045/2112] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:09.957439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd9ce3-ec23-479f-932a-e85c89049c03 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:09.974659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd9ce3-ec23-479f-932a-e85c89049c03 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:09.984307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52123c76-ee53-48ea-8c79-18caed6d4b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:09.985891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52123c76-ee53-48ea-8c79-18caed6d4b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:09.986640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52123c76-ee53-48ea-8c79-18caed6d4b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:09.987412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52123c76-ee53-48ea-8c79-18caed6d4b94 admin admin] PATH_INFO: `/v3/projects/ea37907a82bb4eefba7516514d0891da/users/a9d07d056ce84898ba72f112fb3960b9/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:10.025335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52123c76-ee53-48ea-8c79-18caed6d4b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea37907a82bb4eefba7516514d0891da, user_id=a9d07d056ce84898ba72f112fb3960b9, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:10.028963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52123c76-ee53-48ea-8c79-18caed6d4b94 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:10.076524 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1068/2113] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:09 2022] PUT /identity/v3/projects/22cf87d3e41243bd8deefccfb1af4463/users/1670263e2a284602b3c67a91627d6e28/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:10.078133 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0cc40-d88e-42f0-b44f-ca92b7fd1491 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:10.092244 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-efe0cc40-d88e-42f0-b44f-ca92b7fd1491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:10.195953 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1046/2114] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:09 2022] PUT /identity/v3/projects/ea37907a82bb4eefba7516514d0891da/users/a9d07d056ce84898ba72f112fb3960b9/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:10.202226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfd6aa-97ef-4dbc-ba20-367e38932972 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:10.202868 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfd6aa-97ef-4dbc-ba20-367e38932972 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:10.203468 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfd6aa-97ef-4dbc-ba20-367e38932972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:10.235042 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0cc40-d88e-42f0-b44f-ca92b7fd1491 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:10.242601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-45bfd6aa-97ef-4dbc-ba20-367e38932972 None None] MFA Rules not processed for user `1670263e2a284602b3c67a91627d6e28`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:10.243936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-45bfd6aa-97ef-4dbc-ba20-367e38932972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:10.300888 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:10.310732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020c347-e367-4d1c-88cb-07c850990c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:10.311395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020c347-e367-4d1c-88cb-07c850990c6b service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:10.311680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020c347-e367-4d1c-88cb-07c850990c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:10.311959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020c347-e367-4d1c-88cb-07c850990c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:10.367615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1047/2115] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:10.369032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfd6aa-97ef-4dbc-ba20-367e38932972 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:10.450873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020c347-e367-4d1c-88cb-07c850990c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:10.454760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020c347-e367-4d1c-88cb-07c850990c6b service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:10.479899 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1069/2116] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:10.482936 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020c347-e367-4d1c-88cb-07c850990c6b service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:10.488924 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b020c347-e367-4d1c-88cb-07c850990c6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:10.511805 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020c347-e367-4d1c-88cb-07c850990c6b service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:10.517446 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfd35f-21e0-4e11-abfa-0252325fd3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:10.518210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfd35f-21e0-4e11-abfa-0252325fd3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:10.518602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfd35f-21e0-4e11-abfa-0252325fd3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:10.518959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfd35f-21e0-4e11-abfa-0252325fd3fc admin admin] PATH_INFO: `/v3/projects/7f803f4c903341e2a8c641d9bac1499e` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:10.521227 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfd35f-21e0-4e11-abfa-0252325fd3fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f803f4c903341e2a8c641d9bac1499e)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:10.522023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfd6aa-97ef-4dbc-ba20-367e38932972 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:10.523667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfd35f-21e0-4e11-abfa-0252325fd3fc admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:10.550188 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab54fc-b1d0-4769-a020-ce12d0a10fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:10.550879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab54fc-b1d0-4769-a020-ce12d0a10fbc admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:10.551163 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab54fc-b1d0-4769-a020-ce12d0a10fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:10.551476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab54fc-b1d0-4769-a020-ce12d0a10fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:10.552209 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab54fc-b1d0-4769-a020-ce12d0a10fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:10.553960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab54fc-b1d0-4769-a020-ce12d0a10fbc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:10.564316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:10.571417 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1048/2117] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:10.571417 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab54fc-b1d0-4769-a020-ce12d0a10fbc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:10.580080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab54fc-b1d0-4769-a020-ce12d0a10fbc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:10.586978 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591be1ea-4ae6-4251-b29d-9915e6be5bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:10.587574 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591be1ea-4ae6-4251-b29d-9915e6be5bee admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:10.587864 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591be1ea-4ae6-4251-b29d-9915e6be5bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:10.588306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591be1ea-4ae6-4251-b29d-9915e6be5bee admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:10.589958 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591be1ea-4ae6-4251-b29d-9915e6be5bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:10.591221 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591be1ea-4ae6-4251-b29d-9915e6be5bee admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:10.745135 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-12dfd35f-21e0-4e11-abfa-0252325fd3fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f803f4c903341e2a8c641d9bac1499e', 'request_id': 'req-12dfd35f-21e0-4e11-abfa-0252325fd3fc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:10.800289 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1049/2118] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:10 2022] POST /identity/v3/projects => generated 389 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:10.802782 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591be1ea-4ae6-4251-b29d-9915e6be5bee admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:10.912730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-12dfd35f-21e0-4e11-abfa-0252325fd3fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f803f4c903341e2a8c641d9bac1499e', 'request_id': 'req-12dfd35f-21e0-4e11-abfa-0252325fd3fc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:10.931767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-12dfd35f-21e0-4e11-abfa-0252325fd3fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f803f4c903341e2a8c641d9bac1499e', 'request_id': 'req-12dfd35f-21e0-4e11-abfa-0252325fd3fc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:10.951123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-12dfd35f-21e0-4e11-abfa-0252325fd3fc admin admin] The token cache is being invalidate because project 7f803f4c903341e2a8c641d9bac1499e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:10.951604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-12dfd35f-21e0-4e11-abfa-0252325fd3fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:10.952896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-12dfd35f-21e0-4e11-abfa-0252325fd3fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:10.962123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1070/2119] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:10 2022] DELETE /identity/v3/projects/7f803f4c903341e2a8c641d9bac1499e => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:10.962413 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591be1ea-4ae6-4251-b29d-9915e6be5bee admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:10.963069 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfd35f-21e0-4e11-abfa-0252325fd3fc admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:10.963512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-12dfd35f-21e0-4e11-abfa-0252325fd3fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:10.966914 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85908dc-5ebd-4fc0-a3a4-40af508830bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:10.967831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85908dc-5ebd-4fc0-a3a4-40af508830bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:10.968308 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85908dc-5ebd-4fc0-a3a4-40af508830bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:10.968762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85908dc-5ebd-4fc0-a3a4-40af508830bb admin admin] PATH_INFO: `/v3/projects/ea37907a82bb4eefba7516514d0891da/users/a9d07d056ce84898ba72f112fb3960b9/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:10.972044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85908dc-5ebd-4fc0-a3a4-40af508830bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea37907a82bb4eefba7516514d0891da, user_id=a9d07d056ce84898ba72f112fb3960b9, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:10.977287 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85908dc-5ebd-4fc0-a3a4-40af508830bb admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:10.995193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1050/2120] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:10 2022] PUT /identity/v3/projects/ea37907a82bb4eefba7516514d0891da/users/a9d07d056ce84898ba72f112fb3960b9/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:10.996743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85908dc-5ebd-4fc0-a3a4-40af508830bb admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:10.998784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d85908dc-5ebd-4fc0-a3a4-40af508830bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:11.099499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85908dc-5ebd-4fc0-a3a4-40af508830bb admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:11.106203 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f29b9-4741-45b9-bce0-c305c3db31e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:11.107009 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f29b9-4741-45b9-bce0-c305c3db31e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:11.107373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f29b9-4741-45b9-bce0-c305c3db31e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:11.107728 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f29b9-4741-45b9-bce0-c305c3db31e0 admin admin] PATH_INFO: `/v3/users/ceb8b82533d5438a84d710fb3a945d80` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:11.109081 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f29b9-4741-45b9-bce0-c305c3db31e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb8b82533d5438a84d710fb3a945d80)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:11.111770 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f29b9-4741-45b9-bce0-c305c3db31e0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:11.123370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfd35f-21e0-4e11-abfa-0252325fd3fc admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:11.134240 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c6629-b59a-4890-9f1f-01812a2f1fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:11.138481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c6629-b59a-4890-9f1f-01812a2f1fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:11.138481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c6629-b59a-4890-9f1f-01812a2f1fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:11.138481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c6629-b59a-4890-9f1f-01812a2f1fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:11.138481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c6629-b59a-4890-9f1f-01812a2f1fa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:11.139385 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c6629-b59a-4890-9f1f-01812a2f1fa1 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:11.252628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1071/2121] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:10 2022] POST /identity/v3/users => generated 301 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:11.252628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f272826-4723-4b5e-930e-7bb5c6b3e5d5 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:11.252628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f272826-4723-4b5e-930e-7bb5c6b3e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:11.252983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f272826-4723-4b5e-930e-7bb5c6b3e5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:11.290849 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-8f272826-4723-4b5e-930e-7bb5c6b3e5d5 None None] MFA Rules not processed for user `a9d07d056ce84898ba72f112fb3960b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:11.292120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8f272826-4723-4b5e-930e-7bb5c6b3e5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:11.318044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:11.402974 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:11.418283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1072/2122] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:11.419410 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f272826-4723-4b5e-930e-7bb5c6b3e5d5 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:11.439296 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f272826-4723-4b5e-930e-7bb5c6b3e5d5 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:11.447704 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c94c1-5381-4507-a9fd-4dc46a986fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:11.448409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c94c1-5381-4507-a9fd-4dc46a986fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:11.448700 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c94c1-5381-4507-a9fd-4dc46a986fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:11.448982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c94c1-5381-4507-a9fd-4dc46a986fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:11.450403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c94c1-5381-4507-a9fd-4dc46a986fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:11.451467 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c94c1-5381-4507-a9fd-4dc46a986fa9 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:11.466892 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3a6f29b9-4741-45b9-bce0-c305c3db31e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb8b82533d5438a84d710fb3a945d80'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:11.468328 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3a6f29b9-4741-45b9-bce0-c305c3db31e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb8b82533d5438a84d710fb3a945d80'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:11.473375 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1073/2123] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:11.473375 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c94c1-5381-4507-a9fd-4dc46a986fa9 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:11.477113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ed6c94c1-5381-4507-a9fd-4dc46a986fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:11.488941 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3a6f29b9-4741-45b9-bce0-c305c3db31e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb8b82533d5438a84d710fb3a945d80'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:11.489994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3a6f29b9-4741-45b9-bce0-c305c3db31e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb8b82533d5438a84d710fb3a945d80'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:11.503681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c94c1-5381-4507-a9fd-4dc46a986fa9 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:11.515515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643aa08d-07aa-4e31-b157-937a117ed4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:11.516541 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aa08d-07aa-4e31-b157-937a117ed4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:11.517674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aa08d-07aa-4e31-b157-937a117ed4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:11.518173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aa08d-07aa-4e31-b157-937a117ed4e6 admin admin] PATH_INFO: `/v3/users/846c28fdeb1e4fb68a78bd0b3cb9f344` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:11.520865 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643aa08d-07aa-4e31-b157-937a117ed4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=846c28fdeb1e4fb68a78bd0b3cb9f344)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:11.522822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643aa08d-07aa-4e31-b157-937a117ed4e6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:11.635960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3a6f29b9-4741-45b9-bce0-c305c3db31e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb8b82533d5438a84d710fb3a945d80'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:11.655630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1051/2124] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:10 2022] DELETE /identity/v3/users/ceb8b82533d5438a84d710fb3a945d80 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:11.656840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f29b9-4741-45b9-bce0-c305c3db31e0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:11.658555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3a6f29b9-4741-45b9-bce0-c305c3db31e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:11.763042 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f29b9-4741-45b9-bce0-c305c3db31e0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:11.766396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25f604-cf2f-4844-9d5a-c60bc4456d09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:11.767600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25f604-cf2f-4844-9d5a-c60bc4456d09 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:11.768213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25f604-cf2f-4844-9d5a-c60bc4456d09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:11.768903 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25f604-cf2f-4844-9d5a-c60bc4456d09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:11.773396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bf25f604-cf2f-4844-9d5a-c60bc4456d09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:11.816532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:11.858658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-643aa08d-07aa-4e31-b157-937a117ed4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846c28fdeb1e4fb68a78bd0b3cb9f344'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:11.861386 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-643aa08d-07aa-4e31-b157-937a117ed4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846c28fdeb1e4fb68a78bd0b3cb9f344'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:11.890259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-643aa08d-07aa-4e31-b157-937a117ed4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846c28fdeb1e4fb68a78bd0b3cb9f344'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:11.913061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25f604-cf2f-4844-9d5a-c60bc4456d09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:11.914784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25f604-cf2f-4844-9d5a-c60bc4456d09 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:11.928789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1052/2125] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:11.930078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25f604-cf2f-4844-9d5a-c60bc4456d09 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:11.934863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bf25f604-cf2f-4844-9d5a-c60bc4456d09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:12.008437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-643aa08d-07aa-4e31-b157-937a117ed4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846c28fdeb1e4fb68a78bd0b3cb9f344'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:12.009868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-643aa08d-07aa-4e31-b157-937a117ed4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846c28fdeb1e4fb68a78bd0b3cb9f344'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:12.035002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1074/2126] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:11 2022] DELETE /identity/v3/users/846c28fdeb1e4fb68a78bd0b3cb9f344 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:12.039520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df719733-763a-4fe0-81bf-343ea76c108d None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:12.040409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df719733-763a-4fe0-81bf-343ea76c108d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:12.040409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df719733-763a-4fe0-81bf-343ea76c108d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:12.053012 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25f604-cf2f-4844-9d5a-c60bc4456d09 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:12.065737 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-df719733-763a-4fe0-81bf-343ea76c108d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:12.068226 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-df719733-763a-4fe0-81bf-343ea76c108d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:12.181253 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34a690-cfe4-4001-a5a5-226b3e3b23a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:12.185218 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34a690-cfe4-4001-a5a5-226b3e3b23a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:12.186909 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34a690-cfe4-4001-a5a5-226b3e3b23a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:12.187860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34a690-cfe4-4001-a5a5-226b3e3b23a1 admin admin] PATH_INFO: `/v3/projects/b0b2d0a8d8984d218d5a56e71d73b2d0/users/05fdd7625be54432aadca7ae1982f27c/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:12.206625 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1075/2127] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:22:12.207398 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df719733-763a-4fe0-81bf-343ea76c108d None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:12.209307 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-df719733-763a-4fe0-81bf-343ea76c108d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:12.232234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34a690-cfe4-4001-a5a5-226b3e3b23a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b2d0a8d8984d218d5a56e71d73b2d0, user_id=05fdd7625be54432aadca7ae1982f27c, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:12.238696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34a690-cfe4-4001-a5a5-226b3e3b23a1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:12.300003 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df719733-763a-4fe0-81bf-343ea76c108d None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:12.307272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0a40a-d568-41c2-8567-1fbefcdf2adc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:12.308231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0a40a-d568-41c2-8567-1fbefcdf2adc service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:12.308668 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0a40a-d568-41c2-8567-1fbefcdf2adc service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:12.309002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0a40a-d568-41c2-8567-1fbefcdf2adc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:12.311325 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-28f0a40a-d568-41c2-8567-1fbefcdf2adc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:12.390750 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0a40a-d568-41c2-8567-1fbefcdf2adc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:12.392393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0a40a-d568-41c2-8567-1fbefcdf2adc service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:12.404892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1076/2128] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:12.405782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0a40a-d568-41c2-8567-1fbefcdf2adc service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:12.407585 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-28f0a40a-d568-41c2-8567-1fbefcdf2adc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:12.511576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0a40a-d568-41c2-8567-1fbefcdf2adc service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:12.518739 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49136089-5dbf-4ca5-99e6-fd9605ef9ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:12.519901 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49136089-5dbf-4ca5-99e6-fd9605ef9ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:12.521121 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49136089-5dbf-4ca5-99e6-fd9605ef9ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:12.521472 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49136089-5dbf-4ca5-99e6-fd9605ef9ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:12.539100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49136089-5dbf-4ca5-99e6-fd9605ef9ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:12.542215 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49136089-5dbf-4ca5-99e6-fd9605ef9ff7 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:12.565113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1077/2129] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:12.578575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1053/2130] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:11 2022] PUT /identity/v3/projects/b0b2d0a8d8984d218d5a56e71d73b2d0/users/05fdd7625be54432aadca7ae1982f27c/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:12.585317 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49136089-5dbf-4ca5-99e6-fd9605ef9ff7 service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:12.588747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-49136089-5dbf-4ca5-99e6-fd9605ef9ff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:12.617296 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49136089-5dbf-4ca5-99e6-fd9605ef9ff7 service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:12.752771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dce0c1-1417-41d5-9585-96278da0e7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:12.753978 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dce0c1-1417-41d5-9585-96278da0e7bb admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:12.755337 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dce0c1-1417-41d5-9585-96278da0e7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:12.756413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dce0c1-1417-41d5-9585-96278da0e7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:12.757229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dce0c1-1417-41d5-9585-96278da0e7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:12.760562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dce0c1-1417-41d5-9585-96278da0e7bb admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:12.797914 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1078/2131] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:12.799419 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34a690-cfe4-4001-a5a5-226b3e3b23a1 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:12.843441 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34a690-cfe4-4001-a5a5-226b3e3b23a1 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:12.858472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e26c4f-e08e-44fc-b188-b871b820382d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:12.862072 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e26c4f-e08e-44fc-b188-b871b820382d admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:12.864135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e26c4f-e08e-44fc-b188-b871b820382d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:12.865485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e26c4f-e08e-44fc-b188-b871b820382d admin admin] PATH_INFO: `/v3/projects/b0b2d0a8d8984d218d5a56e71d73b2d0/users/05fdd7625be54432aadca7ae1982f27c/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:12.871329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e26c4f-e08e-44fc-b188-b871b820382d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b2d0a8d8984d218d5a56e71d73b2d0, user_id=05fdd7625be54432aadca7ae1982f27c, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:12.880746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e26c4f-e08e-44fc-b188-b871b820382d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:12.918556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1054/2132] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:12 2022] PUT /identity/v3/projects/b0b2d0a8d8984d218d5a56e71d73b2d0/users/05fdd7625be54432aadca7ae1982f27c/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:12.944415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e3bde-388d-436b-a278-5c14ba4a229f None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:12.945282 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e3bde-388d-436b-a278-5c14ba4a229f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:12.945835 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e3bde-388d-436b-a278-5c14ba4a229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:13.011231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:13.014584 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-340e3bde-388d-436b-a278-5c14ba4a229f None None] MFA Rules not processed for user `05fdd7625be54432aadca7ae1982f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:13.016858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-340e3bde-388d-436b-a278-5c14ba4a229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:13.150313 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e26c4f-e08e-44fc-b188-b871b820382d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:13.154604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f8e26c4f-e08e-44fc-b188-b871b820382d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:13.161654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1079/2133] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:13.182912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e3bde-388d-436b-a278-5c14ba4a229f None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:13.185424 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-340e3bde-388d-436b-a278-5c14ba4a229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:13.356773 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e3bde-388d-436b-a278-5c14ba4a229f None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:13.365967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63212b3-655f-4355-9f10-22d20c90206a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:13.367076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63212b3-655f-4355-9f10-22d20c90206a service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:13.367550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63212b3-655f-4355-9f10-22d20c90206a service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:13.368018 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63212b3-655f-4355-9f10-22d20c90206a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:13.393977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e26c4f-e08e-44fc-b188-b871b820382d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:13.404483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a0031-e7c8-4973-bfdf-4991163bfd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:13.407829 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a0031-e7c8-4973-bfdf-4991163bfd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:13.409177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a0031-e7c8-4973-bfdf-4991163bfd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:13.411517 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a0031-e7c8-4973-bfdf-4991163bfd85 admin admin] PATH_INFO: `/v3/projects/2309ccad0e764a4d8f8745d9ea09eaf4` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:13.413999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63212b3-655f-4355-9f10-22d20c90206a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:13.414302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a0031-e7c8-4973-bfdf-4991163bfd85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2309ccad0e764a4d8f8745d9ea09eaf4)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:13.416897 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63212b3-655f-4355-9f10-22d20c90206a service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:13.421484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a0031-e7c8-4973-bfdf-4991163bfd85 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:13.470587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1080/2134] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:22:13.741890 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63212b3-655f-4355-9f10-22d20c90206a service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:13.750500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-996a0031-e7c8-4973-bfdf-4991163bfd85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2309ccad0e764a4d8f8745d9ea09eaf4', 'request_id': 'req-996a0031-e7c8-4973-bfdf-4991163bfd85'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:13.769682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-996a0031-e7c8-4973-bfdf-4991163bfd85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2309ccad0e764a4d8f8745d9ea09eaf4', 'request_id': 'req-996a0031-e7c8-4973-bfdf-4991163bfd85'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:13.783350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-996a0031-e7c8-4973-bfdf-4991163bfd85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2309ccad0e764a4d8f8745d9ea09eaf4', 'request_id': 'req-996a0031-e7c8-4973-bfdf-4991163bfd85'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:13.787224 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63212b3-655f-4355-9f10-22d20c90206a service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:13.933818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-996a0031-e7c8-4973-bfdf-4991163bfd85 admin admin] The token cache is being invalidate because project 2309ccad0e764a4d8f8745d9ea09eaf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:13.934120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-996a0031-e7c8-4973-bfdf-4991163bfd85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:13.936555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-996a0031-e7c8-4973-bfdf-4991163bfd85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:13.942977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1055/2135] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:13 2022] DELETE /identity/v3/projects/2309ccad0e764a4d8f8745d9ea09eaf4 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:22:13.942977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a0031-e7c8-4973-bfdf-4991163bfd85 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:13.945803 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f12895-b581-4c40-949d-3ac74bb3c9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:13.947141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f12895-b581-4c40-949d-3ac74bb3c9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:13.947546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f12895-b581-4c40-949d-3ac74bb3c9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:13.949078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f12895-b581-4c40-949d-3ac74bb3c9c7 admin admin] PATH_INFO: `/v3/users/1670263e2a284602b3c67a91627d6e28` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:13.951155 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-996a0031-e7c8-4973-bfdf-4991163bfd85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:13.960997 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f12895-b581-4c40-949d-3ac74bb3c9c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1670263e2a284602b3c67a91627d6e28)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:13.963677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f12895-b581-4c40-949d-3ac74bb3c9c7 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:14.001168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a0031-e7c8-4973-bfdf-4991163bfd85 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:14.016999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084482f-2271-45bf-8525-a14ce3c953ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:14.017991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084482f-2271-45bf-8525-a14ce3c953ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:14.018519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084482f-2271-45bf-8525-a14ce3c953ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:14.019051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084482f-2271-45bf-8525-a14ce3c953ec admin admin] PATH_INFO: `/v3/projects/5777cd64b48f422797e2fc5da643b02c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:14.023495 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084482f-2271-45bf-8525-a14ce3c953ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5777cd64b48f422797e2fc5da643b02c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:14.029778 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084482f-2271-45bf-8525-a14ce3c953ec admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:14.118322 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:14.320438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f5f12895-b581-4c40-949d-3ac74bb3c9c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1670263e2a284602b3c67a91627d6e28'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:14.334947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f5f12895-b581-4c40-949d-3ac74bb3c9c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1670263e2a284602b3c67a91627d6e28'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:14.335044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5084482f-2271-45bf-8525-a14ce3c953ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5777cd64b48f422797e2fc5da643b02c', 'request_id': 'req-5084482f-2271-45bf-8525-a14ce3c953ec'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:14.349506 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f5f12895-b581-4c40-949d-3ac74bb3c9c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1670263e2a284602b3c67a91627d6e28'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:14.360164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5084482f-2271-45bf-8525-a14ce3c953ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5777cd64b48f422797e2fc5da643b02c', 'request_id': 'req-5084482f-2271-45bf-8525-a14ce3c953ec'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:14.369575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5084482f-2271-45bf-8525-a14ce3c953ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5777cd64b48f422797e2fc5da643b02c', 'request_id': 'req-5084482f-2271-45bf-8525-a14ce3c953ec'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:14.460958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f5f12895-b581-4c40-949d-3ac74bb3c9c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1670263e2a284602b3c67a91627d6e28'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:14.463423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f5f12895-b581-4c40-949d-3ac74bb3c9c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1670263e2a284602b3c67a91627d6e28'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:14.511376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1081/2136] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:13 2022] DELETE /identity/v3/users/1670263e2a284602b3c67a91627d6e28 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:22:14.514255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7bade-ee1c-419c-8a5f-d25a0cb1f5a3 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:14.515235 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7bade-ee1c-419c-8a5f-d25a0cb1f5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:14.516802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7bade-ee1c-419c-8a5f-d25a0cb1f5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:14.553816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-17a7bade-ee1c-419c-8a5f-d25a0cb1f5a3 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:14.555918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-17a7bade-ee1c-419c-8a5f-d25a0cb1f5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:14.630155 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5084482f-2271-45bf-8525-a14ce3c953ec admin admin] The token cache is being invalidate because project 5777cd64b48f422797e2fc5da643b02c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:14.630155 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5084482f-2271-45bf-8525-a14ce3c953ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:14.630155 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5084482f-2271-45bf-8525-a14ce3c953ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:14.630155 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1056/2137] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:13 2022] DELETE /identity/v3/projects/5777cd64b48f422797e2fc5da643b02c => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:14.630155 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988ed15-a685-4bc2-852a-31577d8c1dc3 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:14.630893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988ed15-a685-4bc2-852a-31577d8c1dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:14.630893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988ed15-a685-4bc2-852a-31577d8c1dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:14.633740 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:14.694198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a988ed15-a685-4bc2-852a-31577d8c1dc3 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:14.703239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1082/2138] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:14.704477 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7bade-ee1c-419c-8a5f-d25a0cb1f5a3 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:14.706010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-17a7bade-ee1c-419c-8a5f-d25a0cb1f5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:14.716413 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a988ed15-a685-4bc2-852a-31577d8c1dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:14.721711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7bade-ee1c-419c-8a5f-d25a0cb1f5a3 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:14.729646 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ea863-3a9c-4a8d-8146-03037b83288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:14.730413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ea863-3a9c-4a8d-8146-03037b83288d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:14.730734 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ea863-3a9c-4a8d-8146-03037b83288d admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:14.731084 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ea863-3a9c-4a8d-8146-03037b83288d admin admin] PATH_INFO: `/v3/users/6faaeee7f178401c8411acefce21928a` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:14.732442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ea863-3a9c-4a8d-8146-03037b83288d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6faaeee7f178401c8411acefce21928a)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:14.734702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ea863-3a9c-4a8d-8146-03037b83288d admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:14.738807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1057/2139] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:14.741792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529db8e-d14e-4c3b-a8a7-ffddb3cf6ad1 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:14.742549 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529db8e-d14e-4c3b-a8a7-ffddb3cf6ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:14.742852 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529db8e-d14e-4c3b-a8a7-ffddb3cf6ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:14.779689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e529db8e-d14e-4c3b-a8a7-ffddb3cf6ad1 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:14.783225 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e529db8e-d14e-4c3b-a8a7-ffddb3cf6ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:14.795074 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1058/2140] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:14.796541 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529db8e-d14e-4c3b-a8a7-ffddb3cf6ad1 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:14.798236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e529db8e-d14e-4c3b-a8a7-ffddb3cf6ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:14.891062 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529db8e-d14e-4c3b-a8a7-ffddb3cf6ad1 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:14.903904 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef8b03-ddf7-487e-b566-45295499f810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:14.905742 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef8b03-ddf7-487e-b566-45295499f810 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:14.907052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef8b03-ddf7-487e-b566-45295499f810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:14.908046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef8b03-ddf7-487e-b566-45295499f810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:14.933907 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef8b03-ddf7-487e-b566-45295499f810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:14.946889 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef8b03-ddf7-487e-b566-45295499f810 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:14.952427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1059/2141] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:14.953362 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef8b03-ddf7-487e-b566-45295499f810 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:14.967710 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef8b03-ddf7-487e-b566-45295499f810 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:14.979279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f9299-faac-412a-9dec-db9119a35d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:14.979279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f9299-faac-412a-9dec-db9119a35d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:14.979279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f9299-faac-412a-9dec-db9119a35d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:14.979279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f9299-faac-412a-9dec-db9119a35d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:14.980297 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f9299-faac-412a-9dec-db9119a35d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:22:14.980908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f9299-faac-412a-9dec-db9119a35d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:14.982896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f9299-faac-412a-9dec-db9119a35d8f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:15.000763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1060/2142] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:22:15.009253 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f9299-faac-412a-9dec-db9119a35d8f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:15.030166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f9299-faac-412a-9dec-db9119a35d8f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:15.039636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4db35-005b-447c-9e75-2784acda2fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:15.043551 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4db35-005b-447c-9e75-2784acda2fba admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:15.043919 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4db35-005b-447c-9e75-2784acda2fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:15.044208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4db35-005b-447c-9e75-2784acda2fba admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:15.047212 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4db35-005b-447c-9e75-2784acda2fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:15.049926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4db35-005b-447c-9e75-2784acda2fba admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:15.091651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1b5ea863-3a9c-4a8d-8146-03037b83288d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6faaeee7f178401c8411acefce21928a'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:15.093138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1b5ea863-3a9c-4a8d-8146-03037b83288d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6faaeee7f178401c8411acefce21928a'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:15.115959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1b5ea863-3a9c-4a8d-8146-03037b83288d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6faaeee7f178401c8411acefce21928a'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:15.221822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1b5ea863-3a9c-4a8d-8146-03037b83288d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6faaeee7f178401c8411acefce21928a'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:15.224954 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1b5ea863-3a9c-4a8d-8146-03037b83288d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6faaeee7f178401c8411acefce21928a'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:15.249466 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1061/2143] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:15 2022] POST /identity/v3/projects => generated 393 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:22:15.255721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4db35-005b-447c-9e75-2784acda2fba admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:15.259461 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-39c4db35-005b-447c-9e75-2784acda2fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:15.309049 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1083/2144] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:14 2022] DELETE /identity/v3/users/6faaeee7f178401c8411acefce21928a => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:15.408897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4db35-005b-447c-9e75-2784acda2fba admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:15.648617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db858-207f-412b-905f-a6177f125a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:15.652547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db858-207f-412b-905f-a6177f125a36 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:15.653095 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db858-207f-412b-905f-a6177f125a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:15.653614 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db858-207f-412b-905f-a6177f125a36 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:15.656256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db858-207f-412b-905f-a6177f125a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:15.663130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db858-207f-412b-905f-a6177f125a36 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:15.822032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1062/2145] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:15 2022] POST /identity/v3/users => generated 297 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:15.827579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ea863-3a9c-4a8d-8146-03037b83288d admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:15.848168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db858-207f-412b-905f-a6177f125a36 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:15.850239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bf9db858-207f-412b-905f-a6177f125a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:15.853131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ea863-3a9c-4a8d-8146-03037b83288d admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:15.872671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db858-207f-412b-905f-a6177f125a36 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:15.881839 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23c62b-3c51-49b2-99c7-b53a8b38062f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:15.882059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94b5be-ea3f-438a-a620-4ee0bed5a7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:15.882413 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23c62b-3c51-49b2-99c7-b53a8b38062f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:15.882722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23c62b-3c51-49b2-99c7-b53a8b38062f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:15.883033 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23c62b-3c51-49b2-99c7-b53a8b38062f admin admin] PATH_INFO: `/v3/projects/22cf87d3e41243bd8deefccfb1af4463` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:15.883140 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94b5be-ea3f-438a-a620-4ee0bed5a7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:15.883564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94b5be-ea3f-438a-a620-4ee0bed5a7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:15.884040 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94b5be-ea3f-438a-a620-4ee0bed5a7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:15.884861 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23c62b-3c51-49b2-99c7-b53a8b38062f admin admin] RBAC: Authorizing `identity:delete_project(project_id=22cf87d3e41243bd8deefccfb1af4463)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:15.885336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94b5be-ea3f-438a-a620-4ee0bed5a7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:15.887226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23c62b-3c51-49b2-99c7-b53a8b38062f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:15.888192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94b5be-ea3f-438a-a620-4ee0bed5a7d5 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:15.914297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1084/2146] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:15.918578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94b5be-ea3f-438a-a620-4ee0bed5a7d5 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:15.938310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94b5be-ea3f-438a-a620-4ee0bed5a7d5 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:15.948291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e6487-cb58-4568-8050-023db5b3158e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:15.949644 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e6487-cb58-4568-8050-023db5b3158e admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:15.950189 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e6487-cb58-4568-8050-023db5b3158e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:15.950786 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e6487-cb58-4568-8050-023db5b3158e admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:15.952215 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e6487-cb58-4568-8050-023db5b3158e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:15.959064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e6487-cb58-4568-8050-023db5b3158e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:15.987500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1085/2147] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:22:15.995784 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e6487-cb58-4568-8050-023db5b3158e admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:16.008903 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e6487-cb58-4568-8050-023db5b3158e admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:16.015832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8628a-a9da-4c25-9789-262575514572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:16.016983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8628a-a9da-4c25-9789-262575514572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:16.017312 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8628a-a9da-4c25-9789-262575514572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:16.017606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8628a-a9da-4c25-9789-262575514572 admin admin] PATH_INFO: `/v3/projects/a22b8b32ee384f339802313df332c21b/users/c4198ebe397542f0b7de1afb889662c5/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:16.038529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8628a-a9da-4c25-9789-262575514572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22b8b32ee384f339802313df332c21b, user_id=c4198ebe397542f0b7de1afb889662c5, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:16.041521 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8628a-a9da-4c25-9789-262575514572 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:16.052113 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5e23c62b-3c51-49b2-99c7-b53a8b38062f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22cf87d3e41243bd8deefccfb1af4463', 'request_id': 'req-5e23c62b-3c51-49b2-99c7-b53a8b38062f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:16.058699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5e23c62b-3c51-49b2-99c7-b53a8b38062f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22cf87d3e41243bd8deefccfb1af4463', 'request_id': 'req-5e23c62b-3c51-49b2-99c7-b53a8b38062f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:16.066788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5e23c62b-3c51-49b2-99c7-b53a8b38062f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22cf87d3e41243bd8deefccfb1af4463', 'request_id': 'req-5e23c62b-3c51-49b2-99c7-b53a8b38062f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:16.158858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1086/2148] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:15 2022] PUT /identity/v3/projects/a22b8b32ee384f339802313df332c21b/users/c4198ebe397542f0b7de1afb889662c5/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:16.175326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa13671-91d7-4733-bd59-b78c53bd780a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:16.180029 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa13671-91d7-4733-bd59-b78c53bd780a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:16.180539 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa13671-91d7-4733-bd59-b78c53bd780a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:16.216656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5e23c62b-3c51-49b2-99c7-b53a8b38062f admin admin] The token cache is being invalidate because project 22cf87d3e41243bd8deefccfb1af4463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:16.217156 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5e23c62b-3c51-49b2-99c7-b53a8b38062f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:16.219427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5e23c62b-3c51-49b2-99c7-b53a8b38062f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:16.227804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1063/2149] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:15 2022] DELETE /identity/v3/projects/22cf87d3e41243bd8deefccfb1af4463 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:22:16.237284 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23c62b-3c51-49b2-99c7-b53a8b38062f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:16.241679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5e23c62b-3c51-49b2-99c7-b53a8b38062f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:16.258105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-6aa13671-91d7-4733-bd59-b78c53bd780a None None] MFA Rules not processed for user `c4198ebe397542f0b7de1afb889662c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:16.262144 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6aa13671-91d7-4733-bd59-b78c53bd780a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:16.311787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:16.468323 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23c62b-3c51-49b2-99c7-b53a8b38062f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:16.510585 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1087/2150] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:16.512248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa13671-91d7-4733-bd59-b78c53bd780a None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:16.514720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6aa13671-91d7-4733-bd59-b78c53bd780a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:16.614499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:16.677688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0654-78b1-4043-834c-156e8dc1711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:16.679259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0654-78b1-4043-834c-156e8dc1711e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:16.686021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0654-78b1-4043-834c-156e8dc1711e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:16.697050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0654-78b1-4043-834c-156e8dc1711e admin admin] PATH_INFO: `/v3/users/05fdd7625be54432aadca7ae1982f27c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:16.697050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c0654-78b1-4043-834c-156e8dc1711e admin admin] RBAC: Authorizing `identity:delete_user(user_id=05fdd7625be54432aadca7ae1982f27c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:16.713297 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c0654-78b1-4043-834c-156e8dc1711e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:16.772831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa13671-91d7-4733-bd59-b78c53bd780a None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:16.803193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92315-900f-4b7e-8b2b-bc007c138504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:16.803193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92315-900f-4b7e-8b2b-bc007c138504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:16.803193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92315-900f-4b7e-8b2b-bc007c138504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:16.803193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92315-900f-4b7e-8b2b-bc007c138504 admin admin] PATH_INFO: `/v3/users/6a835792557248a9aa3293ca80ac55fb` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:16.805182 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a92315-900f-4b7e-8b2b-bc007c138504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a835792557248a9aa3293ca80ac55fb)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:16.805182 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a92315-900f-4b7e-8b2b-bc007c138504 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:17.021909 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-578c0654-78b1-4043-834c-156e8dc1711e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05fdd7625be54432aadca7ae1982f27c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:17.021909 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-578c0654-78b1-4043-834c-156e8dc1711e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05fdd7625be54432aadca7ae1982f27c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:17.071066 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-578c0654-78b1-4043-834c-156e8dc1711e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05fdd7625be54432aadca7ae1982f27c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:17.072410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-578c0654-78b1-4043-834c-156e8dc1711e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05fdd7625be54432aadca7ae1982f27c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:17.096857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f8a92315-900f-4b7e-8b2b-bc007c138504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a835792557248a9aa3293ca80ac55fb'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:17.159166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f8a92315-900f-4b7e-8b2b-bc007c138504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a835792557248a9aa3293ca80ac55fb'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:17.159166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f8a92315-900f-4b7e-8b2b-bc007c138504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a835792557248a9aa3293ca80ac55fb'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:17.806176 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-578c0654-78b1-4043-834c-156e8dc1711e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05fdd7625be54432aadca7ae1982f27c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:17.850594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1064/2151] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:16 2022] DELETE /identity/v3/users/05fdd7625be54432aadca7ae1982f27c => generated 0 bytes in 1611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:17.850594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0654-78b1-4043-834c-156e8dc1711e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:17.850594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-578c0654-78b1-4043-834c-156e8dc1711e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:17.915252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f8a92315-900f-4b7e-8b2b-bc007c138504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a835792557248a9aa3293ca80ac55fb'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:17.916263 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f8a92315-900f-4b7e-8b2b-bc007c138504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a835792557248a9aa3293ca80ac55fb'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:17.945400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1088/2152] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:16 2022] DELETE /identity/v3/users/6a835792557248a9aa3293ca80ac55fb => generated 0 bytes in 1434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:17.951393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92315-900f-4b7e-8b2b-bc007c138504 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:17.959463 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f8a92315-900f-4b7e-8b2b-bc007c138504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:18.060120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0654-78b1-4043-834c-156e8dc1711e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:18.084633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92315-900f-4b7e-8b2b-bc007c138504 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:18.084909 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f792c-4f08-4225-9966-bceea1b80d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:18.086864 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f792c-4f08-4225-9966-bceea1b80d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:18.088346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f792c-4f08-4225-9966-bceea1b80d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:18.090920 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f792c-4f08-4225-9966-bceea1b80d2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:18.094662 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f792c-4f08-4225-9966-bceea1b80d2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:18.101717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f921c7a-c3af-430a-a340-673b732a5212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:18.107274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921c7a-c3af-430a-a340-673b732a5212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:18.107274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921c7a-c3af-430a-a340-673b732a5212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:18.107274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921c7a-c3af-430a-a340-673b732a5212 admin admin] PATH_INFO: `/v3/projects/b9569889a1044cf28f8c94ec922d1b65` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:18.107659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f792c-4f08-4225-9966-bceea1b80d2e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:18.110737 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f921c7a-c3af-430a-a340-673b732a5212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9569889a1044cf28f8c94ec922d1b65)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:18.119013 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f921c7a-c3af-430a-a340-673b732a5212 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:18.318015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1065/2153] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:17 2022] POST /identity/v3/projects => generated 393 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:18.324416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e5960-27e8-44d9-b8ba-6eec9cbdb94b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:18.325930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e5960-27e8-44d9-b8ba-6eec9cbdb94b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:18.328031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e5960-27e8-44d9-b8ba-6eec9cbdb94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:18.371356 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-8f921c7a-c3af-430a-a340-673b732a5212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9569889a1044cf28f8c94ec922d1b65', 'request_id': 'req-8f921c7a-c3af-430a-a340-673b732a5212'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:18.383801 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-562e5960-27e8-44d9-b8ba-6eec9cbdb94b None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:18.386314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-562e5960-27e8-44d9-b8ba-6eec9cbdb94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:18.481778 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-8f921c7a-c3af-430a-a340-673b732a5212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9569889a1044cf28f8c94ec922d1b65', 'request_id': 'req-8f921c7a-c3af-430a-a340-673b732a5212'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:18.490611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-8f921c7a-c3af-430a-a340-673b732a5212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9569889a1044cf28f8c94ec922d1b65', 'request_id': 'req-8f921c7a-c3af-430a-a340-673b732a5212'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:18.511049 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-8f921c7a-c3af-430a-a340-673b732a5212 admin admin] The token cache is being invalidate because project b9569889a1044cf28f8c94ec922d1b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:18.511855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-8f921c7a-c3af-430a-a340-673b732a5212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:18.514593 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1066/2154] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:18.516731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e5960-27e8-44d9-b8ba-6eec9cbdb94b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:18.517604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-8f921c7a-c3af-430a-a340-673b732a5212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:18.521521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-562e5960-27e8-44d9-b8ba-6eec9cbdb94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:18.524542 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1089/2155] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:17 2022] DELETE /identity/v3/projects/b9569889a1044cf28f8c94ec922d1b65 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:18.531070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f921c7a-c3af-430a-a340-673b732a5212 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:18.534913 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8f921c7a-c3af-430a-a340-673b732a5212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:18.539942 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e5960-27e8-44d9-b8ba-6eec9cbdb94b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:18.555620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798910a7-8557-46c6-90ff-fd9b26bc782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:18.558687 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798910a7-8557-46c6-90ff-fd9b26bc782d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:18.559108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798910a7-8557-46c6-90ff-fd9b26bc782d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:18.563301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798910a7-8557-46c6-90ff-fd9b26bc782d admin admin] PATH_INFO: `/v3/users/0fe3f34427bd4029bcb54d616c94fac4` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:18.565808 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798910a7-8557-46c6-90ff-fd9b26bc782d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe3f34427bd4029bcb54d616c94fac4)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:18.569488 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798910a7-8557-46c6-90ff-fd9b26bc782d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:18.721287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f921c7a-c3af-430a-a340-673b732a5212 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:18.729272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7386a9-7683-4b4d-a0f4-5373716c2c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:18.730026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7386a9-7683-4b4d-a0f4-5373716c2c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:18.730638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7386a9-7683-4b4d-a0f4-5373716c2c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:18.731609 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7386a9-7683-4b4d-a0f4-5373716c2c2e admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:18.732395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7386a9-7683-4b4d-a0f4-5373716c2c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:18.736749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7386a9-7683-4b4d-a0f4-5373716c2c2e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:18.810978 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-798910a7-8557-46c6-90ff-fd9b26bc782d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe3f34427bd4029bcb54d616c94fac4'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:18.812759 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-798910a7-8557-46c6-90ff-fd9b26bc782d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe3f34427bd4029bcb54d616c94fac4'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:18.827473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1090/2156] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:18 2022] POST /identity/v3/users => generated 303 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:18.829188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7386a9-7683-4b4d-a0f4-5373716c2c2e admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:18.833711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7f7386a9-7683-4b4d-a0f4-5373716c2c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:18.865192 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-798910a7-8557-46c6-90ff-fd9b26bc782d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe3f34427bd4029bcb54d616c94fac4'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:18.867345 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-798910a7-8557-46c6-90ff-fd9b26bc782d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe3f34427bd4029bcb54d616c94fac4'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:18.950227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-798910a7-8557-46c6-90ff-fd9b26bc782d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe3f34427bd4029bcb54d616c94fac4'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:18.972552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7386a9-7683-4b4d-a0f4-5373716c2c2e admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:18.978125 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1067/2157] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:18 2022] DELETE /identity/v3/users/0fe3f34427bd4029bcb54d616c94fac4 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:18.980529 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed08d45-d47b-4605-b56f-d81e50c45741 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:18.980818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed08d45-d47b-4605-b56f-d81e50c45741 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:18.981381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed08d45-d47b-4605-b56f-d81e50c45741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:19.033428 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8ed08d45-d47b-4605-b56f-d81e50c45741 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:19.037376 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8ed08d45-d47b-4605-b56f-d81e50c45741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:19.183801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fff47-9a13-4961-9406-039cb7020693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:19.184467 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fff47-9a13-4961-9406-039cb7020693 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:19.185147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fff47-9a13-4961-9406-039cb7020693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:19.185147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fff47-9a13-4961-9406-039cb7020693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:19.187350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-298fff47-9a13-4961-9406-039cb7020693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:19.218734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1068/2158] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:19.219594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed08d45-d47b-4605-b56f-d81e50c45741 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:19.221108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8ed08d45-d47b-4605-b56f-d81e50c45741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:19.236522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed08d45-d47b-4605-b56f-d81e50c45741 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:19.243723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79adcb-97dc-4618-b9a5-4dcb6f4bcbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:19.244072 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79adcb-97dc-4618-b9a5-4dcb6f4bcbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:19.244395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79adcb-97dc-4618-b9a5-4dcb6f4bcbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:19.244747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79adcb-97dc-4618-b9a5-4dcb6f4bcbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:19.245549 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79adcb-97dc-4618-b9a5-4dcb6f4bcbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:19.247465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79adcb-97dc-4618-b9a5-4dcb6f4bcbb1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:19.269291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1069/2159] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:19.271950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e5309-3d26-4558-8d8f-3c8450d96047 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:19.272246 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e5309-3d26-4558-8d8f-3c8450d96047 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:19.273390 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e5309-3d26-4558-8d8f-3c8450d96047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:19.308719 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-611e5309-3d26-4558-8d8f-3c8450d96047 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:19.311353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-611e5309-3d26-4558-8d8f-3c8450d96047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:19.326202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298fff47-9a13-4961-9406-039cb7020693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:19.332148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1070/2160] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:19.332148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e5309-3d26-4558-8d8f-3c8450d96047 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:19.332148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-611e5309-3d26-4558-8d8f-3c8450d96047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:19.333810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298fff47-9a13-4961-9406-039cb7020693 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:19.349500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1091/2161] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:19.352463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e5309-3d26-4558-8d8f-3c8450d96047 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:19.353048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c40a1-aef2-4d1f-831d-103f3bb4d4f5 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:19.354400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c40a1-aef2-4d1f-831d-103f3bb4d4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:19.355031 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c40a1-aef2-4d1f-831d-103f3bb4d4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:19.358852 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb108fa-2093-410c-8a9c-dc5863d4ad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:19.359738 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb108fa-2093-410c-8a9c-dc5863d4ad58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:19.360369 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb108fa-2093-410c-8a9c-dc5863d4ad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:19.360734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb108fa-2093-410c-8a9c-dc5863d4ad58 admin admin] PATH_INFO: `/v3/projects/b0b2d0a8d8984d218d5a56e71d73b2d0` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:19.362153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb108fa-2093-410c-8a9c-dc5863d4ad58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b2d0a8d8984d218d5a56e71d73b2d0)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:19.365975 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb108fa-2093-410c-8a9c-dc5863d4ad58 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:19.386124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-ff4c40a1-aef2-4d1f-831d-103f3bb4d4f5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:19.388067 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ff4c40a1-aef2-4d1f-831d-103f3bb4d4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:19.406882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1092/2162] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:19.408384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c40a1-aef2-4d1f-831d-103f3bb4d4f5 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:19.445628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c40a1-aef2-4d1f-831d-103f3bb4d4f5 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:19.459604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e01db-4d07-4d28-9178-b11c0cff5ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:19.461977 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e01db-4d07-4d28-9178-b11c0cff5ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:19.463186 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e01db-4d07-4d28-9178-b11c0cff5ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:19.463826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e01db-4d07-4d28-9178-b11c0cff5ae8 admin admin] PATH_INFO: `/v3/projects/4ded9ca1dbff404c8bb26f48b4e26168/users/9f9ca4edef53418ab576065fe2e0f7b7/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:19.512783 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e01db-4d07-4d28-9178-b11c0cff5ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ded9ca1dbff404c8bb26f48b4e26168, user_id=9f9ca4edef53418ab576065fe2e0f7b7, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:19.528505 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e01db-4d07-4d28-9178-b11c0cff5ae8 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:19.577405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1eb108fa-2093-410c-8a9c-dc5863d4ad58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b2d0a8d8984d218d5a56e71d73b2d0', 'request_id': 'req-1eb108fa-2093-410c-8a9c-dc5863d4ad58'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:19.591767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1eb108fa-2093-410c-8a9c-dc5863d4ad58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b2d0a8d8984d218d5a56e71d73b2d0', 'request_id': 'req-1eb108fa-2093-410c-8a9c-dc5863d4ad58'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:19.606208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1eb108fa-2093-410c-8a9c-dc5863d4ad58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b2d0a8d8984d218d5a56e71d73b2d0', 'request_id': 'req-1eb108fa-2093-410c-8a9c-dc5863d4ad58'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:19.617170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1093/2163] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:19 2022] PUT /identity/v3/projects/4ded9ca1dbff404c8bb26f48b4e26168/users/9f9ca4edef53418ab576065fe2e0f7b7/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:19.618411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e01db-4d07-4d28-9178-b11c0cff5ae8 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:19.713190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1eb108fa-2093-410c-8a9c-dc5863d4ad58 admin admin] The token cache is being invalidate because project b0b2d0a8d8984d218d5a56e71d73b2d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:19.713602 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1eb108fa-2093-410c-8a9c-dc5863d4ad58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:19.714326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1eb108fa-2093-410c-8a9c-dc5863d4ad58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:19.719139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1071/2164] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:19 2022] DELETE /identity/v3/projects/b0b2d0a8d8984d218d5a56e71d73b2d0 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:19.719881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e01db-4d07-4d28-9178-b11c0cff5ae8 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:19.720539 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb108fa-2093-410c-8a9c-dc5863d4ad58 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:19.729325 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b6e67-99e3-4599-9c4e-eda4698d629a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:19.730672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b6e67-99e3-4599-9c4e-eda4698d629a service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:19.732051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b6e67-99e3-4599-9c4e-eda4698d629a service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:19.732771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1eb108fa-2093-410c-8a9c-dc5863d4ad58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:19.734095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b6e67-99e3-4599-9c4e-eda4698d629a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:19.736954 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-345b6e67-99e3-4599-9c4e-eda4698d629a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:19.856679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:19.885356 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b6e67-99e3-4599-9c4e-eda4698d629a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:19.886869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b6e67-99e3-4599-9c4e-eda4698d629a service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:19.926990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1094/2165] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:19.940404 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b6e67-99e3-4599-9c4e-eda4698d629a service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:19.951587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-345b6e67-99e3-4599-9c4e-eda4698d629a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:19.983679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb108fa-2093-410c-8a9c-dc5863d4ad58 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:19.991925 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7aca2-3d3e-49a6-bfeb-c5fb98027c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:19.992601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7aca2-3d3e-49a6-bfeb-c5fb98027c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:19.992888 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7aca2-3d3e-49a6-bfeb-c5fb98027c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:19.993169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7aca2-3d3e-49a6-bfeb-c5fb98027c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:19.993953 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7aca2-3d3e-49a6-bfeb-c5fb98027c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:22:19.994272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7aca2-3d3e-49a6-bfeb-c5fb98027c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:19.996159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7aca2-3d3e-49a6-bfeb-c5fb98027c0b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:20.009870 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:20.016624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1072/2166] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:22:20.018432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b26e8-0233-4623-ad18-4ebdae0d9c4b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:20.018736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b26e8-0233-4623-ad18-4ebdae0d9c4b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:20.019013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b26e8-0233-4623-ad18-4ebdae0d9c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:20.021193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b6e67-99e3-4599-9c4e-eda4698d629a service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:20.054027 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-687b26e8-0233-4623-ad18-4ebdae0d9c4b None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:20.054027 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-687b26e8-0233-4623-ad18-4ebdae0d9c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:20.065492 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1073/2167] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:20.066135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b26e8-0233-4623-ad18-4ebdae0d9c4b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:20.088782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d77f52-c3b5-47d1-94d0-5461601799ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:20.089485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d77f52-c3b5-47d1-94d0-5461601799ea admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:20.089774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d77f52-c3b5-47d1-94d0-5461601799ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:20.090051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d77f52-c3b5-47d1-94d0-5461601799ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:20.090898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d77f52-c3b5-47d1-94d0-5461601799ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:20.092574 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d77f52-c3b5-47d1-94d0-5461601799ea admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:20.095102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b26e8-0233-4623-ad18-4ebdae0d9c4b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:20.110827 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736987c7-d2db-4415-b2c5-1f5a40c032f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:20.112688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736987c7-d2db-4415-b2c5-1f5a40c032f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:20.115346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736987c7-d2db-4415-b2c5-1f5a40c032f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:20.115346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736987c7-d2db-4415-b2c5-1f5a40c032f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:20.117594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736987c7-d2db-4415-b2c5-1f5a40c032f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:20.122796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736987c7-d2db-4415-b2c5-1f5a40c032f4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:20.149926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1095/2168] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:20.155918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdbc8e-7063-4522-8b2d-59bc54b84e40 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:20.156205 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdbc8e-7063-4522-8b2d-59bc54b84e40 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:20.156485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdbc8e-7063-4522-8b2d-59bc54b84e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:20.240956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b7cdbc8e-7063-4522-8b2d-59bc54b84e40 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:20.248976 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b7cdbc8e-7063-4522-8b2d-59bc54b84e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:20.293450 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1096/2169] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:20.296106 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdbc8e-7063-4522-8b2d-59bc54b84e40 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:20.340542 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1074/2170] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:20 2022] POST /identity/v3/projects => generated 385 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:20.343088 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdbc8e-7063-4522-8b2d-59bc54b84e40 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:20.349412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736987c7-d2db-4415-b2c5-1f5a40c032f4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:20.445912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea34d28-9b56-461b-a8db-35d226ab3a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:20.446885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea34d28-9b56-461b-a8db-35d226ab3a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:20.447288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea34d28-9b56-461b-a8db-35d226ab3a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:20.447670 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea34d28-9b56-461b-a8db-35d226ab3a54 admin admin] PATH_INFO: `/v3/projects/4ded9ca1dbff404c8bb26f48b4e26168/users/9f9ca4edef53418ab576065fe2e0f7b7/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:20.449991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea34d28-9b56-461b-a8db-35d226ab3a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ded9ca1dbff404c8bb26f48b4e26168, user_id=9f9ca4edef53418ab576065fe2e0f7b7, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:20.453522 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea34d28-9b56-461b-a8db-35d226ab3a54 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:20.454971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736987c7-d2db-4415-b2c5-1f5a40c032f4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:20.471744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1097/2171] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:20 2022] PUT /identity/v3/projects/4ded9ca1dbff404c8bb26f48b4e26168/users/9f9ca4edef53418ab576065fe2e0f7b7/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:20.473824 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea34d28-9b56-461b-a8db-35d226ab3a54 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:20.506638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbb5c4-3068-4167-87ef-cdcec1d79322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:20.507691 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbb5c4-3068-4167-87ef-cdcec1d79322 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:20.507981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbb5c4-3068-4167-87ef-cdcec1d79322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:20.510617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbb5c4-3068-4167-87ef-cdcec1d79322 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:20.514165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbb5c4-3068-4167-87ef-cdcec1d79322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:22:20.514718 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbb5c4-3068-4167-87ef-cdcec1d79322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:20.526902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbb5c4-3068-4167-87ef-cdcec1d79322 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:20.588179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1075/2172] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:22:20.590374 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbb5c4-3068-4167-87ef-cdcec1d79322 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:20.594228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9abbb5c4-3068-4167-87ef-cdcec1d79322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:20.632101 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbb5c4-3068-4167-87ef-cdcec1d79322 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:20.651550 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72334a0-a42f-4949-86e9-7704c8a54e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:20.652600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72334a0-a42f-4949-86e9-7704c8a54e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:20.656857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea34d28-9b56-461b-a8db-35d226ab3a54 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:20.657547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72334a0-a42f-4949-86e9-7704c8a54e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:20.658015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72334a0-a42f-4949-86e9-7704c8a54e6a admin admin] PATH_INFO: `/v3/projects/ec046218cd32479388ff34b8110d8dc5` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:20.662206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72334a0-a42f-4949-86e9-7704c8a54e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec046218cd32479388ff34b8110d8dc5)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:20.664579 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72334a0-a42f-4949-86e9-7704c8a54e6a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:20.678206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88abec-e990-4c74-a800-f39c5c5745c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:20.678871 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88abec-e990-4c74-a800-f39c5c5745c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:20.679260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88abec-e990-4c74-a800-f39c5c5745c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:20.679705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88abec-e990-4c74-a800-f39c5c5745c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:20.683112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88abec-e990-4c74-a800-f39c5c5745c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:20.687793 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88abec-e990-4c74-a800-f39c5c5745c5 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:20.919291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1098/2173] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:20 2022] POST /identity/v3/users => generated 293 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:20.947496 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e727fa6-19ae-43a8-a746-a15001c7f333 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:20.961769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e727fa6-19ae-43a8-a746-a15001c7f333 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:20.962271 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e727fa6-19ae-43a8-a746-a15001c7f333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:20.982426 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c72334a0-a42f-4949-86e9-7704c8a54e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec046218cd32479388ff34b8110d8dc5', 'request_id': 'req-c72334a0-a42f-4949-86e9-7704c8a54e6a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:20.990261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c72334a0-a42f-4949-86e9-7704c8a54e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec046218cd32479388ff34b8110d8dc5', 'request_id': 'req-c72334a0-a42f-4949-86e9-7704c8a54e6a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:21.042948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c72334a0-a42f-4949-86e9-7704c8a54e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec046218cd32479388ff34b8110d8dc5', 'request_id': 'req-c72334a0-a42f-4949-86e9-7704c8a54e6a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:21.073155 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-4e727fa6-19ae-43a8-a746-a15001c7f333 None None] MFA Rules not processed for user `9f9ca4edef53418ab576065fe2e0f7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:21.076645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4e727fa6-19ae-43a8-a746-a15001c7f333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:21.185108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c72334a0-a42f-4949-86e9-7704c8a54e6a admin admin] The token cache is being invalidate because project ec046218cd32479388ff34b8110d8dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:21.185108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c72334a0-a42f-4949-86e9-7704c8a54e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:21.192511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c72334a0-a42f-4949-86e9-7704c8a54e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:21.198819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1076/2174] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:20 2022] DELETE /identity/v3/projects/ec046218cd32479388ff34b8110d8dc5 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:21.203528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72334a0-a42f-4949-86e9-7704c8a54e6a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:21.211158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c72334a0-a42f-4949-86e9-7704c8a54e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:21.289247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1099/2175] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:21.290944 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e727fa6-19ae-43a8-a746-a15001c7f333 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:21.296633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4e727fa6-19ae-43a8-a746-a15001c7f333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:21.430620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72334a0-a42f-4949-86e9-7704c8a54e6a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:21.445305 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d650f-a48f-4714-a3de-8848977d8a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:21.446502 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d650f-a48f-4714-a3de-8848977d8a29 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:21.447789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d650f-a48f-4714-a3de-8848977d8a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:21.447789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d650f-a48f-4714-a3de-8848977d8a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:21.448618 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d650f-a48f-4714-a3de-8848977d8a29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:21.453225 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d650f-a48f-4714-a3de-8848977d8a29 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:21.455909 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e727fa6-19ae-43a8-a746-a15001c7f333 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:21.461129 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:21.481672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954bd7b-c2bd-4b37-b740-a9b561824e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:21.482476 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954bd7b-c2bd-4b37-b740-a9b561824e1c admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:21.482794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954bd7b-c2bd-4b37-b740-a9b561824e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:21.483389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954bd7b-c2bd-4b37-b740-a9b561824e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:21.484292 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0954bd7b-c2bd-4b37-b740-a9b561824e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:21.486718 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0954bd7b-c2bd-4b37-b740-a9b561824e1c admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:21.539167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1100/2176] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:21.539167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954bd7b-c2bd-4b37-b740-a9b561824e1c admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:21.541586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0954bd7b-c2bd-4b37-b740-a9b561824e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:21.576193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954bd7b-c2bd-4b37-b740-a9b561824e1c admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:21.619002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af6361-c748-43d8-b3f4-8f743396bdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:21.622257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af6361-c748-43d8-b3f4-8f743396bdd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:21.623085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af6361-c748-43d8-b3f4-8f743396bdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:21.623971 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af6361-c748-43d8-b3f4-8f743396bdd0 admin admin] PATH_INFO: `/v3/projects/6444075fa882460f822a025bc182937f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:21.628310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af6361-c748-43d8-b3f4-8f743396bdd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6444075fa882460f822a025bc182937f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:21.634452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af6361-c748-43d8-b3f4-8f743396bdd0 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:21.670194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1077/2177] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:21 2022] POST /identity/v3/projects => generated 373 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:21.672343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d650f-a48f-4714-a3de-8848977d8a29 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:21.678725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-688d650f-a48f-4714-a3de-8848977d8a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:21.806853 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d650f-a48f-4714-a3de-8848977d8a29 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:21.815969 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8c6ed-0cee-4f22-aee0-a11c313fd6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:21.817615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8c6ed-0cee-4f22-aee0-a11c313fd6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:21.818237 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8c6ed-0cee-4f22-aee0-a11c313fd6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:21.829547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8c6ed-0cee-4f22-aee0-a11c313fd6c1 admin admin] PATH_INFO: `/v3/users/1126cd8dca9e48c18429cc04bf134eb7` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:21.829547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8c6ed-0cee-4f22-aee0-a11c313fd6c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1126cd8dca9e48c18429cc04bf134eb7)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:21.829547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8c6ed-0cee-4f22-aee0-a11c313fd6c1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:21.893288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-58af6361-c748-43d8-b3f4-8f743396bdd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6444075fa882460f822a025bc182937f', 'request_id': 'req-58af6361-c748-43d8-b3f4-8f743396bdd0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:22.021065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-58af6361-c748-43d8-b3f4-8f743396bdd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6444075fa882460f822a025bc182937f', 'request_id': 'req-58af6361-c748-43d8-b3f4-8f743396bdd0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:22.050769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-58af6361-c748-43d8-b3f4-8f743396bdd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6444075fa882460f822a025bc182937f', 'request_id': 'req-58af6361-c748-43d8-b3f4-8f743396bdd0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:22.089947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-58af6361-c748-43d8-b3f4-8f743396bdd0 admin admin] The token cache is being invalidate because project 6444075fa882460f822a025bc182937f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:22.090664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-58af6361-c748-43d8-b3f4-8f743396bdd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:22.091902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-58af6361-c748-43d8-b3f4-8f743396bdd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:22.095834 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1101/2178] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:21 2022] DELETE /identity/v3/projects/6444075fa882460f822a025bc182937f => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:22.098660 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af6361-c748-43d8-b3f4-8f743396bdd0 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:22.103164 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-58af6361-c748-43d8-b3f4-8f743396bdd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:22.145158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-09d8c6ed-0cee-4f22-aee0-a11c313fd6c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1126cd8dca9e48c18429cc04bf134eb7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:22.159062 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-09d8c6ed-0cee-4f22-aee0-a11c313fd6c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1126cd8dca9e48c18429cc04bf134eb7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:22.199993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-09d8c6ed-0cee-4f22-aee0-a11c313fd6c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1126cd8dca9e48c18429cc04bf134eb7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:22.203881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-09d8c6ed-0cee-4f22-aee0-a11c313fd6c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1126cd8dca9e48c18429cc04bf134eb7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:22.296453 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af6361-c748-43d8-b3f4-8f743396bdd0 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:22.303453 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e01947-4e36-4589-8dfc-293e49884274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:22.304379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e01947-4e36-4589-8dfc-293e49884274 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:22.304670 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e01947-4e36-4589-8dfc-293e49884274 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:22.304950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e01947-4e36-4589-8dfc-293e49884274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:22.308077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-62e01947-4e36-4589-8dfc-293e49884274 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:22.316320 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-09d8c6ed-0cee-4f22-aee0-a11c313fd6c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1126cd8dca9e48c18429cc04bf134eb7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:22.370706 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1078/2179] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:21 2022] DELETE /identity/v3/users/1126cd8dca9e48c18429cc04bf134eb7 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:22.382349 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8c6ed-0cee-4f22-aee0-a11c313fd6c1 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:22.384105 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-09d8c6ed-0cee-4f22-aee0-a11c313fd6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:22.435232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:22.494100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e01947-4e36-4589-8dfc-293e49884274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:22.495547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e01947-4e36-4589-8dfc-293e49884274 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:22.530700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8c6ed-0cee-4f22-aee0-a11c313fd6c1 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:22.546802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1102/2180] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:22.548648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e01947-4e36-4589-8dfc-293e49884274 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:22.555502 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-62e01947-4e36-4589-8dfc-293e49884274 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:22.579282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37ee90-6b5e-4d81-b838-cce5acdb3eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:22.580243 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37ee90-6b5e-4d81-b838-cce5acdb3eed admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:22.580688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37ee90-6b5e-4d81-b838-cce5acdb3eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:22.581119 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37ee90-6b5e-4d81-b838-cce5acdb3eed admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:22.582723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37ee90-6b5e-4d81-b838-cce5acdb3eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:22.584752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37ee90-6b5e-4d81-b838-cce5acdb3eed admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:22.611538 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1079/2181] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:22.612756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37ee90-6b5e-4d81-b838-cce5acdb3eed admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:22.620898 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-dd37ee90-6b5e-4d81-b838-cce5acdb3eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:22.664931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37ee90-6b5e-4d81-b838-cce5acdb3eed admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:22.673046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69b811-8f79-4ec5-8796-189cb2aafcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:22.673910 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69b811-8f79-4ec5-8796-189cb2aafcb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:22.674455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69b811-8f79-4ec5-8796-189cb2aafcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:22.674645 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69b811-8f79-4ec5-8796-189cb2aafcb0 admin admin] PATH_INFO: `/v3/users/1512b25f55c843e7bf77ee5272bde16b` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:22.678523 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69b811-8f79-4ec5-8796-189cb2aafcb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1512b25f55c843e7bf77ee5272bde16b)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:22.691913 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69b811-8f79-4ec5-8796-189cb2aafcb0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:22.774402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e01947-4e36-4589-8dfc-293e49884274 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:22.784263 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a0037-9a87-4efa-abaf-0ba83fc281f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:22.785460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a0037-9a87-4efa-abaf-0ba83fc281f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:22.787437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a0037-9a87-4efa-abaf-0ba83fc281f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:22.787437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a0037-9a87-4efa-abaf-0ba83fc281f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:22.787911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a0037-9a87-4efa-abaf-0ba83fc281f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:22.790067 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a0037-9a87-4efa-abaf-0ba83fc281f1 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:22.994146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1103/2182] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:22 2022] POST /identity/v3/users => generated 287 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:23.001030 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a0037-9a87-4efa-abaf-0ba83fc281f1 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:23.037233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a0037-9a87-4efa-abaf-0ba83fc281f1 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:23.064540 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f9d11-66cb-4b85-87fe-035e9dcdab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:23.067679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f9d11-66cb-4b85-87fe-035e9dcdab9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:23.068826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f9d11-66cb-4b85-87fe-035e9dcdab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:23.069294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f9d11-66cb-4b85-87fe-035e9dcdab9c admin admin] PATH_INFO: `/v3/projects/21ee9d89f0d341818a9d0032541c7500/users/6b644dee075f444fbd4256623bd74048/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:23.121380 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f9d11-66cb-4b85-87fe-035e9dcdab9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=21ee9d89f0d341818a9d0032541c7500, user_id=6b644dee075f444fbd4256623bd74048, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:23.122258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-7b69b811-8f79-4ec5-8796-189cb2aafcb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1512b25f55c843e7bf77ee5272bde16b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:23.123939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-7b69b811-8f79-4ec5-8796-189cb2aafcb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1512b25f55c843e7bf77ee5272bde16b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:23.132861 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f9d11-66cb-4b85-87fe-035e9dcdab9c admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:23.159627 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-7b69b811-8f79-4ec5-8796-189cb2aafcb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1512b25f55c843e7bf77ee5272bde16b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:23.167126 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-7b69b811-8f79-4ec5-8796-189cb2aafcb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1512b25f55c843e7bf77ee5272bde16b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:23.249680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1104/2183] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:22 2022] PUT /identity/v3/projects/21ee9d89f0d341818a9d0032541c7500/users/6b644dee075f444fbd4256623bd74048/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:23.252600 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f9d11-66cb-4b85-87fe-035e9dcdab9c admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:23.256604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5c7f9d11-66cb-4b85-87fe-035e9dcdab9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:23.276792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-7b69b811-8f79-4ec5-8796-189cb2aafcb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1512b25f55c843e7bf77ee5272bde16b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:23.324863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1080/2184] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:22 2022] DELETE /identity/v3/users/1512b25f55c843e7bf77ee5272bde16b => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:23.335961 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69b811-8f79-4ec5-8796-189cb2aafcb0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:23.339097 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7b69b811-8f79-4ec5-8796-189cb2aafcb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:23.393219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f9d11-66cb-4b85-87fe-035e9dcdab9c admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:23.488133 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69b811-8f79-4ec5-8796-189cb2aafcb0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:23.510520 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563dc40-a683-4e8b-aee2-686c97da1ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:23.512759 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563dc40-a683-4e8b-aee2-686c97da1ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:23.513771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563dc40-a683-4e8b-aee2-686c97da1ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:23.514130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563dc40-a683-4e8b-aee2-686c97da1ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:23.515852 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563dc40-a683-4e8b-aee2-686c97da1ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:23.518443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563dc40-a683-4e8b-aee2-686c97da1ccd admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:23.546249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1081/2185] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:23.549380 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e32d4c-0de0-40fb-90c4-9c2ff77ae9c1 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:23.550167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e32d4c-0de0-40fb-90c4-9c2ff77ae9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:23.550785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e32d4c-0de0-40fb-90c4-9c2ff77ae9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:23.553182 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb7c00-be3b-40a6-8848-bf4937f49a0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:23.554285 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb7c00-be3b-40a6-8848-bf4937f49a0d service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:23.554801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb7c00-be3b-40a6-8848-bf4937f49a0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:23.555286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb7c00-be3b-40a6-8848-bf4937f49a0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:23.560616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a6fb7c00-be3b-40a6-8848-bf4937f49a0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:23.641763 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e3e32d4c-0de0-40fb-90c4-9c2ff77ae9c1 None None] MFA Rules not processed for user `090eeca8e41c4f24b6337c773e87e00e`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:23.643916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e3e32d4c-0de0-40fb-90c4-9c2ff77ae9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:23.765993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb7c00-be3b-40a6-8848-bf4937f49a0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:23.768676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb7c00-be3b-40a6-8848-bf4937f49a0d service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:23.792361 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1105/2186] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:23.793667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a34b3b-96e6-4e8e-a20d-556000ce29be None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:23.793961 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a34b3b-96e6-4e8e-a20d-556000ce29be None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:23.794245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a34b3b-96e6-4e8e-a20d-556000ce29be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:23.832129 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1082/2187] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:23.843274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e32d4c-0de0-40fb-90c4-9c2ff77ae9c1 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:23.856906 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e32d4c-0de0-40fb-90c4-9c2ff77ae9c1 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:23.858791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-07a34b3b-96e6-4e8e-a20d-556000ce29be None None] MFA Rules not processed for user `6b644dee075f444fbd4256623bd74048`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:23.860826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-07a34b3b-96e6-4e8e-a20d-556000ce29be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:23.865998 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00980cb8-ca33-4fd3-a8ab-f862819ef78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:23.867079 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00980cb8-ca33-4fd3-a8ab-f862819ef78c admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:23.867553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00980cb8-ca33-4fd3-a8ab-f862819ef78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:23.868086 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00980cb8-ca33-4fd3-a8ab-f862819ef78c admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:23.869356 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00980cb8-ca33-4fd3-a8ab-f862819ef78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:23.872499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00980cb8-ca33-4fd3-a8ab-f862819ef78c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:23.902350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1083/2188] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:23.902350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00980cb8-ca33-4fd3-a8ab-f862819ef78c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:23.902350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-00980cb8-ca33-4fd3-a8ab-f862819ef78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:23.945209 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00980cb8-ca33-4fd3-a8ab-f862819ef78c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:23.967208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611c96f-ea6d-40bb-a108-043b7d3a31ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:23.968261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611c96f-ea6d-40bb-a108-043b7d3a31ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:23.970832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611c96f-ea6d-40bb-a108-043b7d3a31ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:23.972034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611c96f-ea6d-40bb-a108-043b7d3a31ed admin admin] PATH_INFO: `/v3/projects/6c9e291b57d04e6da573d1d401ab850d` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:23.978243 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611c96f-ea6d-40bb-a108-043b7d3a31ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9e291b57d04e6da573d1d401ab850d)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:23.985080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611c96f-ea6d-40bb-a108-043b7d3a31ed admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:24.038228 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1106/2189] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:24.039268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a34b3b-96e6-4e8e-a20d-556000ce29be None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:24.040771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-07a34b3b-96e6-4e8e-a20d-556000ce29be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:24.179013 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:24.185608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a34b3b-96e6-4e8e-a20d-556000ce29be None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:24.194224 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de23d19-d2b6-459a-abd8-d7e546942318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:24.194929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de23d19-d2b6-459a-abd8-d7e546942318 service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:24.195217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de23d19-d2b6-459a-abd8-d7e546942318 service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:24.195494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de23d19-d2b6-459a-abd8-d7e546942318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:24.207997 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de23d19-d2b6-459a-abd8-d7e546942318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:24.209693 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de23d19-d2b6-459a-abd8-d7e546942318 service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:24.226656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1107/2190] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:24.228366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de23d19-d2b6-459a-abd8-d7e546942318 service nova] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:24.258918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de23d19-d2b6-459a-abd8-d7e546942318 service nova] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:24.275061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75136b27-d073-4408-a5d4-f0ac42eabc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:24.276267 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75136b27-d073-4408-a5d4-f0ac42eabc24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:24.276821 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75136b27-d073-4408-a5d4-f0ac42eabc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:24.277592 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75136b27-d073-4408-a5d4-f0ac42eabc24 admin admin] PATH_INFO: `/v3/projects/65f36ebf1ef44f5d9456d7725ace34db/users/d3256fdf955646dca981ff879a7ba3cc/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:24.303013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-7611c96f-ea6d-40bb-a108-043b7d3a31ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9e291b57d04e6da573d1d401ab850d', 'request_id': 'req-7611c96f-ea6d-40bb-a108-043b7d3a31ed'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:24.329782 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-7611c96f-ea6d-40bb-a108-043b7d3a31ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9e291b57d04e6da573d1d401ab850d', 'request_id': 'req-7611c96f-ea6d-40bb-a108-043b7d3a31ed'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:24.333800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75136b27-d073-4408-a5d4-f0ac42eabc24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f36ebf1ef44f5d9456d7725ace34db, user_id=d3256fdf955646dca981ff879a7ba3cc, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:24.342234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-7611c96f-ea6d-40bb-a108-043b7d3a31ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9e291b57d04e6da573d1d401ab850d', 'request_id': 'req-7611c96f-ea6d-40bb-a108-043b7d3a31ed'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:24.347088 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75136b27-d073-4408-a5d4-f0ac42eabc24 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:24.534685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-7611c96f-ea6d-40bb-a108-043b7d3a31ed admin admin] The token cache is being invalidate because project 6c9e291b57d04e6da573d1d401ab850d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:24.536344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1108/2191] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:24 2022] PUT /identity/v3/projects/65f36ebf1ef44f5d9456d7725ace34db/users/d3256fdf955646dca981ff879a7ba3cc/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:24.537401 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75136b27-d073-4408-a5d4-f0ac42eabc24 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:24.538034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-7611c96f-ea6d-40bb-a108-043b7d3a31ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:24.538886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-7611c96f-ea6d-40bb-a108-043b7d3a31ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:24.542688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-75136b27-d073-4408-a5d4-f0ac42eabc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:24.547635 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1084/2192] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:23 2022] DELETE /identity/v3/projects/6c9e291b57d04e6da573d1d401ab850d => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:24.548928 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611c96f-ea6d-40bb-a108-043b7d3a31ed admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:24.553791 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7611c96f-ea6d-40bb-a108-043b7d3a31ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:24.641884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75136b27-d073-4408-a5d4-f0ac42eabc24 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:24.646630 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab0c91-369a-470c-b3d8-cd0846f2f7c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:24.647396 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab0c91-369a-470c-b3d8-cd0846f2f7c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:24.647728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab0c91-369a-470c-b3d8-cd0846f2f7c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:24.648079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab0c91-369a-470c-b3d8-cd0846f2f7c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:24.650221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-13ab0c91-369a-470c-b3d8-cd0846f2f7c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:24.705960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611c96f-ea6d-40bb-a108-043b7d3a31ed admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:24.775348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab0c91-369a-470c-b3d8-cd0846f2f7c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:24.776809 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab0c91-369a-470c-b3d8-cd0846f2f7c4 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:24.788846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1109/2193] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:24.802073 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab0c91-369a-470c-b3d8-cd0846f2f7c4 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:24.804802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-13ab0c91-369a-470c-b3d8-cd0846f2f7c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:24.818926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb37b8-c1c4-4c40-9d62-2cf5ed31af77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:24.820026 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb37b8-c1c4-4c40-9d62-2cf5ed31af77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:24.820521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb37b8-c1c4-4c40-9d62-2cf5ed31af77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:24.821020 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb37b8-c1c4-4c40-9d62-2cf5ed31af77 admin admin] PATH_INFO: `/v3/projects/ea3599f2780c4d95b2ac215ced2c067d` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:24.823385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb37b8-c1c4-4c40-9d62-2cf5ed31af77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea3599f2780c4d95b2ac215ced2c067d)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:24.827671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb37b8-c1c4-4c40-9d62-2cf5ed31af77 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:24.911492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab0c91-369a-470c-b3d8-cd0846f2f7c4 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:24.919928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c5561-79c1-4809-9a74-7ca0b43b2ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:24.921612 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c5561-79c1-4809-9a74-7ca0b43b2ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:24.922121 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c5561-79c1-4809-9a74-7ca0b43b2ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:24.922628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c5561-79c1-4809-9a74-7ca0b43b2ecf admin admin] PATH_INFO: `/v3/users/605fc9a59a2d4cd687cd0e1919c99316` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:24.925046 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c5561-79c1-4809-9a74-7ca0b43b2ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=605fc9a59a2d4cd687cd0e1919c99316)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:24.929054 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c5561-79c1-4809-9a74-7ca0b43b2ecf admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:25.089403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9ecb37b8-c1c4-4c40-9d62-2cf5ed31af77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea3599f2780c4d95b2ac215ced2c067d', 'request_id': 'req-9ecb37b8-c1c4-4c40-9d62-2cf5ed31af77'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:25.105879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9ecb37b8-c1c4-4c40-9d62-2cf5ed31af77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea3599f2780c4d95b2ac215ced2c067d', 'request_id': 'req-9ecb37b8-c1c4-4c40-9d62-2cf5ed31af77'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:25.116511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9ecb37b8-c1c4-4c40-9d62-2cf5ed31af77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea3599f2780c4d95b2ac215ced2c067d', 'request_id': 'req-9ecb37b8-c1c4-4c40-9d62-2cf5ed31af77'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:25.230960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:25.326218 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9ecb37b8-c1c4-4c40-9d62-2cf5ed31af77 admin admin] The token cache is being invalidate because project ea3599f2780c4d95b2ac215ced2c067d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:25.326927 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9ecb37b8-c1c4-4c40-9d62-2cf5ed31af77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:25.330722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9ecb37b8-c1c4-4c40-9d62-2cf5ed31af77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:25.342843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1085/2194] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:24 2022] DELETE /identity/v3/projects/ea3599f2780c4d95b2ac215ced2c067d => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:25.346164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9475dbd-e3a9-497b-b87f-f5c9303075d2 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:25.346706 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9475dbd-e3a9-497b-b87f-f5c9303075d2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:25.347175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9475dbd-e3a9-497b-b87f-f5c9303075d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:25.395515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-789c5561-79c1-4809-9a74-7ca0b43b2ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '605fc9a59a2d4cd687cd0e1919c99316'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:25.397026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-789c5561-79c1-4809-9a74-7ca0b43b2ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '605fc9a59a2d4cd687cd0e1919c99316'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:25.414929 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b9475dbd-e3a9-497b-b87f-f5c9303075d2 None None] MFA Rules not processed for user `d3256fdf955646dca981ff879a7ba3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:25.417292 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b9475dbd-e3a9-497b-b87f-f5c9303075d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:25.428225 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-789c5561-79c1-4809-9a74-7ca0b43b2ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '605fc9a59a2d4cd687cd0e1919c99316'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:25.453055 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:25.543925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-789c5561-79c1-4809-9a74-7ca0b43b2ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '605fc9a59a2d4cd687cd0e1919c99316'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:25.545925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-789c5561-79c1-4809-9a74-7ca0b43b2ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '605fc9a59a2d4cd687cd0e1919c99316'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:25.576403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1110/2195] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:24 2022] DELETE /identity/v3/users/605fc9a59a2d4cd687cd0e1919c99316 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:25.578525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c5561-79c1-4809-9a74-7ca0b43b2ecf admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:25.581510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-789c5561-79c1-4809-9a74-7ca0b43b2ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:25.625080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1086/2196] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:25.651512 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9475dbd-e3a9-497b-b87f-f5c9303075d2 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:25.656876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b9475dbd-e3a9-497b-b87f-f5c9303075d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:25.783319 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c5561-79c1-4809-9a74-7ca0b43b2ecf admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:25.794532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e0a8f-a657-4643-a353-b38835b5228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:25.795928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e0a8f-a657-4643-a353-b38835b5228d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:25.796561 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e0a8f-a657-4643-a353-b38835b5228d admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:25.797019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e0a8f-a657-4643-a353-b38835b5228d admin admin] PATH_INFO: `/v3/users/a9d07d056ce84898ba72f112fb3960b9` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:25.799682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e0a8f-a657-4643-a353-b38835b5228d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d07d056ce84898ba72f112fb3960b9)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:25.816379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e0a8f-a657-4643-a353-b38835b5228d admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:25.876327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9475dbd-e3a9-497b-b87f-f5c9303075d2 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:26.046786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec7a46-bfe7-4e2a-b3b8-2be775af917b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d85dc9f9f15480db927e617c992e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:26.048590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec7a46-bfe7-4e2a-b3b8-2be775af917b service glance] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:26.048590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec7a46-bfe7-4e2a-b3b8-2be775af917b service glance] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:26.049105 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec7a46-bfe7-4e2a-b3b8-2be775af917b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:26.229251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d22e0a8f-a657-4643-a353-b38835b5228d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d07d056ce84898ba72f112fb3960b9'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:26.231093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d22e0a8f-a657-4643-a353-b38835b5228d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d07d056ce84898ba72f112fb3960b9'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:26.264466 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec7a46-bfe7-4e2a-b3b8-2be775af917b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:26.266291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec7a46-bfe7-4e2a-b3b8-2be775af917b service glance] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:26.282521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1087/2197] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:22:26.299894 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d22e0a8f-a657-4643-a353-b38835b5228d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d07d056ce84898ba72f112fb3960b9'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:26.435893 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d22e0a8f-a657-4643-a353-b38835b5228d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d07d056ce84898ba72f112fb3960b9'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:26.444641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d22e0a8f-a657-4643-a353-b38835b5228d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d07d056ce84898ba72f112fb3960b9'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:26.477183 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1111/2198] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:25 2022] DELETE /identity/v3/users/a9d07d056ce84898ba72f112fb3960b9 => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:27.152049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec7a46-bfe7-4e2a-b3b8-2be775af917b service glance] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:27.153201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:27.155336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-44ec7a46-bfe7-4e2a-b3b8-2be775af917b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:27.179269 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec7a46-bfe7-4e2a-b3b8-2be775af917b service glance] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:27.341907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e0a8f-a657-4643-a353-b38835b5228d admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:27.343621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d22e0a8f-a657-4643-a353-b38835b5228d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:27.478946 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918aa51-c15f-4daf-b9b5-0aa99ac4c3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:27.480185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918aa51-c15f-4daf-b9b5-0aa99ac4c3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:27.480573 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918aa51-c15f-4daf-b9b5-0aa99ac4c3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:27.480979 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918aa51-c15f-4daf-b9b5-0aa99ac4c3ec admin admin] PATH_INFO: `/v3/projects/fa1211d80e9b4aaa93c6cd929cb911aa` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:27.507162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918aa51-c15f-4daf-b9b5-0aa99ac4c3ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa1211d80e9b4aaa93c6cd929cb911aa)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:27.510937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918aa51-c15f-4daf-b9b5-0aa99ac4c3ec admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:27.602751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e0a8f-a657-4643-a353-b38835b5228d admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:27.626831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321eaca2-edff-43a5-9a30-c0d2bb8549d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:27.626831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eaca2-edff-43a5-9a30-c0d2bb8549d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:27.626831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eaca2-edff-43a5-9a30-c0d2bb8549d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:27.626831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eaca2-edff-43a5-9a30-c0d2bb8549d2 admin admin] PATH_INFO: `/v3/projects/ea37907a82bb4eefba7516514d0891da` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:27.630915 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321eaca2-edff-43a5-9a30-c0d2bb8549d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea37907a82bb4eefba7516514d0891da)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:27.633349 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321eaca2-edff-43a5-9a30-c0d2bb8549d2 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:27.772588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a918aa51-c15f-4daf-b9b5-0aa99ac4c3ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa1211d80e9b4aaa93c6cd929cb911aa', 'request_id': 'req-a918aa51-c15f-4daf-b9b5-0aa99ac4c3ec'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:27.780123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a918aa51-c15f-4daf-b9b5-0aa99ac4c3ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa1211d80e9b4aaa93c6cd929cb911aa', 'request_id': 'req-a918aa51-c15f-4daf-b9b5-0aa99ac4c3ec'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:27.788212 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a918aa51-c15f-4daf-b9b5-0aa99ac4c3ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa1211d80e9b4aaa93c6cd929cb911aa', 'request_id': 'req-a918aa51-c15f-4daf-b9b5-0aa99ac4c3ec'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:27.869378 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-321eaca2-edff-43a5-9a30-c0d2bb8549d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea37907a82bb4eefba7516514d0891da', 'request_id': 'req-321eaca2-edff-43a5-9a30-c0d2bb8549d2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:27.970226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a918aa51-c15f-4daf-b9b5-0aa99ac4c3ec admin admin] The token cache is being invalidate because project fa1211d80e9b4aaa93c6cd929cb911aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:27.970838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a918aa51-c15f-4daf-b9b5-0aa99ac4c3ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:27.987620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a918aa51-c15f-4daf-b9b5-0aa99ac4c3ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:27.987620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1088/2199] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:27 2022] DELETE /identity/v3/projects/fa1211d80e9b4aaa93c6cd929cb911aa => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:27.987620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5df492-2080-49c3-8437-5f10883ed2bb None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:27.987620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5df492-2080-49c3-8437-5f10883ed2bb None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:27.987620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5df492-2080-49c3-8437-5f10883ed2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:28.041262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-eb5df492-2080-49c3-8437-5f10883ed2bb None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:28.045269 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-eb5df492-2080-49c3-8437-5f10883ed2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:28.166712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-321eaca2-edff-43a5-9a30-c0d2bb8549d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea37907a82bb4eefba7516514d0891da', 'request_id': 'req-321eaca2-edff-43a5-9a30-c0d2bb8549d2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:28.176965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-321eaca2-edff-43a5-9a30-c0d2bb8549d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea37907a82bb4eefba7516514d0891da', 'request_id': 'req-321eaca2-edff-43a5-9a30-c0d2bb8549d2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:28.207125 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-321eaca2-edff-43a5-9a30-c0d2bb8549d2 admin admin] The token cache is being invalidate because project ea37907a82bb4eefba7516514d0891da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:28.207683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-321eaca2-edff-43a5-9a30-c0d2bb8549d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:28.215826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-321eaca2-edff-43a5-9a30-c0d2bb8549d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:28.227718 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1112/2200] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:27 2022] DELETE /identity/v3/projects/ea37907a82bb4eefba7516514d0891da => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:22:28.244678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06051963-a055-460a-b458-2b1f6ed7f933 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:28.245457 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06051963-a055-460a-b458-2b1f6ed7f933 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:28.246074 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06051963-a055-460a-b458-2b1f6ed7f933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:28.309557 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:28.310411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-06051963-a055-460a-b458-2b1f6ed7f933 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:28.312053 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-06051963-a055-460a-b458-2b1f6ed7f933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:28.337360 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1089/2201] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:28.343953 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543c5ce-9a05-4fb4-9309-da540d87c69d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:28.344587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543c5ce-9a05-4fb4-9309-da540d87c69d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:28.345092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543c5ce-9a05-4fb4-9309-da540d87c69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:28.386683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2543c5ce-9a05-4fb4-9309-da540d87c69d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:28.389546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2543c5ce-9a05-4fb4-9309-da540d87c69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:28.419746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1090/2202] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:28.421212 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543c5ce-9a05-4fb4-9309-da540d87c69d None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:28.440547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543c5ce-9a05-4fb4-9309-da540d87c69d None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:28.442401 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1113/2203] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:22:28.452237 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9fcdf-40ac-4ba0-9d16-cfc7e93aba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:28.462735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9fcdf-40ac-4ba0-9d16-cfc7e93aba26 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:28.462735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9fcdf-40ac-4ba0-9d16-cfc7e93aba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:28.462735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9fcdf-40ac-4ba0-9d16-cfc7e93aba26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:28.462735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9fcdf-40ac-4ba0-9d16-cfc7e93aba26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:22:28.462735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9fcdf-40ac-4ba0-9d16-cfc7e93aba26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:28.462735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9fcdf-40ac-4ba0-9d16-cfc7e93aba26 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:28.466924 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dbf82-3d1c-4c41-9049-5e416044eb86 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:28.467798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dbf82-3d1c-4c41-9049-5e416044eb86 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:28.469382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dbf82-3d1c-4c41-9049-5e416044eb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:28.495671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1091/2204] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:22:28.508767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9fcdf-40ac-4ba0-9d16-cfc7e93aba26 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:28.526041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-fa6dbf82-3d1c-4c41-9049-5e416044eb86 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:28.528122 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-fa6dbf82-3d1c-4c41-9049-5e416044eb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:28.535551 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9fcdf-40ac-4ba0-9d16-cfc7e93aba26 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:28.561687 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cdc51-4203-4c5f-a61d-af25834fe150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:28.562735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cdc51-4203-4c5f-a61d-af25834fe150 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:28.563224 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cdc51-4203-4c5f-a61d-af25834fe150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:28.565003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cdc51-4203-4c5f-a61d-af25834fe150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:28.567539 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cdc51-4203-4c5f-a61d-af25834fe150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:28.568876 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1114/2205] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:28.571690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dbf82-3d1c-4c41-9049-5e416044eb86 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:28.575827 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cdc51-4203-4c5f-a61d-af25834fe150 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:28.589899 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dbf82-3d1c-4c41-9049-5e416044eb86 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:28.601972 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cda587-8f1b-4c44-9db5-8e28d2efc031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:28.603664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cda587-8f1b-4c44-9db5-8e28d2efc031 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:28.604956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cda587-8f1b-4c44-9db5-8e28d2efc031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:28.605695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cda587-8f1b-4c44-9db5-8e28d2efc031 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:28.607892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cda587-8f1b-4c44-9db5-8e28d2efc031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:22:28.610485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cda587-8f1b-4c44-9db5-8e28d2efc031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:28.617361 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cda587-8f1b-4c44-9db5-8e28d2efc031 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:28.635879 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1115/2206] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:22:28.641871 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cda587-8f1b-4c44-9db5-8e28d2efc031 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:28.656900 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cda587-8f1b-4c44-9db5-8e28d2efc031 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:28.667162 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc66f0-e48e-437d-b935-a2b036d9e560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:28.670702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc66f0-e48e-437d-b935-a2b036d9e560 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:28.671248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc66f0-e48e-437d-b935-a2b036d9e560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:28.671730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc66f0-e48e-437d-b935-a2b036d9e560 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:28.673223 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc66f0-e48e-437d-b935-a2b036d9e560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:28.678590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc66f0-e48e-437d-b935-a2b036d9e560 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:28.763792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1092/2207] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:28 2022] POST /identity/v3/projects => generated 373 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:28.775700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cdc51-4203-4c5f-a61d-af25834fe150 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:28.892226 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1116/2208] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:28 2022] POST /identity/v3/projects => generated 373 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:28.903095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc66f0-e48e-437d-b935-a2b036d9e560 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:28.987506 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cdc51-4203-4c5f-a61d-af25834fe150 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:29.114044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc66f0-e48e-437d-b935-a2b036d9e560 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:29.130699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33aaca-eff3-4796-82b6-5ace00b91bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:29.131733 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33aaca-eff3-4796-82b6-5ace00b91bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:29.132047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33aaca-eff3-4796-82b6-5ace00b91bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:29.132334 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33aaca-eff3-4796-82b6-5ace00b91bdd admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:29.133041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33aaca-eff3-4796-82b6-5ace00b91bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:29.136390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33aaca-eff3-4796-82b6-5ace00b91bdd admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:29.277893 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1117/2209] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:28 2022] POST /identity/v3/users => generated 287 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:29.280306 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33aaca-eff3-4796-82b6-5ace00b91bdd admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:29.284826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf44fe-8849-411a-ab34-2c2767682270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:29.285541 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf44fe-8849-411a-ab34-2c2767682270 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:29.285827 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf44fe-8849-411a-ab34-2c2767682270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:29.286113 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf44fe-8849-411a-ab34-2c2767682270 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:29.287034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf44fe-8849-411a-ab34-2c2767682270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:29.295659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf44fe-8849-411a-ab34-2c2767682270 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:29.304535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33aaca-eff3-4796-82b6-5ace00b91bdd admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:29.323712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ff553-ed48-4e53-9ff0-1e116d382113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:29.327870 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ff553-ed48-4e53-9ff0-1e116d382113 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:29.328524 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ff553-ed48-4e53-9ff0-1e116d382113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:29.329389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ff553-ed48-4e53-9ff0-1e116d382113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:29.330725 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ff553-ed48-4e53-9ff0-1e116d382113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:29.336244 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ff553-ed48-4e53-9ff0-1e116d382113 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:29.382423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1118/2210] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:29.390664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ff553-ed48-4e53-9ff0-1e116d382113 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:29.418582 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ff553-ed48-4e53-9ff0-1e116d382113 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:29.436260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c4246-e33c-4526-8c95-ec0308134117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:29.440818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c4246-e33c-4526-8c95-ec0308134117 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:29.444045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c4246-e33c-4526-8c95-ec0308134117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:29.447739 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c4246-e33c-4526-8c95-ec0308134117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:29.448145 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c4246-e33c-4526-8c95-ec0308134117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:29.451831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c4246-e33c-4526-8c95-ec0308134117 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:29.471722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1093/2211] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:28 2022] POST /identity/v3/users => generated 287 bytes in 698 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:29.487364 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf44fe-8849-411a-ab34-2c2767682270 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:29.496061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1119/2212] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:29.508328 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c4246-e33c-4526-8c95-ec0308134117 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:29.521718 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf44fe-8849-411a-ab34-2c2767682270 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:29.527456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199be83-5331-4268-ab3b-4001d8beab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:29.528072 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199be83-5331-4268-ab3b-4001d8beab30 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:29.528567 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199be83-5331-4268-ab3b-4001d8beab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:29.529207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199be83-5331-4268-ab3b-4001d8beab30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:29.531128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199be83-5331-4268-ab3b-4001d8beab30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:29.533187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199be83-5331-4268-ab3b-4001d8beab30 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:29.534838 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:29.548049 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c4246-e33c-4526-8c95-ec0308134117 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:29.558530 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1094/2213] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:29.560751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe5af4-509a-4acd-b792-39e93db9b32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:29.562178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe5af4-509a-4acd-b792-39e93db9b32f admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:29.562578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199be83-5331-4268-ab3b-4001d8beab30 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:29.563049 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe5af4-509a-4acd-b792-39e93db9b32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:29.564298 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe5af4-509a-4acd-b792-39e93db9b32f admin admin] PATH_INFO: `/v3/projects/cdeb1ef208c84b018a3d160c42a8d448/users/7d2ac4abe7f04f7e861157588e42485c/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:29.577102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199be83-5331-4268-ab3b-4001d8beab30 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:29.586936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd83e04-996e-4290-83ba-6ff2d72eac66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:29.587851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd83e04-996e-4290-83ba-6ff2d72eac66 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:29.588322 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd83e04-996e-4290-83ba-6ff2d72eac66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:29.588632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd83e04-996e-4290-83ba-6ff2d72eac66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:29.589466 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd83e04-996e-4290-83ba-6ff2d72eac66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:29.591382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd83e04-996e-4290-83ba-6ff2d72eac66 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:29.613517 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1095/2214] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:22:29.623452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd83e04-996e-4290-83ba-6ff2d72eac66 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:29.627259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe5af4-509a-4acd-b792-39e93db9b32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdeb1ef208c84b018a3d160c42a8d448, user_id=7d2ac4abe7f04f7e861157588e42485c, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:29.630903 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe5af4-509a-4acd-b792-39e93db9b32f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:29.656615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd83e04-996e-4290-83ba-6ff2d72eac66 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:29.670968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff940e-f3eb-4c3c-8b6c-1d3fbd017e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:29.671830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff940e-f3eb-4c3c-8b6c-1d3fbd017e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:29.672266 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff940e-f3eb-4c3c-8b6c-1d3fbd017e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:29.674135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff940e-f3eb-4c3c-8b6c-1d3fbd017e59 admin admin] PATH_INFO: `/v3/projects/c9f57ad6cef24c73a221dd91632a2875/users/bf25d296b8cc49049e25913f65c9036f/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:29.712728 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff940e-f3eb-4c3c-8b6c-1d3fbd017e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f57ad6cef24c73a221dd91632a2875, user_id=bf25d296b8cc49049e25913f65c9036f, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:29.720281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff940e-f3eb-4c3c-8b6c-1d3fbd017e59 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:29.875202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1120/2215] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:29 2022] PUT /identity/v3/projects/cdeb1ef208c84b018a3d160c42a8d448/users/7d2ac4abe7f04f7e861157588e42485c/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:29.879917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe5af4-509a-4acd-b792-39e93db9b32f admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:29.880144 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-99fe5af4-509a-4acd-b792-39e93db9b32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:29.920080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1096/2216] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:29 2022] PUT /identity/v3/projects/c9f57ad6cef24c73a221dd91632a2875/users/bf25d296b8cc49049e25913f65c9036f/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:29.923227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b19c8-9f76-4e97-8628-80a3a3eb4a9c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:29.923756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b19c8-9f76-4e97-8628-80a3a3eb4a9c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:29.924259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b19c8-9f76-4e97-8628-80a3a3eb4a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:29.991968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-634b19c8-9f76-4e97-8628-80a3a3eb4a9c None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:29.994408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-634b19c8-9f76-4e97-8628-80a3a3eb4a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:30.043572 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe5af4-509a-4acd-b792-39e93db9b32f admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:30.120472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1097/2217] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:30.122534 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056fa77-bfe6-4da4-8d05-96217b75aa5b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:30.122789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056fa77-bfe6-4da4-8d05-96217b75aa5b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:30.123062 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056fa77-bfe6-4da4-8d05-96217b75aa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:30.167105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d7541-bcf2-4cd3-9fae-321230f8eb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:30.172432 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d7541-bcf2-4cd3-9fae-321230f8eb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:30.172737 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d7541-bcf2-4cd3-9fae-321230f8eb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:30.173173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d7541-bcf2-4cd3-9fae-321230f8eb10 admin admin] PATH_INFO: `/v3/users/6b644dee075f444fbd4256623bd74048` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:30.174755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d7541-bcf2-4cd3-9fae-321230f8eb10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b644dee075f444fbd4256623bd74048)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:30.192682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d7541-bcf2-4cd3-9fae-321230f8eb10 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:30.192769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d056fa77-bfe6-4da4-8d05-96217b75aa5b None None] MFA Rules not processed for user `bf25d296b8cc49049e25913f65c9036f`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:30.192769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d056fa77-bfe6-4da4-8d05-96217b75aa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:30.219989 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:30.310162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1098/2218] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:30.311015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056fa77-bfe6-4da4-8d05-96217b75aa5b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:30.314587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d056fa77-bfe6-4da4-8d05-96217b75aa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:30.392022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056fa77-bfe6-4da4-8d05-96217b75aa5b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:30.397183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f8967-81fc-4f24-b1b8-be70b29c5224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:30.397920 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f8967-81fc-4f24-b1b8-be70b29c5224 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:30.398231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f8967-81fc-4f24-b1b8-be70b29c5224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:30.398520 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f8967-81fc-4f24-b1b8-be70b29c5224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:30.411570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f8967-81fc-4f24-b1b8-be70b29c5224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:30.414599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f8967-81fc-4f24-b1b8-be70b29c5224 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:30.427995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1099/2219] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:30.429369 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35d34d-7ec8-45e4-9214-327de2b9a006 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:30.429647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35d34d-7ec8-45e4-9214-327de2b9a006 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:30.429992 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35d34d-7ec8-45e4-9214-327de2b9a006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:30.452831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ab35d34d-7ec8-45e4-9214-327de2b9a006 None None] MFA Rules not processed for user `090eeca8e41c4f24b6337c773e87e00e`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:30.454618 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ab35d34d-7ec8-45e4-9214-327de2b9a006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:30.533789 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d75d7541-bcf2-4cd3-9fae-321230f8eb10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b644dee075f444fbd4256623bd74048'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:30.537303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d75d7541-bcf2-4cd3-9fae-321230f8eb10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b644dee075f444fbd4256623bd74048'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:30.554222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1100/2220] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:30.555469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35d34d-7ec8-45e4-9214-327de2b9a006 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:30.557405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ab35d34d-7ec8-45e4-9214-327de2b9a006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:30.580010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d75d7541-bcf2-4cd3-9fae-321230f8eb10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b644dee075f444fbd4256623bd74048'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:30.676874 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35d34d-7ec8-45e4-9214-327de2b9a006 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:30.684869 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e198a9-0630-4650-bc6a-83dd8ed86af8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:30.690688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d75d7541-bcf2-4cd3-9fae-321230f8eb10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b644dee075f444fbd4256623bd74048'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:30.690688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d75d7541-bcf2-4cd3-9fae-321230f8eb10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b644dee075f444fbd4256623bd74048'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:30.691556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e198a9-0630-4650-bc6a-83dd8ed86af8 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:30.691556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e198a9-0630-4650-bc6a-83dd8ed86af8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:30.691851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e198a9-0630-4650-bc6a-83dd8ed86af8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:30.694532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-44e198a9-0630-4650-bc6a-83dd8ed86af8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:30.709506 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e198a9-0630-4650-bc6a-83dd8ed86af8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:30.711591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e198a9-0630-4650-bc6a-83dd8ed86af8 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:30.712195 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1121/2221] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:29 2022] DELETE /identity/v3/users/6b644dee075f444fbd4256623bd74048 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:30.720521 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c91207-f797-421b-bc7b-8db350b64e1c None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:30.721793 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c91207-f797-421b-bc7b-8db350b64e1c None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:30.723297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c91207-f797-421b-bc7b-8db350b64e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:30.725527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1101/2222] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:30.767157 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-82c91207-f797-421b-bc7b-8db350b64e1c None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:30.769593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-82c91207-f797-421b-bc7b-8db350b64e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:30.922516 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1122/2223] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:22:30.934762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e198a9-0630-4650-bc6a-83dd8ed86af8 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:30.943886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-44e198a9-0630-4650-bc6a-83dd8ed86af8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:30.979600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e198a9-0630-4650-bc6a-83dd8ed86af8 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:31.104877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cab31f-9937-4648-b283-f6db48f5d0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:31.105872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cab31f-9937-4648-b283-f6db48f5d0be service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:31.106328 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cab31f-9937-4648-b283-f6db48f5d0be service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:31.106925 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cab31f-9937-4648-b283-f6db48f5d0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:31.120585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cab31f-9937-4648-b283-f6db48f5d0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:31.122262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cab31f-9937-4648-b283-f6db48f5d0be service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:31.135099 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1102/2224] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:31.535295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:31.935309 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c91207-f797-421b-bc7b-8db350b64e1c None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:31.938106 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-82c91207-f797-421b-bc7b-8db350b64e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:31.976118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c91207-f797-421b-bc7b-8db350b64e1c None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:31.986966 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a2a90-69fb-46ed-a165-1037c6d35952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:31.990535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a2a90-69fb-46ed-a165-1037c6d35952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:31.991733 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a2a90-69fb-46ed-a165-1037c6d35952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:31.992422 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a2a90-69fb-46ed-a165-1037c6d35952 admin admin] PATH_INFO: `/v3/projects/21ee9d89f0d341818a9d0032541c7500` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:31.995092 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a2a90-69fb-46ed-a165-1037c6d35952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21ee9d89f0d341818a9d0032541c7500)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:31.998882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a2a90-69fb-46ed-a165-1037c6d35952 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:32.214680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:32.286174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-457a2a90-69fb-46ed-a165-1037c6d35952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21ee9d89f0d341818a9d0032541c7500', 'request_id': 'req-457a2a90-69fb-46ed-a165-1037c6d35952'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:32.333213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cab31f-9937-4648-b283-f6db48f5d0be service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:32.336009 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e5cab31f-9937-4648-b283-f6db48f5d0be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:32.360355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cab31f-9937-4648-b283-f6db48f5d0be service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:32.389700 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-457a2a90-69fb-46ed-a165-1037c6d35952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21ee9d89f0d341818a9d0032541c7500', 'request_id': 'req-457a2a90-69fb-46ed-a165-1037c6d35952'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:32.417034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-457a2a90-69fb-46ed-a165-1037c6d35952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21ee9d89f0d341818a9d0032541c7500', 'request_id': 'req-457a2a90-69fb-46ed-a165-1037c6d35952'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:32.441297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-457a2a90-69fb-46ed-a165-1037c6d35952 admin admin] The token cache is being invalidate because project 21ee9d89f0d341818a9d0032541c7500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:32.441935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-457a2a90-69fb-46ed-a165-1037c6d35952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:32.443747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-457a2a90-69fb-46ed-a165-1037c6d35952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:32.446869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1123/2225] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:31 2022] DELETE /identity/v3/projects/21ee9d89f0d341818a9d0032541c7500 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:32.495041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d574e4a-360d-4ace-a58c-4dcfdb3039a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:32.496768 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d574e4a-360d-4ace-a58c-4dcfdb3039a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:32.497601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d574e4a-360d-4ace-a58c-4dcfdb3039a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:32.498417 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d574e4a-360d-4ace-a58c-4dcfdb3039a2 admin admin] PATH_INFO: `/v3/users/c4198ebe397542f0b7de1afb889662c5` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:32.501534 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d574e4a-360d-4ace-a58c-4dcfdb3039a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4198ebe397542f0b7de1afb889662c5)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:32.511714 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d574e4a-360d-4ace-a58c-4dcfdb3039a2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:32.998787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8d574e4a-360d-4ace-a58c-4dcfdb3039a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4198ebe397542f0b7de1afb889662c5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:32.999219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8d574e4a-360d-4ace-a58c-4dcfdb3039a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4198ebe397542f0b7de1afb889662c5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:33.020730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8d574e4a-360d-4ace-a58c-4dcfdb3039a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4198ebe397542f0b7de1afb889662c5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:33.022130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8d574e4a-360d-4ace-a58c-4dcfdb3039a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4198ebe397542f0b7de1afb889662c5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:33.207015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8d574e4a-360d-4ace-a58c-4dcfdb3039a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4198ebe397542f0b7de1afb889662c5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:33.242318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1103/2226] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:32 2022] DELETE /identity/v3/users/c4198ebe397542f0b7de1afb889662c5 => generated 0 bytes in 911 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:33.249527 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff2199-e60a-473a-b220-58cc4bdd1996 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:33.251009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff2199-e60a-473a-b220-58cc4bdd1996 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:33.251530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff2199-e60a-473a-b220-58cc4bdd1996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:33.283434 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-51ff2199-e60a-473a-b220-58cc4bdd1996 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:33.286970 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-51ff2199-e60a-473a-b220-58cc4bdd1996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:33.387523 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1124/2227] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:33.400485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d574e4a-360d-4ace-a58c-4dcfdb3039a2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:33.402310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8d574e4a-360d-4ace-a58c-4dcfdb3039a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:33.512509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d574e4a-360d-4ace-a58c-4dcfdb3039a2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:33.521262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1521f25-9cb0-434c-9f58-15f741768a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:33.522118 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1521f25-9cb0-434c-9f58-15f741768a93 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:33.522576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1521f25-9cb0-434c-9f58-15f741768a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:33.523236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1521f25-9cb0-434c-9f58-15f741768a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:33.551536 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1521f25-9cb0-434c-9f58-15f741768a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:33.556066 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1521f25-9cb0-434c-9f58-15f741768a93 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:33.590142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f95fc-fff1-43e9-a8b6-67f59467d9dc None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:33.591148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f95fc-fff1-43e9-a8b6-67f59467d9dc None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:33.591952 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f95fc-fff1-43e9-a8b6-67f59467d9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:33.596371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1104/2228] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:22:33.666719 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-695f95fc-fff1-43e9-a8b6-67f59467d9dc None None] MFA Rules not processed for user `7d2ac4abe7f04f7e861157588e42485c`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:33.669389 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-695f95fc-fff1-43e9-a8b6-67f59467d9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:33.925714 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1125/2229] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:33.933469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1521f25-9cb0-434c-9f58-15f741768a93 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:33.935890 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c1521f25-9cb0-434c-9f58-15f741768a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:34.003657 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1521f25-9cb0-434c-9f58-15f741768a93 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:34.009829 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c0547-3e21-4543-8321-d111e606cf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:34.010574 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c0547-3e21-4543-8321-d111e606cf3b admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:34.011028 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c0547-3e21-4543-8321-d111e606cf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:34.011477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c0547-3e21-4543-8321-d111e606cf3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:34.012394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c0547-3e21-4543-8321-d111e606cf3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:34.015870 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c0547-3e21-4543-8321-d111e606cf3b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:34.164133 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1105/2230] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:33 2022] POST /identity/v3/projects => generated 371 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:34.166964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f95fc-fff1-43e9-a8b6-67f59467d9dc None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:34.185204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f95fc-fff1-43e9-a8b6-67f59467d9dc None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:34.293511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cde6f2-692a-466d-96a4-67a7cd7ed58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:34.293511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cde6f2-692a-466d-96a4-67a7cd7ed58c admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:34.293511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cde6f2-692a-466d-96a4-67a7cd7ed58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:34.293511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cde6f2-692a-466d-96a4-67a7cd7ed58c admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:34.294838 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cde6f2-692a-466d-96a4-67a7cd7ed58c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:34.302005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cde6f2-692a-466d-96a4-67a7cd7ed58c admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:34.304385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c0547-3e21-4543-8321-d111e606cf3b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:34.306304 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-734c0547-3e21-4543-8321-d111e606cf3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:34.342490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c0547-3e21-4543-8321-d111e606cf3b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:34.349792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df4395-35e9-44ab-b236-152062b2a0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:34.351836 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df4395-35e9-44ab-b236-152062b2a0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:34.351836 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df4395-35e9-44ab-b236-152062b2a0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:34.351836 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df4395-35e9-44ab-b236-152062b2a0bc admin admin] PATH_INFO: `/v3/projects/a22b8b32ee384f339802313df332c21b` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:34.354321 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df4395-35e9-44ab-b236-152062b2a0bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22b8b32ee384f339802313df332c21b)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:34.357009 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df4395-35e9-44ab-b236-152062b2a0bc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:34.468770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1126/2231] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:34 2022] POST /identity/v3/users => generated 292 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:34.475322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cde6f2-692a-466d-96a4-67a7cd7ed58c admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:34.494765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cde6f2-692a-466d-96a4-67a7cd7ed58c admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:34.505697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61756cf-375d-4b4d-b7b9-82d379701d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:34.506944 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61756cf-375d-4b4d-b7b9-82d379701d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:34.507453 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61756cf-375d-4b4d-b7b9-82d379701d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:34.508207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61756cf-375d-4b4d-b7b9-82d379701d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:34.509557 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61756cf-375d-4b4d-b7b9-82d379701d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:34.513603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61756cf-375d-4b4d-b7b9-82d379701d71 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:34.535000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1127/2232] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:34.538048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61756cf-375d-4b4d-b7b9-82d379701d71 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:34.552679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61756cf-375d-4b4d-b7b9-82d379701d71 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:34.563265 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f14c8f-0cba-4e56-b274-0730690233bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:34.566385 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f14c8f-0cba-4e56-b274-0730690233bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:34.566965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f14c8f-0cba-4e56-b274-0730690233bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:34.568227 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f14c8f-0cba-4e56-b274-0730690233bc admin admin] PATH_INFO: `/v3/projects/b4dc5d5e79ef42b39acfdf6bbf7a4883/users/d8a260d24b67412982e0d79165b20d8e/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:34.573954 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:34.590216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c8df4395-35e9-44ab-b236-152062b2a0bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22b8b32ee384f339802313df332c21b', 'request_id': 'req-c8df4395-35e9-44ab-b236-152062b2a0bc'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:34.597862 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f14c8f-0cba-4e56-b274-0730690233bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4dc5d5e79ef42b39acfdf6bbf7a4883, user_id=d8a260d24b67412982e0d79165b20d8e, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:34.601406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f14c8f-0cba-4e56-b274-0730690233bc admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:34.601724 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c8df4395-35e9-44ab-b236-152062b2a0bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22b8b32ee384f339802313df332c21b', 'request_id': 'req-c8df4395-35e9-44ab-b236-152062b2a0bc'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:34.611256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c8df4395-35e9-44ab-b236-152062b2a0bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22b8b32ee384f339802313df332c21b', 'request_id': 'req-c8df4395-35e9-44ab-b236-152062b2a0bc'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:34.718659 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1128/2233] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:34 2022] PUT /identity/v3/projects/b4dc5d5e79ef42b39acfdf6bbf7a4883/users/d8a260d24b67412982e0d79165b20d8e/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:22:34.720805 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f14c8f-0cba-4e56-b274-0730690233bc admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:34.836199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f14c8f-0cba-4e56-b274-0730690233bc admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:34.844757 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba604d-989c-47a4-860b-9f28ba5824be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:34.845872 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba604d-989c-47a4-860b-9f28ba5824be admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:34.846390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba604d-989c-47a4-860b-9f28ba5824be admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:34.847962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba604d-989c-47a4-860b-9f28ba5824be admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:34.848681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba604d-989c-47a4-860b-9f28ba5824be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:34.852185 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba604d-989c-47a4-860b-9f28ba5824be admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:34.874741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1129/2234] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:34.879941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba604d-989c-47a4-860b-9f28ba5824be admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:34.895134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba604d-989c-47a4-860b-9f28ba5824be admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:34.903438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db91b22-6883-4615-971b-98fd65b7b392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:34.904696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db91b22-6883-4615-971b-98fd65b7b392 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:34.905329 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db91b22-6883-4615-971b-98fd65b7b392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:34.905877 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db91b22-6883-4615-971b-98fd65b7b392 admin admin] PATH_INFO: `/v3/projects/b4dc5d5e79ef42b39acfdf6bbf7a4883/users/d8a260d24b67412982e0d79165b20d8e/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:34.910682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db91b22-6883-4615-971b-98fd65b7b392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4dc5d5e79ef42b39acfdf6bbf7a4883, user_id=d8a260d24b67412982e0d79165b20d8e, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:34.916266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db91b22-6883-4615-971b-98fd65b7b392 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:34.938079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1130/2235] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:34 2022] PUT /identity/v3/projects/b4dc5d5e79ef42b39acfdf6bbf7a4883/users/d8a260d24b67412982e0d79165b20d8e/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:22:34.946822 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c8df4395-35e9-44ab-b236-152062b2a0bc admin admin] The token cache is being invalidate because project a22b8b32ee384f339802313df332c21b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:34.947259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c8df4395-35e9-44ab-b236-152062b2a0bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:34.948464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c8df4395-35e9-44ab-b236-152062b2a0bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:34.958293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1106/2236] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:34 2022] DELETE /identity/v3/projects/a22b8b32ee384f339802313df332c21b => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:22:34.958619 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db91b22-6883-4615-971b-98fd65b7b392 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:34.964500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7db91b22-6883-4615-971b-98fd65b7b392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:35.122166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db91b22-6883-4615-971b-98fd65b7b392 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:35.126052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:35.137364 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1998314-4652-4809-9b83-f1428c7bbb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:35.138058 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1998314-4652-4809-9b83-f1428c7bbb8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:35.138481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1998314-4652-4809-9b83-f1428c7bbb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:35.138909 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1998314-4652-4809-9b83-f1428c7bbb8c admin admin] PATH_INFO: `/v3/users/9f9ca4edef53418ab576065fe2e0f7b7` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:35.140394 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1998314-4652-4809-9b83-f1428c7bbb8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f9ca4edef53418ab576065fe2e0f7b7)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:35.142484 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1998314-4652-4809-9b83-f1428c7bbb8c admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:35.408639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-a1998314-4652-4809-9b83-f1428c7bbb8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f9ca4edef53418ab576065fe2e0f7b7'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:35.410561 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-a1998314-4652-4809-9b83-f1428c7bbb8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f9ca4edef53418ab576065fe2e0f7b7'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:35.450317 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-a1998314-4652-4809-9b83-f1428c7bbb8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f9ca4edef53418ab576065fe2e0f7b7'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:35.663938 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-a1998314-4652-4809-9b83-f1428c7bbb8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f9ca4edef53418ab576065fe2e0f7b7'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:35.664763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-a1998314-4652-4809-9b83-f1428c7bbb8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f9ca4edef53418ab576065fe2e0f7b7'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:35.687315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1131/2237] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:34 2022] DELETE /identity/v3/users/9f9ca4edef53418ab576065fe2e0f7b7 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:22:36.531254 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df4395-35e9-44ab-b236-152062b2a0bc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:36.660087 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df4395-35e9-44ab-b236-152062b2a0bc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:36.769358 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189111d-dec5-4db1-9f3f-f91c35c1e967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:36.770983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189111d-dec5-4db1-9f3f-f91c35c1e967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:36.771731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189111d-dec5-4db1-9f3f-f91c35c1e967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:36.772412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189111d-dec5-4db1-9f3f-f91c35c1e967 admin admin] PATH_INFO: `/v3/projects/4ded9ca1dbff404c8bb26f48b4e26168` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:36.774210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189111d-dec5-4db1-9f3f-f91c35c1e967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ded9ca1dbff404c8bb26f48b4e26168)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:36.776638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189111d-dec5-4db1-9f3f-f91c35c1e967 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:36.930044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:37.042280 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1189111d-dec5-4db1-9f3f-f91c35c1e967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ded9ca1dbff404c8bb26f48b4e26168', 'request_id': 'req-1189111d-dec5-4db1-9f3f-f91c35c1e967'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:37.047780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1189111d-dec5-4db1-9f3f-f91c35c1e967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ded9ca1dbff404c8bb26f48b4e26168', 'request_id': 'req-1189111d-dec5-4db1-9f3f-f91c35c1e967'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:37.061259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1189111d-dec5-4db1-9f3f-f91c35c1e967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ded9ca1dbff404c8bb26f48b4e26168', 'request_id': 'req-1189111d-dec5-4db1-9f3f-f91c35c1e967'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:37.223580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:37.282977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1189111d-dec5-4db1-9f3f-f91c35c1e967 admin admin] The token cache is being invalidate because project 4ded9ca1dbff404c8bb26f48b4e26168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:37.282977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1189111d-dec5-4db1-9f3f-f91c35c1e967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:37.282977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1189111d-dec5-4db1-9f3f-f91c35c1e967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:37.286338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1107/2238] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:36 2022] DELETE /identity/v3/projects/4ded9ca1dbff404c8bb26f48b4e26168 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:37.291806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524df33-b1cd-4c7a-8961-bad9206e77d0 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:37.292173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524df33-b1cd-4c7a-8961-bad9206e77d0 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:37.292377 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524df33-b1cd-4c7a-8961-bad9206e77d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:37.319952 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-4524df33-b1cd-4c7a-8961-bad9206e77d0 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:37.328946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4524df33-b1cd-4c7a-8961-bad9206e77d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:37.423517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1132/2239] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:37.433148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04188817-8741-444a-bf5f-93e7f38fdf5e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:37.433615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04188817-8741-444a-bf5f-93e7f38fdf5e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:37.434931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04188817-8741-444a-bf5f-93e7f38fdf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:37.475838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-04188817-8741-444a-bf5f-93e7f38fdf5e None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:37.477306 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-04188817-8741-444a-bf5f-93e7f38fdf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:37.486402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1108/2240] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:37.494883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524df33-b1cd-4c7a-8961-bad9206e77d0 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:37.520126 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524df33-b1cd-4c7a-8961-bad9206e77d0 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:37.533241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e8147-b00d-4d98-b64e-600e01939584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:37.535348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e8147-b00d-4d98-b64e-600e01939584 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:37.536119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e8147-b00d-4d98-b64e-600e01939584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:37.537120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e8147-b00d-4d98-b64e-600e01939584 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:37.538675 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e8147-b00d-4d98-b64e-600e01939584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:22:37.539410 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e8147-b00d-4d98-b64e-600e01939584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:37.541837 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e8147-b00d-4d98-b64e-600e01939584 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:37.572178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1133/2241] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:22:37.578772 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04188817-8741-444a-bf5f-93e7f38fdf5e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:37.595487 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04188817-8741-444a-bf5f-93e7f38fdf5e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:37.597714 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c4a41-082f-4ef1-ac4b-2aac4cd0390f None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:37.598190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c4a41-082f-4ef1-ac4b-2aac4cd0390f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:37.599030 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c4a41-082f-4ef1-ac4b-2aac4cd0390f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:37.603791 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5022b-c903-458e-b1c3-9067113f0df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:37.604430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5022b-c903-458e-b1c3-9067113f0df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:37.604787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5022b-c903-458e-b1c3-9067113f0df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:37.604975 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5022b-c903-458e-b1c3-9067113f0df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:37.605672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5022b-c903-458e-b1c3-9067113f0df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:37.608284 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5022b-c903-458e-b1c3-9067113f0df3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:37.668196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d93c4a41-082f-4ef1-ac4b-2aac4cd0390f None None] MFA Rules not processed for user `d8a260d24b67412982e0d79165b20d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:37.677178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d93c4a41-082f-4ef1-ac4b-2aac4cd0390f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:37.747700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1109/2242] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:37 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:37.754923 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5022b-c903-458e-b1c3-9067113f0df3 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:37.892451 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1134/2243] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:37.905505 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbd0c9-8bcf-4c0f-9e25-18717e40641e None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:37.905505 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbd0c9-8bcf-4c0f-9e25-18717e40641e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:37.905808 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbd0c9-8bcf-4c0f-9e25-18717e40641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:37.913633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:37.915211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5022b-c903-458e-b1c3-9067113f0df3 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:37.924329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb1faf-6c63-4f66-8dcc-36cbc26b8a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:37.926025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb1faf-6c63-4f66-8dcc-36cbc26b8a24 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:37.926545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb1faf-6c63-4f66-8dcc-36cbc26b8a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:37.927037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb1faf-6c63-4f66-8dcc-36cbc26b8a24 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:37.928301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb1faf-6c63-4f66-8dcc-36cbc26b8a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:37.931640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-04cbd0c9-8bcf-4c0f-9e25-18717e40641e None None] MFA Rules not processed for user `7d2ac4abe7f04f7e861157588e42485c`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:37.932375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb1faf-6c63-4f66-8dcc-36cbc26b8a24 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:37.936278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-04cbd0c9-8bcf-4c0f-9e25-18717e40641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:38.018402 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1135/2244] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:38.027456 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbd0c9-8bcf-4c0f-9e25-18717e40641e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:38.031687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-04cbd0c9-8bcf-4c0f-9e25-18717e40641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:38.130680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1110/2245] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:37 2022] POST /identity/v3/users => generated 291 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:38.144490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb1faf-6c63-4f66-8dcc-36cbc26b8a24 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:38.161661 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb1faf-6c63-4f66-8dcc-36cbc26b8a24 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:38.178220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbd0c9-8bcf-4c0f-9e25-18717e40641e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:38.183272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4914a59-6754-43ef-bec0-16ab21ed7ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:38.184064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4914a59-6754-43ef-bec0-16ab21ed7ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:38.184336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4914a59-6754-43ef-bec0-16ab21ed7ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:38.184604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4914a59-6754-43ef-bec0-16ab21ed7ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:38.185347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4914a59-6754-43ef-bec0-16ab21ed7ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:38.185521 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9b5cf-5244-4bbd-ad8a-32d6325c19b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:38.186185 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9b5cf-5244-4bbd-ad8a-32d6325c19b2 service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:38.186518 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9b5cf-5244-4bbd-ad8a-32d6325c19b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:38.186818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9b5cf-5244-4bbd-ad8a-32d6325c19b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:38.187173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4914a59-6754-43ef-bec0-16ab21ed7ad0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:38.189030 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-abe9b5cf-5244-4bbd-ad8a-32d6325c19b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:38.202682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9b5cf-5244-4bbd-ad8a-32d6325c19b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:38.203613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1111/2246] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:38.204342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9b5cf-5244-4bbd-ad8a-32d6325c19b2 service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:38.209896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4914a59-6754-43ef-bec0-16ab21ed7ad0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:38.217259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1136/2247] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:22:38.227658 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4914a59-6754-43ef-bec0-16ab21ed7ad0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:38.234447 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebbc00-1561-4769-b923-58df45748f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:38.235111 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebbc00-1561-4769-b923-58df45748f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:38.235392 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebbc00-1561-4769-b923-58df45748f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:38.235675 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebbc00-1561-4769-b923-58df45748f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:38.236594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebbc00-1561-4769-b923-58df45748f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:38.239049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebbc00-1561-4769-b923-58df45748f43 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:38.279908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1112/2248] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:38.281614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9b5cf-5244-4bbd-ad8a-32d6325c19b2 service nova] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:38.306403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9b5cf-5244-4bbd-ad8a-32d6325c19b2 service nova] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:38.329542 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da81a7-1405-4d82-af53-60978dc0a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:38.335841 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da81a7-1405-4d82-af53-60978dc0a6df admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:38.335841 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da81a7-1405-4d82-af53-60978dc0a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:38.335841 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da81a7-1405-4d82-af53-60978dc0a6df admin admin] PATH_INFO: `/v3/projects/97335e14614644a6b99794c30c36ab7f/users/19ebc809e0cf48559e5e1e9f577dfba9/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:38.370430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da81a7-1405-4d82-af53-60978dc0a6df admin admin] RBAC: Authorizing `identity:create_grant(project_id=97335e14614644a6b99794c30c36ab7f, user_id=19ebc809e0cf48559e5e1e9f577dfba9, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:38.376295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da81a7-1405-4d82-af53-60978dc0a6df admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:38.488731 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1137/2249] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:38 2022] PUT /identity/v3/projects/97335e14614644a6b99794c30c36ab7f/users/19ebc809e0cf48559e5e1e9f577dfba9/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:22:38.509158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2399d4-4eae-4526-af3a-08740895274f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:38.509621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2399d4-4eae-4526-af3a-08740895274f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:38.510094 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2399d4-4eae-4526-af3a-08740895274f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:38.564216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-6c2399d4-4eae-4526-af3a-08740895274f None None] MFA Rules not processed for user `19ebc809e0cf48559e5e1e9f577dfba9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:38.566540 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6c2399d4-4eae-4526-af3a-08740895274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:38.635780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:38.696589 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1113/2250] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:38.702258 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da81a7-1405-4d82-af53-60978dc0a6df admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:38.805360 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da81a7-1405-4d82-af53-60978dc0a6df admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:38.810479 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1b810-f065-47fc-ae30-da83f6df811f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:38.811314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1b810-f065-47fc-ae30-da83f6df811f admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:38.811560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1b810-f065-47fc-ae30-da83f6df811f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:38.811894 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1b810-f065-47fc-ae30-da83f6df811f admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:38.812542 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1b810-f065-47fc-ae30-da83f6df811f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:38.814802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1b810-f065-47fc-ae30-da83f6df811f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:38.862423 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:39.016812 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1138/2251] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:38 2022] POST /identity/v3/projects => generated 379 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:22:39.019112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2399d4-4eae-4526-af3a-08740895274f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:39.038720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2399d4-4eae-4526-af3a-08740895274f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:39.151118 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13b747-fb0b-46ea-8e06-f97e24123a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:39.152655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b747-fb0b-46ea-8e06-f97e24123a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:39.153508 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b747-fb0b-46ea-8e06-f97e24123a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:39.154078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b747-fb0b-46ea-8e06-f97e24123a0e admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:39.155764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13b747-fb0b-46ea-8e06-f97e24123a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:39.160450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13b747-fb0b-46ea-8e06-f97e24123a0e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:39.272606 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1114/2252] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:39 2022] POST /identity/v3/users => generated 296 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:22:39.279144 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1b810-f065-47fc-ae30-da83f6df811f admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:39.299417 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1b810-f065-47fc-ae30-da83f6df811f admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:39.309032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24abc03-1f87-45e9-920d-62f296bdd12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:39.310234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24abc03-1f87-45e9-920d-62f296bdd12b admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:39.310857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24abc03-1f87-45e9-920d-62f296bdd12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:39.311436 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24abc03-1f87-45e9-920d-62f296bdd12b admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:39.312773 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24abc03-1f87-45e9-920d-62f296bdd12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:39.316627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24abc03-1f87-45e9-920d-62f296bdd12b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:39.339324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1139/2253] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:39.347452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13b747-fb0b-46ea-8e06-f97e24123a0e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:39.400901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13b747-fb0b-46ea-8e06-f97e24123a0e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:39.410823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e3c54-e0aa-488b-93a1-598f4e457b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:39.411757 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e3c54-e0aa-488b-93a1-598f4e457b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:39.412260 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e3c54-e0aa-488b-93a1-598f4e457b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:39.412743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e3c54-e0aa-488b-93a1-598f4e457b64 admin admin] PATH_INFO: `/v3/projects/2289c3809e73409f94cd794a4ff317ca/users/ff5745977ef4463483c36fe8f12084ed/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:39.459299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e3c54-e0aa-488b-93a1-598f4e457b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2289c3809e73409f94cd794a4ff317ca, user_id=ff5745977ef4463483c36fe8f12084ed, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:39.464327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e3c54-e0aa-488b-93a1-598f4e457b64 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:39.603395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1115/2254] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:39 2022] PUT /identity/v3/projects/2289c3809e73409f94cd794a4ff317ca/users/ff5745977ef4463483c36fe8f12084ed/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:22:39.607543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24abc03-1f87-45e9-920d-62f296bdd12b admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:39.633783 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24abc03-1f87-45e9-920d-62f296bdd12b admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:39.911534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9355c-2657-40d7-b791-31e29a31d102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:39.912597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9355c-2657-40d7-b791-31e29a31d102 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:39.913256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9355c-2657-40d7-b791-31e29a31d102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:39.913731 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9355c-2657-40d7-b791-31e29a31d102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:39.918870 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9355c-2657-40d7-b791-31e29a31d102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:39.926589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9355c-2657-40d7-b791-31e29a31d102 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:40.020273 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1140/2255] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:22:40.025279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e3c54-e0aa-488b-93a1-598f4e457b64 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:40.050960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e3c54-e0aa-488b-93a1-598f4e457b64 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:40.093720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d463471-e61a-4f9f-9308-dc2a1024a165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:40.095052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d463471-e61a-4f9f-9308-dc2a1024a165 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:40.095849 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d463471-e61a-4f9f-9308-dc2a1024a165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:40.096860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d463471-e61a-4f9f-9308-dc2a1024a165 admin admin] PATH_INFO: `/v3/projects/2289c3809e73409f94cd794a4ff317ca/users/ff5745977ef4463483c36fe8f12084ed/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:40.100893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d463471-e61a-4f9f-9308-dc2a1024a165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2289c3809e73409f94cd794a4ff317ca, user_id=ff5745977ef4463483c36fe8f12084ed, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:40.105895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d463471-e61a-4f9f-9308-dc2a1024a165 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:40.126340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1116/2256] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:40 2022] PUT /identity/v3/projects/2289c3809e73409f94cd794a4ff317ca/users/ff5745977ef4463483c36fe8f12084ed/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:22:40.146217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41997bf6-f6d2-4d0e-be28-1bbdc98cf28b None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:40.146807 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41997bf6-f6d2-4d0e-be28-1bbdc98cf28b None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:40.147311 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41997bf6-f6d2-4d0e-be28-1bbdc98cf28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:40.191852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-41997bf6-f6d2-4d0e-be28-1bbdc98cf28b None None] MFA Rules not processed for user `ff5745977ef4463483c36fe8f12084ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:40.195147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-41997bf6-f6d2-4d0e-be28-1bbdc98cf28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:40.318566 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1141/2257] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:40.331993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d463471-e61a-4f9f-9308-dc2a1024a165 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:40.334237 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7d463471-e61a-4f9f-9308-dc2a1024a165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:40.337677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:40.487390 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d463471-e61a-4f9f-9308-dc2a1024a165 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:40.495299 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03490054-9c74-4136-8925-0d49a4e76ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:40.496378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03490054-9c74-4136-8925-0d49a4e76ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:40.496840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03490054-9c74-4136-8925-0d49a4e76ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:40.497326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03490054-9c74-4136-8925-0d49a4e76ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:40.535156 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:40.549459 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03490054-9c74-4136-8925-0d49a4e76ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:40.549459 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03490054-9c74-4136-8925-0d49a4e76ed6 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:40.561209 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1117/2258] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:40.791368 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41997bf6-f6d2-4d0e-be28-1bbdc98cf28b None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:40.806956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41997bf6-f6d2-4d0e-be28-1bbdc98cf28b None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:40.813048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fccc2f-9b16-477c-a662-32213e6a63cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:40.813970 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fccc2f-9b16-477c-a662-32213e6a63cd service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:40.814508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fccc2f-9b16-477c-a662-32213e6a63cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:40.814958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fccc2f-9b16-477c-a662-32213e6a63cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:41.024196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fccc2f-9b16-477c-a662-32213e6a63cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:41.032730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fccc2f-9b16-477c-a662-32213e6a63cd service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:41.075230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1142/2259] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:41.963123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03490054-9c74-4136-8925-0d49a4e76ed6 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:42.074497 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03490054-9c74-4136-8925-0d49a4e76ed6 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:42.091239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b496da-e213-4ba2-b515-84464128ba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:42.091239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b496da-e213-4ba2-b515-84464128ba54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:42.091239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b496da-e213-4ba2-b515-84464128ba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:42.091239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b496da-e213-4ba2-b515-84464128ba54 admin admin] PATH_INFO: `/v3/users/19ebc809e0cf48559e5e1e9f577dfba9` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:42.095686 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b496da-e213-4ba2-b515-84464128ba54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ebc809e0cf48559e5e1e9f577dfba9)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:42.098114 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b496da-e213-4ba2-b515-84464128ba54 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:42.128088 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:42.304378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:42.369401 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-f7b496da-e213-4ba2-b515-84464128ba54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ebc809e0cf48559e5e1e9f577dfba9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:42.370721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-f7b496da-e213-4ba2-b515-84464128ba54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ebc809e0cf48559e5e1e9f577dfba9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:42.401281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-f7b496da-e213-4ba2-b515-84464128ba54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ebc809e0cf48559e5e1e9f577dfba9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:42.402829 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-f7b496da-e213-4ba2-b515-84464128ba54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ebc809e0cf48559e5e1e9f577dfba9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:42.612732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-f7b496da-e213-4ba2-b515-84464128ba54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ebc809e0cf48559e5e1e9f577dfba9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:42.634581 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1118/2260] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:41 2022] DELETE /identity/v3/users/19ebc809e0cf48559e5e1e9f577dfba9 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:42.641154 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002df8f3-6033-443d-9439-3b6593ec0a99 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:42.642535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002df8f3-6033-443d-9439-3b6593ec0a99 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:42.644011 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002df8f3-6033-443d-9439-3b6593ec0a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:42.684900 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-002df8f3-6033-443d-9439-3b6593ec0a99 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:42.687351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-002df8f3-6033-443d-9439-3b6593ec0a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:42.858336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1143/2261] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:42.877439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b496da-e213-4ba2-b515-84464128ba54 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:42.880858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f7b496da-e213-4ba2-b515-84464128ba54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:43.034833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b496da-e213-4ba2-b515-84464128ba54 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:43.042850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62963d6-44fe-427f-91d1-f064ce2e4077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:43.045152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62963d6-44fe-427f-91d1-f064ce2e4077 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:43.046039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62963d6-44fe-427f-91d1-f064ce2e4077 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:43.046788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62963d6-44fe-427f-91d1-f064ce2e4077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:43.068498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62963d6-44fe-427f-91d1-f064ce2e4077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:43.071694 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62963d6-44fe-427f-91d1-f064ce2e4077 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:43.100932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1119/2262] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:43.761163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002df8f3-6033-443d-9439-3b6593ec0a99 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:43.766535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-002df8f3-6033-443d-9439-3b6593ec0a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:43.793167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002df8f3-6033-443d-9439-3b6593ec0a99 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:43.803916 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:43.804974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:43.805441 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:43.805899 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1 admin admin] PATH_INFO: `/v3/projects/97335e14614644a6b99794c30c36ab7f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:43.808143 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97335e14614644a6b99794c30c36ab7f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:43.811862 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:43.886595 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:43.992863 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97335e14614644a6b99794c30c36ab7f', 'request_id': 'req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:44.085512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97335e14614644a6b99794c30c36ab7f', 'request_id': 'req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:44.098439 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97335e14614644a6b99794c30c36ab7f', 'request_id': 'req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:44.098651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:44.119809 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1 admin admin] The token cache is being invalidate because project 97335e14614644a6b99794c30c36ab7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:44.120383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:44.121352 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:44.123055 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1144/2263] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:43 2022] DELETE /identity/v3/projects/97335e14614644a6b99794c30c36ab7f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:44.128130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62963d6-44fe-427f-91d1-f064ce2e4077 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:44.142577 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62963d6-44fe-427f-91d1-f064ce2e4077 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:44.221105 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa263a3-063c-4beb-8eeb-e7a65d526ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:44.221859 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa263a3-063c-4beb-8eeb-e7a65d526ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:44.222192 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa263a3-063c-4beb-8eeb-e7a65d526ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:44.222593 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa263a3-063c-4beb-8eeb-e7a65d526ffe admin admin] PATH_INFO: `/v3/users/ff5745977ef4463483c36fe8f12084ed` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:44.223980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa263a3-063c-4beb-8eeb-e7a65d526ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff5745977ef4463483c36fe8f12084ed)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:44.226461 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa263a3-063c-4beb-8eeb-e7a65d526ffe admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:44.472332 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-caa263a3-063c-4beb-8eeb-e7a65d526ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff5745977ef4463483c36fe8f12084ed'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:44.473249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-caa263a3-063c-4beb-8eeb-e7a65d526ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff5745977ef4463483c36fe8f12084ed'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:44.495428 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-caa263a3-063c-4beb-8eeb-e7a65d526ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff5745977ef4463483c36fe8f12084ed'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:44.496375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-caa263a3-063c-4beb-8eeb-e7a65d526ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff5745977ef4463483c36fe8f12084ed'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:44.675233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-caa263a3-063c-4beb-8eeb-e7a65d526ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff5745977ef4463483c36fe8f12084ed'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:44.690140 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1120/2264] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:44 2022] DELETE /identity/v3/users/ff5745977ef4463483c36fe8f12084ed => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:22:45.482426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:45.579236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:45.897695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:45.900326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:45.985769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fed02-77f8-4ea7-abbf-f375d3e9e3e1 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:46.135150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763e218-af6e-492a-af42-44103c6cf9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:46.135861 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763e218-af6e-492a-af42-44103c6cf9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:46.136593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763e218-af6e-492a-af42-44103c6cf9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:46.137103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763e218-af6e-492a-af42-44103c6cf9d7 admin admin] PATH_INFO: `/v3/projects/2289c3809e73409f94cd794a4ff317ca` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:46.143610 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763e218-af6e-492a-af42-44103c6cf9d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2289c3809e73409f94cd794a4ff317ca)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:46.143610 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763e218-af6e-492a-af42-44103c6cf9d7 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:46.328005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4763e218-af6e-492a-af42-44103c6cf9d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2289c3809e73409f94cd794a4ff317ca', 'request_id': 'req-4763e218-af6e-492a-af42-44103c6cf9d7'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:46.488450 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4763e218-af6e-492a-af42-44103c6cf9d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2289c3809e73409f94cd794a4ff317ca', 'request_id': 'req-4763e218-af6e-492a-af42-44103c6cf9d7'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:46.501716 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4763e218-af6e-492a-af42-44103c6cf9d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2289c3809e73409f94cd794a4ff317ca', 'request_id': 'req-4763e218-af6e-492a-af42-44103c6cf9d7'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:46.526517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4763e218-af6e-492a-af42-44103c6cf9d7 admin admin] The token cache is being invalidate because project 2289c3809e73409f94cd794a4ff317ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:46.527198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4763e218-af6e-492a-af42-44103c6cf9d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:46.528353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4763e218-af6e-492a-af42-44103c6cf9d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:46.531131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1145/2265] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:45 2022] DELETE /identity/v3/projects/2289c3809e73409f94cd794a4ff317ca => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:22:46.538124 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c35fe8-ed09-42c6-be3f-a32693f7344f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:46.538836 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c35fe8-ed09-42c6-be3f-a32693f7344f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:46.539425 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c35fe8-ed09-42c6-be3f-a32693f7344f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:46.614000 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-45c35fe8-ed09-42c6-be3f-a32693f7344f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:46.619382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-45c35fe8-ed09-42c6-be3f-a32693f7344f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:46.786398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1121/2266] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:46.796547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b728d11-3e2f-4bbb-92fe-48e1aa0b45a4 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:46.797336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b728d11-3e2f-4bbb-92fe-48e1aa0b45a4 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:46.798102 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b728d11-3e2f-4bbb-92fe-48e1aa0b45a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:46.852555 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-7b728d11-3e2f-4bbb-92fe-48e1aa0b45a4 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:46.853981 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7b728d11-3e2f-4bbb-92fe-48e1aa0b45a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:46.879045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1146/2267] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:46.881019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c35fe8-ed09-42c6-be3f-a32693f7344f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:46.909601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c35fe8-ed09-42c6-be3f-a32693f7344f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:46.921932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a271cef-d615-459c-b6e9-d966d05c574e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:46.923061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a271cef-d615-459c-b6e9-d966d05c574e admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:46.923579 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a271cef-d615-459c-b6e9-d966d05c574e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:46.924953 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a271cef-d615-459c-b6e9-d966d05c574e admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:46.926375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a271cef-d615-459c-b6e9-d966d05c574e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:22:46.926949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a271cef-d615-459c-b6e9-d966d05c574e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:46.930497 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a271cef-d615-459c-b6e9-d966d05c574e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:46.955178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1122/2268] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:22:46.959628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b728d11-3e2f-4bbb-92fe-48e1aa0b45a4 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:46.970209 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b728d11-3e2f-4bbb-92fe-48e1aa0b45a4 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:46.977238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540b005-556d-4961-b917-4a5098b11212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:46.977887 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540b005-556d-4961-b917-4a5098b11212 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:46.978173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540b005-556d-4961-b917-4a5098b11212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:46.978481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540b005-556d-4961-b917-4a5098b11212 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:46.979168 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540b005-556d-4961-b917-4a5098b11212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:46.981119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540b005-556d-4961-b917-4a5098b11212 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:47.087351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:47.102472 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1147/2269] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:46 2022] POST /identity/v3/projects => generated 359 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:47.104561 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a271cef-d615-459c-b6e9-d966d05c574e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:47.120812 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a271cef-d615-459c-b6e9-d966d05c574e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:47.212887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd47f3-a161-4bb6-b812-6f5c988edf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:47.213568 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd47f3-a161-4bb6-b812-6f5c988edf8c admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:47.213840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd47f3-a161-4bb6-b812-6f5c988edf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:47.214154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd47f3-a161-4bb6-b812-6f5c988edf8c admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:47.214907 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd47f3-a161-4bb6-b812-6f5c988edf8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:47.217371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd47f3-a161-4bb6-b812-6f5c988edf8c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:47.332937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1123/2270] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:47 2022] POST /identity/v3/users => generated 280 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:47.338399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540b005-556d-4961-b917-4a5098b11212 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:47.353112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540b005-556d-4961-b917-4a5098b11212 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:47.358844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56882c-affb-4f52-a70b-e0995da4fbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:47.359555 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56882c-affb-4f52-a70b-e0995da4fbbb admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:47.359844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56882c-affb-4f52-a70b-e0995da4fbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:47.360123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56882c-affb-4f52-a70b-e0995da4fbbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:47.361756 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56882c-affb-4f52-a70b-e0995da4fbbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:47.364262 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56882c-affb-4f52-a70b-e0995da4fbbb admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:47.377666 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1148/2271] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:47.382104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd47f3-a161-4bb6-b812-6f5c988edf8c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:47.396165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd47f3-a161-4bb6-b812-6f5c988edf8c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:47.402309 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74841a-9b2c-4d9d-b372-4f56300bfc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:47.402996 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74841a-9b2c-4d9d-b372-4f56300bfc2d admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:47.403337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74841a-9b2c-4d9d-b372-4f56300bfc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:47.404105 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74841a-9b2c-4d9d-b372-4f56300bfc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:47.404799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74841a-9b2c-4d9d-b372-4f56300bfc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:47.406802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74841a-9b2c-4d9d-b372-4f56300bfc2d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:47.421029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1124/2272] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:47.432705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56882c-affb-4f52-a70b-e0995da4fbbb admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:47.446703 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56882c-affb-4f52-a70b-e0995da4fbbb admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:47.453406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b4087-2d83-4797-a6fa-1d31840fbe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:47.454657 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b4087-2d83-4797-a6fa-1d31840fbe9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:47.455038 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b4087-2d83-4797-a6fa-1d31840fbe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:47.457408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b4087-2d83-4797-a6fa-1d31840fbe9b admin admin] PATH_INFO: `/v3/projects/8a3f6fd84c45460db45d4335f0b9c956/users/5adc5a1f79344b60b9b38e614bbca45a/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:47.489874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b4087-2d83-4797-a6fa-1d31840fbe9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3f6fd84c45460db45d4335f0b9c956, user_id=5adc5a1f79344b60b9b38e614bbca45a, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:47.496584 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b4087-2d83-4797-a6fa-1d31840fbe9b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:47.630381 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1149/2273] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:47 2022] PUT /identity/v3/projects/8a3f6fd84c45460db45d4335f0b9c956/users/5adc5a1f79344b60b9b38e614bbca45a/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:47.652938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709df15-b3ef-46fa-803c-5b193400df3e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:47.655326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709df15-b3ef-46fa-803c-5b193400df3e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:47.656274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709df15-b3ef-46fa-803c-5b193400df3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:47.732744 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:47.756881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2709df15-b3ef-46fa-803c-5b193400df3e None None] MFA Rules not processed for user `5adc5a1f79344b60b9b38e614bbca45a`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:47.759859 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2709df15-b3ef-46fa-803c-5b193400df3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:47.778212 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b4087-2d83-4797-a6fa-1d31840fbe9b admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:47.781487 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6f2b4087-2d83-4797-a6fa-1d31840fbe9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:47.946965 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1125/2274] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:47 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:47.964864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b4087-2d83-4797-a6fa-1d31840fbe9b admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:47.975180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86a002-6600-4a08-8cb2-d1605bc3b8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:47.976660 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a002-6600-4a08-8cb2-d1605bc3b8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:47.977491 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a002-6600-4a08-8cb2-d1605bc3b8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:47.978278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a002-6600-4a08-8cb2-d1605bc3b8a7 admin admin] PATH_INFO: `/v3/users/d3256fdf955646dca981ff879a7ba3cc` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:47.981073 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86a002-6600-4a08-8cb2-d1605bc3b8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3256fdf955646dca981ff879a7ba3cc)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:47.985419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86a002-6600-4a08-8cb2-d1605bc3b8a7 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:48.029899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709df15-b3ef-46fa-803c-5b193400df3e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:48.039591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2709df15-b3ef-46fa-803c-5b193400df3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:48.091376 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:48.196523 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709df15-b3ef-46fa-803c-5b193400df3e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:48.202721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4079b-52a8-4ab3-b04f-13512c089b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:48.203808 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4079b-52a8-4ab3-b04f-13512c089b12 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:48.204220 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4079b-52a8-4ab3-b04f-13512c089b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:48.204753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4079b-52a8-4ab3-b04f-13512c089b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:48.222804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4079b-52a8-4ab3-b04f-13512c089b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:48.224758 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4079b-52a8-4ab3-b04f-13512c089b12 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:48.242949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1126/2275] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:48 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:22:48.286700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4079b-52a8-4ab3-b04f-13512c089b12 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:48.303983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4079b-52a8-4ab3-b04f-13512c089b12 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:48.311468 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49814363-fe9d-4d70-913d-853c851b3c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:48.312948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49814363-fe9d-4d70-913d-853c851b3c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:48.313434 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49814363-fe9d-4d70-913d-853c851b3c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:48.313926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49814363-fe9d-4d70-913d-853c851b3c78 admin admin] PATH_INFO: `/v3/users/5adc5a1f79344b60b9b38e614bbca45a` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:48.317056 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49814363-fe9d-4d70-913d-853c851b3c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5adc5a1f79344b60b9b38e614bbca45a)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:48.319671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49814363-fe9d-4d70-913d-853c851b3c78 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:48.328590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ac86a002-6600-4a08-8cb2-d1605bc3b8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3256fdf955646dca981ff879a7ba3cc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:48.332722 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ac86a002-6600-4a08-8cb2-d1605bc3b8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3256fdf955646dca981ff879a7ba3cc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:48.376876 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ac86a002-6600-4a08-8cb2-d1605bc3b8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3256fdf955646dca981ff879a7ba3cc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:48.514718 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ac86a002-6600-4a08-8cb2-d1605bc3b8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3256fdf955646dca981ff879a7ba3cc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:48.516330 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-ac86a002-6600-4a08-8cb2-d1605bc3b8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3256fdf955646dca981ff879a7ba3cc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:48.532187 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1150/2276] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:47 2022] DELETE /identity/v3/users/d3256fdf955646dca981ff879a7ba3cc => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:22:48.537591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ba0ac-e6c6-4c67-ae07-be3b1d67b129 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:48.537987 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ba0ac-e6c6-4c67-ae07-be3b1d67b129 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:48.538278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ba0ac-e6c6-4c67-ae07-be3b1d67b129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:48.575077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-3e7ba0ac-e6c6-4c67-ae07-be3b1d67b129 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:48.576875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3e7ba0ac-e6c6-4c67-ae07-be3b1d67b129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:48.593655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-49814363-fe9d-4d70-913d-853c851b3c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5adc5a1f79344b60b9b38e614bbca45a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:48.595581 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-49814363-fe9d-4d70-913d-853c851b3c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5adc5a1f79344b60b9b38e614bbca45a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:48.627437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-49814363-fe9d-4d70-913d-853c851b3c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5adc5a1f79344b60b9b38e614bbca45a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:48.628862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-49814363-fe9d-4d70-913d-853c851b3c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5adc5a1f79344b60b9b38e614bbca45a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:48.669238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1151/2277] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:48.685111 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ba0ac-e6c6-4c67-ae07-be3b1d67b129 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:48.686864 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3e7ba0ac-e6c6-4c67-ae07-be3b1d67b129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:48.714832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-49814363-fe9d-4d70-913d-853c851b3c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5adc5a1f79344b60b9b38e614bbca45a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:48.747499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1127/2278] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:48 2022] DELETE /identity/v3/users/5adc5a1f79344b60b9b38e614bbca45a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:48.752939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e366c8-378b-4c6c-88fb-8c4818d5a546 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:48.753410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e366c8-378b-4c6c-88fb-8c4818d5a546 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:48.753966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e366c8-378b-4c6c-88fb-8c4818d5a546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:48.797024 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-68e366c8-378b-4c6c-88fb-8c4818d5a546 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:48.799456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-68e366c8-378b-4c6c-88fb-8c4818d5a546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:48.803290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ba0ac-e6c6-4c67-ae07-be3b1d67b129 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:48.901007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c7648-c21a-4834-b9f7-ddf7f05bc891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:48.901828 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c7648-c21a-4834-b9f7-ddf7f05bc891 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:48.902002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c7648-c21a-4834-b9f7-ddf7f05bc891 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:48.902548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c7648-c21a-4834-b9f7-ddf7f05bc891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:48.986236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1128/2279] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:22:49.001583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e366c8-378b-4c6c-88fb-8c4818d5a546 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:49.023153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e366c8-378b-4c6c-88fb-8c4818d5a546 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:49.034869 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b71a03-dc6a-467f-9c89-cdfdec4929cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:49.035794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b71a03-dc6a-467f-9c89-cdfdec4929cb service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:49.037523 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b71a03-dc6a-467f-9c89-cdfdec4929cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:49.037979 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b71a03-dc6a-467f-9c89-cdfdec4929cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:49.065395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b71a03-dc6a-467f-9c89-cdfdec4929cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:49.067619 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b71a03-dc6a-467f-9c89-cdfdec4929cb service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:49.093950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1129/2280] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:49.123386 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c7648-c21a-4834-b9f7-ddf7f05bc891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:49.127945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c7648-c21a-4834-b9f7-ddf7f05bc891 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:49.151979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1152/2281] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:49.239902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:49.478596 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b71a03-dc6a-467f-9c89-cdfdec4929cb service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:49.481521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a2b71a03-dc6a-467f-9c89-cdfdec4929cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:49.517994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b71a03-dc6a-467f-9c89-cdfdec4929cb service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:49.523865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bef85-9cd3-4783-8635-d9ecbbf738dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:49.524553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bef85-9cd3-4783-8635-d9ecbbf738dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:49.524851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bef85-9cd3-4783-8635-d9ecbbf738dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:49.525133 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bef85-9cd3-4783-8635-d9ecbbf738dc admin admin] PATH_INFO: `/v3/users/bf25d296b8cc49049e25913f65c9036f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:49.526579 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bef85-9cd3-4783-8635-d9ecbbf738dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf25d296b8cc49049e25913f65c9036f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:49.528612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bef85-9cd3-4783-8635-d9ecbbf738dc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:49.561982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:49.966280 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-867bef85-9cd3-4783-8635-d9ecbbf738dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf25d296b8cc49049e25913f65c9036f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:49.967710 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-867bef85-9cd3-4783-8635-d9ecbbf738dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf25d296b8cc49049e25913f65c9036f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:49.968600 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb86e-2e11-487d-aa31-1404ad325945 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:49.969085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb86e-2e11-487d-aa31-1404ad325945 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:49.969571 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb86e-2e11-487d-aa31-1404ad325945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:50.020066 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-867bef85-9cd3-4783-8635-d9ecbbf738dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf25d296b8cc49049e25913f65c9036f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:50.021063 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-867bef85-9cd3-4783-8635-d9ecbbf738dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf25d296b8cc49049e25913f65c9036f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:50.033715 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b17fb86e-2e11-487d-aa31-1404ad325945 None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:50.036158 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b17fb86e-2e11-487d-aa31-1404ad325945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:50.131173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-867bef85-9cd3-4783-8635-d9ecbbf738dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf25d296b8cc49049e25913f65c9036f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:50.175535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1130/2282] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:22:49 2022] DELETE /identity/v3/users/bf25d296b8cc49049e25913f65c9036f => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:50.178021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bef85-9cd3-4783-8635-d9ecbbf738dc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:50.183690 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-867bef85-9cd3-4783-8635-d9ecbbf738dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:50.186148 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1153/2283] 10.222.0.98 () {58 vars in 1009 bytes} [Tue Jul 26 15:22:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:50.188895 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb86e-2e11-487d-aa31-1404ad325945 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:50.194017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b17fb86e-2e11-487d-aa31-1404ad325945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:50.234980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb86e-2e11-487d-aa31-1404ad325945 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:50.371551 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b75feb-0f55-4a18-b9eb-3441fdb63b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:50.372607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b75feb-0f55-4a18-b9eb-3441fdb63b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:50.373221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b75feb-0f55-4a18-b9eb-3441fdb63b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:50.373589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b75feb-0f55-4a18-b9eb-3441fdb63b60 admin admin] PATH_INFO: `/v3/projects/8a3f6fd84c45460db45d4335f0b9c956` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:50.375134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b75feb-0f55-4a18-b9eb-3441fdb63b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a3f6fd84c45460db45d4335f0b9c956)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:50.379892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b75feb-0f55-4a18-b9eb-3441fdb63b60 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:50.384481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bef85-9cd3-4783-8635-d9ecbbf738dc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:50.405344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246db5e-74e4-4fc4-b407-d423e36aa170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:50.409518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246db5e-74e4-4fc4-b407-d423e36aa170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:50.410036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246db5e-74e4-4fc4-b407-d423e36aa170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:50.411059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246db5e-74e4-4fc4-b407-d423e36aa170 admin admin] PATH_INFO: `/v3/projects/65f36ebf1ef44f5d9456d7725ace34db` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:50.414943 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246db5e-74e4-4fc4-b407-d423e36aa170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f36ebf1ef44f5d9456d7725ace34db)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:50.421310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246db5e-74e4-4fc4-b407-d423e36aa170 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:50.534603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-36b75feb-0f55-4a18-b9eb-3441fdb63b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a3f6fd84c45460db45d4335f0b9c956', 'request_id': 'req-36b75feb-0f55-4a18-b9eb-3441fdb63b60'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:50.629661 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6246db5e-74e4-4fc4-b407-d423e36aa170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f36ebf1ef44f5d9456d7725ace34db', 'request_id': 'req-6246db5e-74e4-4fc4-b407-d423e36aa170'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:50.643957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6246db5e-74e4-4fc4-b407-d423e36aa170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f36ebf1ef44f5d9456d7725ace34db', 'request_id': 'req-6246db5e-74e4-4fc4-b407-d423e36aa170'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:50.657226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6246db5e-74e4-4fc4-b407-d423e36aa170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f36ebf1ef44f5d9456d7725ace34db', 'request_id': 'req-6246db5e-74e4-4fc4-b407-d423e36aa170'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:50.681683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-36b75feb-0f55-4a18-b9eb-3441fdb63b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a3f6fd84c45460db45d4335f0b9c956', 'request_id': 'req-36b75feb-0f55-4a18-b9eb-3441fdb63b60'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:50.713534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-36b75feb-0f55-4a18-b9eb-3441fdb63b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a3f6fd84c45460db45d4335f0b9c956', 'request_id': 'req-36b75feb-0f55-4a18-b9eb-3441fdb63b60'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:50.745936 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-36b75feb-0f55-4a18-b9eb-3441fdb63b60 admin admin] The token cache is being invalidate because project 8a3f6fd84c45460db45d4335f0b9c956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:50.746455 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-36b75feb-0f55-4a18-b9eb-3441fdb63b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:50.747585 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-36b75feb-0f55-4a18-b9eb-3441fdb63b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:50.749495 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1154/2284] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:50 2022] DELETE /identity/v3/projects/8a3f6fd84c45460db45d4335f0b9c956 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:50.752392 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913c3d0-89ad-4bb5-a918-cea570cffc93 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:50.752956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913c3d0-89ad-4bb5-a918-cea570cffc93 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:50.753706 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913c3d0-89ad-4bb5-a918-cea570cffc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:50.787884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-c913c3d0-89ad-4bb5-a918-cea570cffc93 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:50.790591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c913c3d0-89ad-4bb5-a918-cea570cffc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:50.803117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6246db5e-74e4-4fc4-b407-d423e36aa170 admin admin] The token cache is being invalidate because project 65f36ebf1ef44f5d9456d7725ace34db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:50.803670 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6246db5e-74e4-4fc4-b407-d423e36aa170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:50.804604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6246db5e-74e4-4fc4-b407-d423e36aa170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:50.808951 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1131/2285] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:50 2022] DELETE /identity/v3/projects/65f36ebf1ef44f5d9456d7725ace34db => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:50.810878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246db5e-74e4-4fc4-b407-d423e36aa170 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:50.815394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6246db5e-74e4-4fc4-b407-d423e36aa170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:50.969895 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1155/2286] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:50.979856 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25b730-5124-4296-9c78-a9c1e011e93a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:50.980154 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25b730-5124-4296-9c78-a9c1e011e93a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:50.980470 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25b730-5124-4296-9c78-a9c1e011e93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:51.044833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246db5e-74e4-4fc4-b407-d423e36aa170 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:51.046847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-fa25b730-5124-4296-9c78-a9c1e011e93a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:51.048157 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-fa25b730-5124-4296-9c78-a9c1e011e93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:51.057401 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f2a4c-3807-4963-ad37-23a879d935e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:51.058066 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f2a4c-3807-4963-ad37-23a879d935e6 service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:51.058354 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f2a4c-3807-4963-ad37-23a879d935e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:51.058664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f2a4c-3807-4963-ad37-23a879d935e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:51.074186 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4e2f2a4c-3807-4963-ad37-23a879d935e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:51.085390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1156/2287] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:51.086750 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc06bd-b569-407e-bd31-3879ad0e02cb None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:51.087043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc06bd-b569-407e-bd31-3879ad0e02cb None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:51.087323 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc06bd-b569-407e-bd31-3879ad0e02cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:51.157344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d3bc06bd-b569-407e-bd31-3879ad0e02cb None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:51.159610 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d3bc06bd-b569-407e-bd31-3879ad0e02cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:51.193634 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1157/2288] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:51.194984 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc06bd-b569-407e-bd31-3879ad0e02cb None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:51.201188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d3bc06bd-b569-407e-bd31-3879ad0e02cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:51.221602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:51.286100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f2a4c-3807-4963-ad37-23a879d935e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:51.288109 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f2a4c-3807-4963-ad37-23a879d935e6 service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:51.306080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1132/2289] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:22:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:22:51.312731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b8a67-1306-4184-a8c5-af0bccecaa51 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:51.312731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b8a67-1306-4184-a8c5-af0bccecaa51 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:51.312731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b8a67-1306-4184-a8c5-af0bccecaa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:51.347843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc06bd-b569-407e-bd31-3879ad0e02cb None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:51.358650 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff0168-cba3-4436-b317-6249bf599cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:51.359325 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff0168-cba3-4436-b317-6249bf599cce service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:51.362513 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff0168-cba3-4436-b317-6249bf599cce service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:51.362926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff0168-cba3-4436-b317-6249bf599cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:51.364944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a58b8a67-1306-4184-a8c5-af0bccecaa51 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:51.368597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a58b8a67-1306-4184-a8c5-af0bccecaa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:51.420737 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff0168-cba3-4436-b317-6249bf599cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:51.421313 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1133/2290] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:51.422401 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff0168-cba3-4436-b317-6249bf599cce service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:51.428016 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524772c-8ff8-4761-aaba-5a09053c8568 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:51.428789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524772c-8ff8-4761-aaba-5a09053c8568 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:51.431031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524772c-8ff8-4761-aaba-5a09053c8568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:51.452996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1158/2291] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:51.453920 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff0168-cba3-4436-b317-6249bf599cce service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:51.480686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff0168-cba3-4436-b317-6249bf599cce service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:51.510076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97bc94-1cb2-4040-851f-b636472d94b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:51.511400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97bc94-1cb2-4040-851f-b636472d94b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:51.511984 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97bc94-1cb2-4040-851f-b636472d94b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:51.512550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97bc94-1cb2-4040-851f-b636472d94b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:51.513890 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97bc94-1cb2-4040-851f-b636472d94b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:22:51.514187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1524772c-8ff8-4761-aaba-5a09053c8568 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:51.517905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1524772c-8ff8-4761-aaba-5a09053c8568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:51.519928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97bc94-1cb2-4040-851f-b636472d94b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:51.526018 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97bc94-1cb2-4040-851f-b636472d94b5 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:51.538540 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1134/2292] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:51.547607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524772c-8ff8-4761-aaba-5a09053c8568 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:51.565146 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524772c-8ff8-4761-aaba-5a09053c8568 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:51.575975 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84952e14-5176-4dab-be67-191944a83d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:51.576769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84952e14-5176-4dab-be67-191944a83d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:51.577144 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84952e14-5176-4dab-be67-191944a83d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:51.577539 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84952e14-5176-4dab-be67-191944a83d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:51.584658 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84952e14-5176-4dab-be67-191944a83d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:22:51.585141 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:51.590588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84952e14-5176-4dab-be67-191944a83d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:51.590588 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84952e14-5176-4dab-be67-191944a83d33 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:51.621331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1135/2293] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:22:51.622939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1159/2294] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:22:51.623166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84952e14-5176-4dab-be67-191944a83d33 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:51.624959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97bc94-1cb2-4040-851f-b636472d94b5 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:51.636634 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84952e14-5176-4dab-be67-191944a83d33 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:51.643303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd8be8-45f3-4b73-8182-1d2e53ac31ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:51.644187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd8be8-45f3-4b73-8182-1d2e53ac31ec admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:51.644534 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd8be8-45f3-4b73-8182-1d2e53ac31ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:51.654558 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd8be8-45f3-4b73-8182-1d2e53ac31ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:51.655506 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd8be8-45f3-4b73-8182-1d2e53ac31ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:51.657713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd8be8-45f3-4b73-8182-1d2e53ac31ec admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:51.684905 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97bc94-1cb2-4040-851f-b636472d94b5 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:51.755767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f37bf-f152-4f8f-a069-9254b650e3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:51.762476 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f37bf-f152-4f8f-a069-9254b650e3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:51.762476 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f37bf-f152-4f8f-a069-9254b650e3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:51.762476 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f37bf-f152-4f8f-a069-9254b650e3a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:51.762476 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f37bf-f152-4f8f-a069-9254b650e3a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:51.765133 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f37bf-f152-4f8f-a069-9254b650e3a8 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:51.857729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1136/2295] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:51 2022] POST /identity/v3/projects => generated 367 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:51.863728 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd8be8-45f3-4b73-8182-1d2e53ac31ec admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:51.999640 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd8be8-45f3-4b73-8182-1d2e53ac31ec admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:52.024504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732649d8-79b0-4160-8f73-f1413d802e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:52.025916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732649d8-79b0-4160-8f73-f1413d802e28 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:52.028151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732649d8-79b0-4160-8f73-f1413d802e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:52.036743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732649d8-79b0-4160-8f73-f1413d802e28 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:52.042183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732649d8-79b0-4160-8f73-f1413d802e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:52.049206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732649d8-79b0-4160-8f73-f1413d802e28 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:52.087525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1160/2296] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:51 2022] POST /identity/v3/projects => generated 375 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:52.093744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f37bf-f152-4f8f-a069-9254b650e3a8 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:52.276007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1137/2297] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:51 2022] POST /identity/v3/users => generated 284 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:22:52.279276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732649d8-79b0-4160-8f73-f1413d802e28 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:52.335957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732649d8-79b0-4160-8f73-f1413d802e28 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:52.369441 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f37bf-f152-4f8f-a069-9254b650e3a8 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:52.381093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa07d8e-5b89-4339-a9a2-da909d16bbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:52.382201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa07d8e-5b89-4339-a9a2-da909d16bbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:52.382774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa07d8e-5b89-4339-a9a2-da909d16bbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:52.384044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa07d8e-5b89-4339-a9a2-da909d16bbe4 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:52.402742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa07d8e-5b89-4339-a9a2-da909d16bbe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:52.406053 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa07d8e-5b89-4339-a9a2-da909d16bbe4 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:52.451317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e16e9-5205-4d77-b588-37bc36009060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:52.451981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e16e9-5205-4d77-b588-37bc36009060 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:52.452263 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e16e9-5205-4d77-b588-37bc36009060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:52.452652 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e16e9-5205-4d77-b588-37bc36009060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:52.453408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e16e9-5205-4d77-b588-37bc36009060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:52.456123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e16e9-5205-4d77-b588-37bc36009060 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:52.474338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1138/2298] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:52.474338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e16e9-5205-4d77-b588-37bc36009060 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:52.479052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e90e16e9-5205-4d77-b588-37bc36009060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:52.514448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e16e9-5205-4d77-b588-37bc36009060 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:52.524868 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cf7ea-c5ff-4321-80c4-25beb030fd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:52.526008 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cf7ea-c5ff-4321-80c4-25beb030fd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:52.526293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cf7ea-c5ff-4321-80c4-25beb030fd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:52.526735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cf7ea-c5ff-4321-80c4-25beb030fd6b admin admin] PATH_INFO: `/v3/projects/c9f57ad6cef24c73a221dd91632a2875` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:52.529990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cf7ea-c5ff-4321-80c4-25beb030fd6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f57ad6cef24c73a221dd91632a2875)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:52.533018 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cf7ea-c5ff-4321-80c4-25beb030fd6b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:52.575500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1161/2299] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:52 2022] POST /identity/v3/users => generated 288 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:22:52.575500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa07d8e-5b89-4339-a9a2-da909d16bbe4 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:52.603001 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa07d8e-5b89-4339-a9a2-da909d16bbe4 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:52.614725 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ceab7c-6af3-4aa2-9f78-4a10699aba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:52.615383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ceab7c-6af3-4aa2-9f78-4a10699aba39 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:52.615708 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ceab7c-6af3-4aa2-9f78-4a10699aba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:52.615988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ceab7c-6af3-4aa2-9f78-4a10699aba39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:52.616971 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ceab7c-6af3-4aa2-9f78-4a10699aba39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:52.618813 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ceab7c-6af3-4aa2-9f78-4a10699aba39 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:52.633269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1162/2300] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:52.634141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ceab7c-6af3-4aa2-9f78-4a10699aba39 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:52.655855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ceab7c-6af3-4aa2-9f78-4a10699aba39 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:52.666116 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a04011-0319-4953-8d90-ef0d423a79a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:52.667210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a04011-0319-4953-8d90-ef0d423a79a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:52.667665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a04011-0319-4953-8d90-ef0d423a79a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:52.668105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a04011-0319-4953-8d90-ef0d423a79a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:52.668993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a04011-0319-4953-8d90-ef0d423a79a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:52.672912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a04011-0319-4953-8d90-ef0d423a79a5 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:52.690772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1163/2301] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:52.692938 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a04011-0319-4953-8d90-ef0d423a79a5 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:52.704766 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a04011-0319-4953-8d90-ef0d423a79a5 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:52.712067 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bfb00-4321-445f-90c1-2f107664d378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:52.713117 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bfb00-4321-445f-90c1-2f107664d378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:52.713631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bfb00-4321-445f-90c1-2f107664d378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:52.714183 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bfb00-4321-445f-90c1-2f107664d378 admin admin] PATH_INFO: `/v3/projects/b83a616fb2674d59a0f09dce57937bf7/users/888ccdc35e2848aaa7da7f7d70540db5/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:52.735401 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bfb00-4321-445f-90c1-2f107664d378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83a616fb2674d59a0f09dce57937bf7, user_id=888ccdc35e2848aaa7da7f7d70540db5, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:52.739014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bfb00-4321-445f-90c1-2f107664d378 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:52.873015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1164/2302] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:52 2022] PUT /identity/v3/projects/b83a616fb2674d59a0f09dce57937bf7/users/888ccdc35e2848aaa7da7f7d70540db5/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:52.877357 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bfb00-4321-445f-90c1-2f107664d378 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:52.911793 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d75cf7ea-c5ff-4321-80c4-25beb030fd6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f57ad6cef24c73a221dd91632a2875', 'request_id': 'req-d75cf7ea-c5ff-4321-80c4-25beb030fd6b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:52.941519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d75cf7ea-c5ff-4321-80c4-25beb030fd6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f57ad6cef24c73a221dd91632a2875', 'request_id': 'req-d75cf7ea-c5ff-4321-80c4-25beb030fd6b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:52.950984 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d75cf7ea-c5ff-4321-80c4-25beb030fd6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f57ad6cef24c73a221dd91632a2875', 'request_id': 'req-d75cf7ea-c5ff-4321-80c4-25beb030fd6b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:53.073538 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bfb00-4321-445f-90c1-2f107664d378 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:53.074206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d75cf7ea-c5ff-4321-80c4-25beb030fd6b admin admin] The token cache is being invalidate because project c9f57ad6cef24c73a221dd91632a2875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:22:53.075128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d75cf7ea-c5ff-4321-80c4-25beb030fd6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:53.076661 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d75cf7ea-c5ff-4321-80c4-25beb030fd6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:22:53.079028 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1139/2303] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:22:52 2022] DELETE /identity/v3/projects/c9f57ad6cef24c73a221dd91632a2875 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:53.082575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e0d84-f24b-4aea-b860-9ca1968c7b02 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:53.082575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e0d84-f24b-4aea-b860-9ca1968c7b02 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:53.083195 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16ab87-31b8-4746-b860-14bed7671a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:53.083355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e0d84-f24b-4aea-b860-9ca1968c7b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:53.084295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16ab87-31b8-4746-b860-14bed7671a41 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:53.084634 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16ab87-31b8-4746-b860-14bed7671a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:53.084932 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16ab87-31b8-4746-b860-14bed7671a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:53.085765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16ab87-31b8-4746-b860-14bed7671a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:53.087572 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16ab87-31b8-4746-b860-14bed7671a41 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:53.105995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1165/2304] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:53.105995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728c6fd-dcda-45e5-ae97-4bd20d07f813 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:53.105995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728c6fd-dcda-45e5-ae97-4bd20d07f813 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:53.105995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728c6fd-dcda-45e5-ae97-4bd20d07f813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:53.130191 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-2728c6fd-dcda-45e5-ae97-4bd20d07f813 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:53.131609 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2728c6fd-dcda-45e5-ae97-4bd20d07f813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:53.146722 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1166/2305] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:53.147695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728c6fd-dcda-45e5-ae97-4bd20d07f813 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:53.151242 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2728c6fd-dcda-45e5-ae97-4bd20d07f813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:53.188032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e30e0d84-f24b-4aea-b860-9ca1968c7b02 None None] MFA Rules not processed for user `888ccdc35e2848aaa7da7f7d70540db5`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:53.202024 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e30e0d84-f24b-4aea-b860-9ca1968c7b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:53.207905 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728c6fd-dcda-45e5-ae97-4bd20d07f813 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:53.215565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec13e8-5e2f-4c6e-9f13-c56e06d7cecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:53.221256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec13e8-5e2f-4c6e-9f13-c56e06d7cecb admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:53.221256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec13e8-5e2f-4c6e-9f13-c56e06d7cecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:53.221256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec13e8-5e2f-4c6e-9f13-c56e06d7cecb admin admin] PATH_INFO: `/v3/projects/7f05b33c7c2f402fb190e82d67bf6059/users/131994761926469298b4b95a33de4782/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:53.243811 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec13e8-5e2f-4c6e-9f13-c56e06d7cecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f05b33c7c2f402fb190e82d67bf6059, user_id=131994761926469298b4b95a33de4782, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:53.248840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec13e8-5e2f-4c6e-9f13-c56e06d7cecb admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:53.338073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1140/2306] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:53.338073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f26cf-2f40-43d5-a74f-476837d54422 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:53.338073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f26cf-2f40-43d5-a74f-476837d54422 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:53.338073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f26cf-2f40-43d5-a74f-476837d54422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:53.411514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:53.411753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a09f26cf-2f40-43d5-a74f-476837d54422 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:53.416517 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a09f26cf-2f40-43d5-a74f-476837d54422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:53.445092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1141/2307] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:53.445092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f26cf-2f40-43d5-a74f-476837d54422 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:53.445092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a09f26cf-2f40-43d5-a74f-476837d54422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:53.464753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1167/2308] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:53 2022] PUT /identity/v3/projects/7f05b33c7c2f402fb190e82d67bf6059/users/131994761926469298b4b95a33de4782/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:53.570563 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec13e8-5e2f-4c6e-9f13-c56e06d7cecb admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:53.644590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f26cf-2f40-43d5-a74f-476837d54422 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:53.807234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec13e8-5e2f-4c6e-9f13-c56e06d7cecb admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:53.807234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5810b8e-e5d7-4c3d-9fe6-887127a125d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:53.807234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5810b8e-e5d7-4c3d-9fe6-887127a125d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:53.807234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5810b8e-e5d7-4c3d-9fe6-887127a125d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:53.809988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5810b8e-e5d7-4c3d-9fe6-887127a125d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:53.809988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5810b8e-e5d7-4c3d-9fe6-887127a125d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:22:53.809988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5810b8e-e5d7-4c3d-9fe6-887127a125d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:53.809988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5810b8e-e5d7-4c3d-9fe6-887127a125d6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:53.809988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1168/2309] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:22:53.809988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131979f-f350-492e-9ce4-4fb42deefa07 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:53.811396 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131979f-f350-492e-9ce4-4fb42deefa07 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:53.811396 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131979f-f350-492e-9ce4-4fb42deefa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:53.860084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b323a63-25cb-48c5-b6fb-d8c6aa7e2c75 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d85dc9f9f15480db927e617c992e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:53.876095 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b323a63-25cb-48c5-b6fb-d8c6aa7e2c75 service glance] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:53.876095 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b323a63-25cb-48c5-b6fb-d8c6aa7e2c75 service glance] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:53.876095 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b323a63-25cb-48c5-b6fb-d8c6aa7e2c75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:53.901721 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-e131979f-f350-492e-9ce4-4fb42deefa07 None None] MFA Rules not processed for user `131994761926469298b4b95a33de4782`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:53.904747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e131979f-f350-492e-9ce4-4fb42deefa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:53.995263 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b323a63-25cb-48c5-b6fb-d8c6aa7e2c75 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:54.005967 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b323a63-25cb-48c5-b6fb-d8c6aa7e2c75 service glance] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:54.030222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1142/2310] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:54.031546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b323a63-25cb-48c5-b6fb-d8c6aa7e2c75 service glance] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:54.066818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b323a63-25cb-48c5-b6fb-d8c6aa7e2c75 service glance] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:54.085615 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1169/2311] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:54.090869 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd6ad7-f2a5-4cbb-bf70-3153f948f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:54.094731 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd6ad7-f2a5-4cbb-bf70-3153f948f9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:54.096260 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd6ad7-f2a5-4cbb-bf70-3153f948f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:54.098554 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd6ad7-f2a5-4cbb-bf70-3153f948f9d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:54.099395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd6ad7-f2a5-4cbb-bf70-3153f948f9d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:54.102310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131979f-f350-492e-9ce4-4fb42deefa07 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:54.103935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e131979f-f350-492e-9ce4-4fb42deefa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:54.110591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd6ad7-f2a5-4cbb-bf70-3153f948f9d0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:54.213414 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131979f-f350-492e-9ce4-4fb42deefa07 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:54.217256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68e315-2311-4950-90db-53c0fa2e35d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:54.218004 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68e315-2311-4950-90db-53c0fa2e35d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:54.218294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68e315-2311-4950-90db-53c0fa2e35d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:54.218838 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68e315-2311-4950-90db-53c0fa2e35d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:54.232467 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68e315-2311-4950-90db-53c0fa2e35d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:54.239603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68e315-2311-4950-90db-53c0fa2e35d9 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:54.247899 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1170/2312] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:54.412748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1143/2313] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:22:54 2022] POST /identity/v3/projects => generated 373 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:54.418768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68e315-2311-4950-90db-53c0fa2e35d9 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:54.443982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68e315-2311-4950-90db-53c0fa2e35d9 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:54.619592 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6d9c8-44b0-4986-a3e6-b4a673b393be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:54.620682 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6d9c8-44b0-4986-a3e6-b4a673b393be admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:54.621000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6d9c8-44b0-4986-a3e6-b4a673b393be admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:54.621382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6d9c8-44b0-4986-a3e6-b4a673b393be admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:54.622275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6d9c8-44b0-4986-a3e6-b4a673b393be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:54.625824 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6d9c8-44b0-4986-a3e6-b4a673b393be admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:54.885037 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1171/2314] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:22:54 2022] POST /identity/v3/users => generated 287 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:22:54.890339 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd6ad7-f2a5-4cbb-bf70-3153f948f9d0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:54.913405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd6ad7-f2a5-4cbb-bf70-3153f948f9d0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:54.919585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01df3b-fbdc-42a8-a442-c10c04841408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:54.920978 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01df3b-fbdc-42a8-a442-c10c04841408 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:54.921612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01df3b-fbdc-42a8-a442-c10c04841408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:54.921954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01df3b-fbdc-42a8-a442-c10c04841408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:54.922951 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01df3b-fbdc-42a8-a442-c10c04841408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:54.925510 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01df3b-fbdc-42a8-a442-c10c04841408 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:54.945625 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1144/2315] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:54.947028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6d9c8-44b0-4986-a3e6-b4a673b393be admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:54.965783 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6d9c8-44b0-4986-a3e6-b4a673b393be admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:54.972869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d0926-a746-4911-b0e8-2712f49fccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:54.973739 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d0926-a746-4911-b0e8-2712f49fccd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:54.974644 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d0926-a746-4911-b0e8-2712f49fccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:54.974644 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d0926-a746-4911-b0e8-2712f49fccd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:54.976095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d0926-a746-4911-b0e8-2712f49fccd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:54.978848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d0926-a746-4911-b0e8-2712f49fccd8 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:55.000335 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1172/2316] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:22:55.002678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01df3b-fbdc-42a8-a442-c10c04841408 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:55.023533 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01df3b-fbdc-42a8-a442-c10c04841408 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:55.032797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4beac8-5616-4499-92c0-e5d14cb7e3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:55.034671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4beac8-5616-4499-92c0-e5d14cb7e3c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:55.035622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4beac8-5616-4499-92c0-e5d14cb7e3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:55.036525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4beac8-5616-4499-92c0-e5d14cb7e3c2 admin admin] PATH_INFO: `/v3/projects/85ea31dae6fe4fe4bb0c6ba9062fbe84/users/350bc4821c16408298bb19bbb7fcd505/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:55.078927 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4beac8-5616-4499-92c0-e5d14cb7e3c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ea31dae6fe4fe4bb0c6ba9062fbe84, user_id=350bc4821c16408298bb19bbb7fcd505, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:55.081935 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4beac8-5616-4499-92c0-e5d14cb7e3c2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:55.202922 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1145/2317] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:22:55 2022] PUT /identity/v3/projects/85ea31dae6fe4fe4bb0c6ba9062fbe84/users/350bc4821c16408298bb19bbb7fcd505/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:22:55.210124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a8efe-2d14-464e-84c7-2a4cc236cfe1 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:55.210869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a8efe-2d14-464e-84c7-2a4cc236cfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:55.211379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a8efe-2d14-464e-84c7-2a4cc236cfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:55.299854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b52a8efe-2d14-464e-84c7-2a4cc236cfe1 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:55.304242 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b52a8efe-2d14-464e-84c7-2a4cc236cfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:55.506924 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1173/2318] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:55.521617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4beac8-5616-4499-92c0-e5d14cb7e3c2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:55.526141 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ab4beac8-5616-4499-92c0-e5d14cb7e3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:55.752915 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4beac8-5616-4499-92c0-e5d14cb7e3c2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:55.765265 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cd89f-0a19-4d51-bf4a-8c97b951f668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:55.769075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cd89f-0a19-4d51-bf4a-8c97b951f668 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:55.769075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cd89f-0a19-4d51-bf4a-8c97b951f668 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:55.769075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cd89f-0a19-4d51-bf4a-8c97b951f668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:55.792873 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cd89f-0a19-4d51-bf4a-8c97b951f668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:55.794616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cd89f-0a19-4d51-bf4a-8c97b951f668 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:55.822546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1146/2319] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:22:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:55.972897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:58.305742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:59.924735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:01.820290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:02.712892 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:04.755578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:05.141576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:07.127072 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:07.790293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:07.880394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:07.968368 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a8efe-2d14-464e-84c7-2a4cc236cfe1 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:08.120920 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a8efe-2d14-464e-84c7-2a4cc236cfe1 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:08.129443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb986f-1035-479b-a4ba-c455293d119f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:08.130446 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb986f-1035-479b-a4ba-c455293d119f service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:08.131111 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb986f-1035-479b-a4ba-c455293d119f service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:08.131548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb986f-1035-479b-a4ba-c455293d119f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:08.134301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-dafb986f-1035-479b-a4ba-c455293d119f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:08.351131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb986f-1035-479b-a4ba-c455293d119f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:08.352535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb986f-1035-479b-a4ba-c455293d119f service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:08.372554 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1174/2320] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:23:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:23:09.324142 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fb4db-6bbc-4288-9dfc-27f396926e3e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:09.324798 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fb4db-6bbc-4288-9dfc-27f396926e3e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:09.324798 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fb4db-6bbc-4288-9dfc-27f396926e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:09.358678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7f4fb4db-6bbc-4288-9dfc-27f396926e3e None None] MFA Rules not processed for user `5182476e94ea4f0c8049001bebd351bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:09.364626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7f4fb4db-6bbc-4288-9dfc-27f396926e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:09.445596 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1147/2321] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:23:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:10.266500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:10.353631 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:11.502678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:11.527123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662558df-4f84-44d2-a388-6cc4f5cfcfa2 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:11.529854 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662558df-4f84-44d2-a388-6cc4f5cfcfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:11.530173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662558df-4f84-44d2-a388-6cc4f5cfcfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:11.606302 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-662558df-4f84-44d2-a388-6cc4f5cfcfa2 None None] MFA Rules not processed for user `350bc4821c16408298bb19bbb7fcd505`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:11.608633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-662558df-4f84-44d2-a388-6cc4f5cfcfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:11.768926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1175/2322] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:23:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:11.775368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fb4db-6bbc-4288-9dfc-27f396926e3e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:11.800613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fb4db-6bbc-4288-9dfc-27f396926e3e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:11.811745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d1d89-7fd6-4a0f-997f-cab6def4b247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:11.812591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d1d89-7fd6-4a0f-997f-cab6def4b247 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:11.812977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d1d89-7fd6-4a0f-997f-cab6def4b247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:11.813358 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d1d89-7fd6-4a0f-997f-cab6def4b247 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:11.814209 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d1d89-7fd6-4a0f-997f-cab6def4b247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:11.817421 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d1d89-7fd6-4a0f-997f-cab6def4b247 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:12.055331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1148/2323] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:23:11 2022] POST /identity/v3/projects => generated 373 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:23:12.057163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662558df-4f84-44d2-a388-6cc4f5cfcfa2 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:12.083054 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662558df-4f84-44d2-a388-6cc4f5cfcfa2 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:12.246165 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7d8ff-8704-4418-8412-647cf10afb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:12.247314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7d8ff-8704-4418-8412-647cf10afb6a admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:12.247778 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7d8ff-8704-4418-8412-647cf10afb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:12.248299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7d8ff-8704-4418-8412-647cf10afb6a admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:12.249547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7d8ff-8704-4418-8412-647cf10afb6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:12.253338 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7d8ff-8704-4418-8412-647cf10afb6a admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:12.481522 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1176/2324] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:23:12 2022] POST /identity/v3/users => generated 293 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:23:12.489080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d1d89-7fd6-4a0f-997f-cab6def4b247 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:12.556732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d1d89-7fd6-4a0f-997f-cab6def4b247 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:12.583474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4a16a-3cd0-4b21-83b5-1d21976e69a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:12.584540 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4a16a-3cd0-4b21-83b5-1d21976e69a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:12.585060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4a16a-3cd0-4b21-83b5-1d21976e69a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:12.585667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4a16a-3cd0-4b21-83b5-1d21976e69a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:12.589624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4a16a-3cd0-4b21-83b5-1d21976e69a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:12.604139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4a16a-3cd0-4b21-83b5-1d21976e69a9 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:12.640608 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1149/2325] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:23:12.649394 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7d8ff-8704-4418-8412-647cf10afb6a admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:12.724563 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7d8ff-8704-4418-8412-647cf10afb6a admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:12.730342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6eac78-8aed-492e-b33a-f5fd4bc88eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:12.731138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6eac78-8aed-492e-b33a-f5fd4bc88eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:12.731414 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6eac78-8aed-492e-b33a-f5fd4bc88eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:12.731881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6eac78-8aed-492e-b33a-f5fd4bc88eb4 admin admin] PATH_INFO: `/v3/projects/ce05182a4a5d41629b3b73098f808eb1/users/65a3e7a42b1b4074b916f8f9ea7bf7c6/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:12.767314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6eac78-8aed-492e-b33a-f5fd4bc88eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce05182a4a5d41629b3b73098f808eb1, user_id=65a3e7a42b1b4074b916f8f9ea7bf7c6, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:12.771144 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6eac78-8aed-492e-b33a-f5fd4bc88eb4 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:12.853560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1177/2326] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:23:12 2022] PUT /identity/v3/projects/ce05182a4a5d41629b3b73098f808eb1/users/65a3e7a42b1b4074b916f8f9ea7bf7c6/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:23:12.861548 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4a16a-3cd0-4b21-83b5-1d21976e69a9 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:12.880761 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:12.930165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4a16a-3cd0-4b21-83b5-1d21976e69a9 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:13.118831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb80dae-e6f0-485d-a7e7-27b4791b0c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:13.120750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb80dae-e6f0-485d-a7e7-27b4791b0c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:13.121030 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb80dae-e6f0-485d-a7e7-27b4791b0c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:13.125752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb80dae-e6f0-485d-a7e7-27b4791b0c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:13.128346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb80dae-e6f0-485d-a7e7-27b4791b0c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:13.136045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb80dae-e6f0-485d-a7e7-27b4791b0c15 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:13.161643 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1150/2327] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:23:13.167888 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6eac78-8aed-492e-b33a-f5fd4bc88eb4 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:13.193946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6eac78-8aed-492e-b33a-f5fd4bc88eb4 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:13.199809 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab84e5-67ca-4262-9bfd-690f714bb3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:13.200816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab84e5-67ca-4262-9bfd-690f714bb3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:13.201273 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab84e5-67ca-4262-9bfd-690f714bb3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:13.201765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab84e5-67ca-4262-9bfd-690f714bb3ad admin admin] PATH_INFO: `/v3/projects/ce05182a4a5d41629b3b73098f808eb1/users/65a3e7a42b1b4074b916f8f9ea7bf7c6/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:13.204759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab84e5-67ca-4262-9bfd-690f714bb3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce05182a4a5d41629b3b73098f808eb1, user_id=65a3e7a42b1b4074b916f8f9ea7bf7c6, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:13.208848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab84e5-67ca-4262-9bfd-690f714bb3ad admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:13.234056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1178/2328] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:23:13 2022] PUT /identity/v3/projects/ce05182a4a5d41629b3b73098f808eb1/users/65a3e7a42b1b4074b916f8f9ea7bf7c6/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:23:14.717004 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:15.770836 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:16.295884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:16.665465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb80dae-e6f0-485d-a7e7-27b4791b0c15 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:16.667734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7fb80dae-e6f0-485d-a7e7-27b4791b0c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:16.842570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb80dae-e6f0-485d-a7e7-27b4791b0c15 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:17.078397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab84e5-67ca-4262-9bfd-690f714bb3ad admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:17.083479 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b7ab84e5-67ca-4262-9bfd-690f714bb3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:17.262076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf561b3-d9f7-43e0-88b6-0ef118a13720 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:17.266826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf561b3-d9f7-43e0-88b6-0ef118a13720 service placement] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:17.272361 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf561b3-d9f7-43e0-88b6-0ef118a13720 service placement] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:17.278786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf561b3-d9f7-43e0-88b6-0ef118a13720 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:17.292289 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-dcf561b3-d9f7-43e0-88b6-0ef118a13720 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:17.349792 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf561b3-d9f7-43e0-88b6-0ef118a13720 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:17.354575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf561b3-d9f7-43e0-88b6-0ef118a13720 service placement] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:17.386821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1151/2329] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:23:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:23:17.393340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab84e5-67ca-4262-9bfd-690f714bb3ad admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:17.418008 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f6be8-475b-420c-bbc2-c7c6e8630f71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:17.419417 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f6be8-475b-420c-bbc2-c7c6e8630f71 service placement] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:17.422014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f6be8-475b-420c-bbc2-c7c6e8630f71 service placement] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:17.422586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f6be8-475b-420c-bbc2-c7c6e8630f71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:17.462314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f6be8-475b-420c-bbc2-c7c6e8630f71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:17.466734 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f6be8-475b-420c-bbc2-c7c6e8630f71 service placement] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:17.504637 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1179/2330] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:23:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:23:18.125994 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:18.403100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:20.809272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:20.946132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:23.374291 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:23.870919 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:24.300282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf561b3-d9f7-43e0-88b6-0ef118a13720 service placement] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:24.474908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf561b3-d9f7-43e0-88b6-0ef118a13720 service placement] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:24.486831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f8b25-5534-4aa9-b923-83202566b836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:24.488179 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f8b25-5534-4aa9-b923-83202566b836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:24.488472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f8b25-5534-4aa9-b923-83202566b836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:24.489317 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f8b25-5534-4aa9-b923-83202566b836 admin admin] PATH_INFO: `/v3/users/131994761926469298b4b95a33de4782` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:24.496908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f8b25-5534-4aa9-b923-83202566b836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=131994761926469298b4b95a33de4782)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:24.496908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f8b25-5534-4aa9-b923-83202566b836 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:25.008145 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8c3f8b25-5534-4aa9-b923-83202566b836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131994761926469298b4b95a33de4782'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:25.010910 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8c3f8b25-5534-4aa9-b923-83202566b836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131994761926469298b4b95a33de4782'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:25.068331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8c3f8b25-5534-4aa9-b923-83202566b836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131994761926469298b4b95a33de4782'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:25.069619 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8c3f8b25-5534-4aa9-b923-83202566b836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131994761926469298b4b95a33de4782'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:25.195326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8c3f8b25-5534-4aa9-b923-83202566b836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131994761926469298b4b95a33de4782'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:25.220064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1152/2331] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:23:24 2022] DELETE /identity/v3/users/131994761926469298b4b95a33de4782 => generated 0 bytes in 921 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:23:25.228255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b3de5-d2d3-46f2-be1a-243a8025a032 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:25.228980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b3de5-d2d3-46f2-be1a-243a8025a032 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:25.229355 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b3de5-d2d3-46f2-be1a-243a8025a032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:25.262757 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a31b3de5-d2d3-46f2-be1a-243a8025a032 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:25.264302 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a31b3de5-d2d3-46f2-be1a-243a8025a032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:25.453529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1180/2332] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:25.505706 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f8b25-5534-4aa9-b923-83202566b836 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:25.508292 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8c3f8b25-5534-4aa9-b923-83202566b836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:25.572675 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef9489-7ce9-40fa-9e56-468e130c4ad6 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:25.576720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef9489-7ce9-40fa-9e56-468e130c4ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:25.577437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef9489-7ce9-40fa-9e56-468e130c4ad6 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:25.580046 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1181/2333] 10.222.0.98 () {54 vars in 921 bytes} [Tue Jul 26 15:23:25 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:23:25.593338 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36959b8-3f27-41b3-b19f-8ff05406f518 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:25.595557 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36959b8-3f27-41b3-b19f-8ff05406f518 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:25.596191 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36959b8-3f27-41b3-b19f-8ff05406f518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:25.655663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-f36959b8-3f27-41b3-b19f-8ff05406f518 None None] MFA Rules not processed for user `a4a6c0e7ca434010980d7cac1800dbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:25.661638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f36959b8-3f27-41b3-b19f-8ff05406f518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:25.794527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f8b25-5534-4aa9-b923-83202566b836 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:25.803704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb46a2-530b-446c-81f7-932838606d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:25.804574 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb46a2-530b-446c-81f7-932838606d3f service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:25.804864 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb46a2-530b-446c-81f7-932838606d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:25.809198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb46a2-530b-446c-81f7-932838606d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:25.828397 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb46a2-530b-446c-81f7-932838606d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:25.829928 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb46a2-530b-446c-81f7-932838606d3f service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:25.869737 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1153/2334] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:25.930550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1182/2335] 10.222.0.98 () {58 vars in 1018 bytes} [Tue Jul 26 15:23:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:25.943428 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb46a2-530b-446c-81f7-932838606d3f service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:25.945590 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a6bb46a2-530b-446c-81f7-932838606d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:26.113680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb46a2-530b-446c-81f7-932838606d3f service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:26.139135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ddf14-9434-47cf-86a2-3c607b28f18e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d85dc9f9f15480db927e617c992e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:26.143818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ddf14-9434-47cf-86a2-3c607b28f18e service glance] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:26.147152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ddf14-9434-47cf-86a2-3c607b28f18e service glance] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:26.149016 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ddf14-9434-47cf-86a2-3c607b28f18e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:26.173861 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ddf14-9434-47cf-86a2-3c607b28f18e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:26.178705 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ddf14-9434-47cf-86a2-3c607b28f18e service glance] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:26.222331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1154/2336] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:23:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:23:26.588514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9650e-7214-4e70-a145-8a886731a869 None None] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:26.591493 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9650e-7214-4e70-a145-8a886731a869 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:26.592318 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9650e-7214-4e70-a145-8a886731a869 None None] PATH_INFO: `/` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:26.601491 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1183/2337] 10.222.0.98 () {54 vars in 921 bytes} [Tue Jul 26 15:23:26 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:23:26.613944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5328c12-0c1b-41a9-9454-dd4c8eef1e56 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:26.613944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5328c12-0c1b-41a9-9454-dd4c8eef1e56 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:26.613944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5328c12-0c1b-41a9-9454-dd4c8eef1e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:26.650302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c5328c12-0c1b-41a9-9454-dd4c8eef1e56 None None] MFA Rules not processed for user `e44d2d2b50484fb89b0688ff28615d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:26.652554 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c5328c12-0c1b-41a9-9454-dd4c8eef1e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:26.670717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1155/2338] 10.222.0.98 () {58 vars in 1018 bytes} [Tue Jul 26 15:23:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:26.692438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9650e-7214-4e70-a145-8a886731a869 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:26.695259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4ce9650e-7214-4e70-a145-8a886731a869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:26.725707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9650e-7214-4e70-a145-8a886731a869 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:26.736368 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec539090-7e4d-4761-abd0-762f46148092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:26.736368 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec539090-7e4d-4761-abd0-762f46148092 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:26.736368 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec539090-7e4d-4761-abd0-762f46148092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:26.739101 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec539090-7e4d-4761-abd0-762f46148092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:26.757222 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec539090-7e4d-4761-abd0-762f46148092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:26.757481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39116f9-d5df-49fe-bf3f-54e7204fdf4c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:26.757678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39116f9-d5df-49fe-bf3f-54e7204fdf4c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:26.758139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39116f9-d5df-49fe-bf3f-54e7204fdf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:26.759689 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec539090-7e4d-4761-abd0-762f46148092 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:26.803505 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c39116f9-d5df-49fe-bf3f-54e7204fdf4c None None] MFA Rules not processed for user `65a3e7a42b1b4074b916f8f9ea7bf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:26.805860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c39116f9-d5df-49fe-bf3f-54e7204fdf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:26.806767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1184/2339] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:23:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:26.965144 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1156/2340] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:23:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:23:26.974799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec539090-7e4d-4761-abd0-762f46148092 service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:26.978220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ec539090-7e4d-4761-abd0-762f46148092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:27.021697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec539090-7e4d-4761-abd0-762f46148092 service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:27.037156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998de3d-f210-404f-b09c-2412da4f1cd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:27.040550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998de3d-f210-404f-b09c-2412da4f1cd5 service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:27.041124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998de3d-f210-404f-b09c-2412da4f1cd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:27.041994 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998de3d-f210-404f-b09c-2412da4f1cd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:27.048131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8998de3d-f210-404f-b09c-2412da4f1cd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:27.053759 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b708a1b-45c2-4fda-b77a-9aa4beade8a3 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:27.057616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b708a1b-45c2-4fda-b77a-9aa4beade8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:27.057616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b708a1b-45c2-4fda-b77a-9aa4beade8a3 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:27.057616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1157/2341] 10.222.0.98 () {54 vars in 921 bytes} [Tue Jul 26 15:23:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:23:27.066238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76591542-a1af-47c0-81bc-916c281c0558 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:27.066735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76591542-a1af-47c0-81bc-916c281c0558 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:27.067223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76591542-a1af-47c0-81bc-916c281c0558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:27.100359 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-76591542-a1af-47c0-81bc-916c281c0558 None None] MFA Rules not processed for user `a4a6c0e7ca434010980d7cac1800dbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:27.102607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-76591542-a1af-47c0-81bc-916c281c0558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:27.120586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1158/2342] 10.222.0.98 () {58 vars in 1018 bytes} [Tue Jul 26 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:23:27.148213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76591542-a1af-47c0-81bc-916c281c0558 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:27.217685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76591542-a1af-47c0-81bc-916c281c0558 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:27.235429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4a91f-f5e2-4330-95d2-602c8e013e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:27.235813 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4a91f-f5e2-4330-95d2-602c8e013e27 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:27.237298 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4a91f-f5e2-4330-95d2-602c8e013e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:27.237298 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4a91f-f5e2-4330-95d2-602c8e013e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:27.257253 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4a91f-f5e2-4330-95d2-602c8e013e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:27.258996 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4a91f-f5e2-4330-95d2-602c8e013e27 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:27.266082 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998de3d-f210-404f-b09c-2412da4f1cd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:27.269131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998de3d-f210-404f-b09c-2412da4f1cd5 service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:27.275814 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1159/2343] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:23:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:27.276927 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4a91f-f5e2-4330-95d2-602c8e013e27 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:27.278871 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d1e4a91f-f5e2-4330-95d2-602c8e013e27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:27.295481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4a91f-f5e2-4330-95d2-602c8e013e27 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:27.307767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e6923-559a-4433-a11a-448ad63050b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:27.308717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e6923-559a-4433-a11a-448ad63050b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:27.320681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1185/2344] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:23:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:27.322241 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e6923-559a-4433-a11a-448ad63050b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:27.322749 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e6923-559a-4433-a11a-448ad63050b7 admin admin] PATH_INFO: `/v3/projects/7f05b33c7c2f402fb190e82d67bf6059` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:27.326031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e6923-559a-4433-a11a-448ad63050b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f05b33c7c2f402fb190e82d67bf6059)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:27.331742 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e6923-559a-4433-a11a-448ad63050b7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:27.574861 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-739e6923-559a-4433-a11a-448ad63050b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f05b33c7c2f402fb190e82d67bf6059', 'request_id': 'req-739e6923-559a-4433-a11a-448ad63050b7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:27.592252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-739e6923-559a-4433-a11a-448ad63050b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f05b33c7c2f402fb190e82d67bf6059', 'request_id': 'req-739e6923-559a-4433-a11a-448ad63050b7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:27.617431 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-739e6923-559a-4433-a11a-448ad63050b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f05b33c7c2f402fb190e82d67bf6059', 'request_id': 'req-739e6923-559a-4433-a11a-448ad63050b7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:27.770776 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-739e6923-559a-4433-a11a-448ad63050b7 admin admin] The token cache is being invalidate because project 7f05b33c7c2f402fb190e82d67bf6059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:23:27.770776 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-739e6923-559a-4433-a11a-448ad63050b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:27.770776 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-739e6923-559a-4433-a11a-448ad63050b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:27.770776 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1160/2345] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:23:27 2022] DELETE /identity/v3/projects/7f05b33c7c2f402fb190e82d67bf6059 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:23:27.772701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8ed36-31f9-4793-b582-effa1df398d0 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:27.773459 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8ed36-31f9-4793-b582-effa1df398d0 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:27.774548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8ed36-31f9-4793-b582-effa1df398d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:27.822910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-f9a8ed36-31f9-4793-b582-effa1df398d0 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:27.825751 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f9a8ed36-31f9-4793-b582-effa1df398d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:28.023679 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1186/2346] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:28.026146 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b468ea-f8b8-4de7-944f-22eee3437e46 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:28.026974 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b468ea-f8b8-4de7-944f-22eee3437e46 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:28.027692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b468ea-f8b8-4de7-944f-22eee3437e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:28.109168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e0b468ea-f8b8-4de7-944f-22eee3437e46 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:28.112515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e0b468ea-f8b8-4de7-944f-22eee3437e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:28.132892 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1161/2347] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:23:28.137158 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8ed36-31f9-4793-b582-effa1df398d0 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:28.155765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8ed36-31f9-4793-b582-effa1df398d0 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:28.172560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a4687-78c0-49fb-bfa1-6222e375e76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:28.173677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a4687-78c0-49fb-bfa1-6222e375e76f admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:28.176343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a4687-78c0-49fb-bfa1-6222e375e76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:28.176884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a4687-78c0-49fb-bfa1-6222e375e76f admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:28.178384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a4687-78c0-49fb-bfa1-6222e375e76f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:23:28.179343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a4687-78c0-49fb-bfa1-6222e375e76f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:28.182758 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a4687-78c0-49fb-bfa1-6222e375e76f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:28.236275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1187/2348] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:23:28.244708 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b468ea-f8b8-4de7-944f-22eee3437e46 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:28.265381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b468ea-f8b8-4de7-944f-22eee3437e46 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:28.266613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99a268-0fab-4941-aab0-b6fe19578abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:28.267273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99a268-0fab-4941-aab0-b6fe19578abc admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:28.267656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99a268-0fab-4941-aab0-b6fe19578abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:28.267969 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99a268-0fab-4941-aab0-b6fe19578abc admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:28.268965 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99a268-0fab-4941-aab0-b6fe19578abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:28.281491 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99a268-0fab-4941-aab0-b6fe19578abc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:28.487382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1162/2349] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:23:28 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:23:28.492690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a4687-78c0-49fb-bfa1-6222e375e76f admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:28.512985 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a4687-78c0-49fb-bfa1-6222e375e76f admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:28.550020 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:28.661781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e2ab1-03f9-4a99-ad82-571380fc2447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:28.663294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e2ab1-03f9-4a99-ad82-571380fc2447 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:28.663914 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e2ab1-03f9-4a99-ad82-571380fc2447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:28.664812 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e2ab1-03f9-4a99-ad82-571380fc2447 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:28.666378 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e2ab1-03f9-4a99-ad82-571380fc2447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:28.672953 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e2ab1-03f9-4a99-ad82-571380fc2447 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:28.844199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1188/2350] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:23:28 2022] POST /identity/v3/users => generated 292 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:23:28.852727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99a268-0fab-4941-aab0-b6fe19578abc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:28.882892 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99a268-0fab-4941-aab0-b6fe19578abc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:28.899924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e63e2-a1f9-4935-978f-dd54bbeacd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:28.901476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e63e2-a1f9-4935-978f-dd54bbeacd97 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:28.902807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e63e2-a1f9-4935-978f-dd54bbeacd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:28.903813 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e63e2-a1f9-4935-978f-dd54bbeacd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:28.906194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e63e2-a1f9-4935-978f-dd54bbeacd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:28.909929 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e63e2-a1f9-4935-978f-dd54bbeacd97 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:28.941218 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1163/2351] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:23:28.946230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e2ab1-03f9-4a99-ad82-571380fc2447 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:28.973717 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e2ab1-03f9-4a99-ad82-571380fc2447 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:28.995883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb817c54-47ed-4213-bd86-ebb0832212f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:28.996824 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb817c54-47ed-4213-bd86-ebb0832212f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:28.997312 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb817c54-47ed-4213-bd86-ebb0832212f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:28.997970 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb817c54-47ed-4213-bd86-ebb0832212f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:29.000602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb817c54-47ed-4213-bd86-ebb0832212f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:29.005136 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb817c54-47ed-4213-bd86-ebb0832212f3 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:29.029408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1189/2352] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:23:29.036262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e63e2-a1f9-4935-978f-dd54bbeacd97 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:29.059982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e63e2-a1f9-4935-978f-dd54bbeacd97 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:29.070749 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b6f11-2dbb-469f-9ede-5c0a667d9eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:29.073320 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b6f11-2dbb-469f-9ede-5c0a667d9eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:29.073320 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b6f11-2dbb-469f-9ede-5c0a667d9eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:29.073320 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b6f11-2dbb-469f-9ede-5c0a667d9eb1 admin admin] PATH_INFO: `/v3/projects/01d4389cc0a1470cb879aaf5c4d55286/users/e9fe8b6818fa44d6a459589de462c8da/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:29.109237 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b6f11-2dbb-469f-9ede-5c0a667d9eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d4389cc0a1470cb879aaf5c4d55286, user_id=e9fe8b6818fa44d6a459589de462c8da, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:29.111755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:29.119568 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b6f11-2dbb-469f-9ede-5c0a667d9eb1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:29.311303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1164/2353] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:23:29 2022] PUT /identity/v3/projects/01d4389cc0a1470cb879aaf5c4d55286/users/e9fe8b6818fa44d6a459589de462c8da/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:23:29.317431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b0c7a-3d4c-4fe6-b306-ae39528d550d None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:29.318049 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b0c7a-3d4c-4fe6-b306-ae39528d550d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:29.318680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b0c7a-3d4c-4fe6-b306-ae39528d550d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:29.399075 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-c07b0c7a-3d4c-4fe6-b306-ae39528d550d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:29.406159 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c07b0c7a-3d4c-4fe6-b306-ae39528d550d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:29.570276 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1190/2354] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:29.582915 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b6f11-2dbb-469f-9ede-5c0a667d9eb1 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:29.584867 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c17b6f11-2dbb-469f-9ede-5c0a667d9eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:29.703190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b6f11-2dbb-469f-9ede-5c0a667d9eb1 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:29.707584 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef2d8b-a45d-42a5-b41c-7abd8e7fc529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:29.708245 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef2d8b-a45d-42a5-b41c-7abd8e7fc529 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:29.708527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef2d8b-a45d-42a5-b41c-7abd8e7fc529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:29.708800 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef2d8b-a45d-42a5-b41c-7abd8e7fc529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:29.723666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef2d8b-a45d-42a5-b41c-7abd8e7fc529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:29.725257 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef2d8b-a45d-42a5-b41c-7abd8e7fc529 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:29.739087 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1165/2355] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:30.622425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:33.201960 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8f7f3-b033-4e48-89ab-9d79924886fe None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:33.203014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8f7f3-b033-4e48-89ab-9d79924886fe None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:33.203267 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8f7f3-b033-4e48-89ab-9d79924886fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:33.272629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-5ad8f7f3-b033-4e48-89ab-9d79924886fe None None] MFA Rules not processed for user `350bc4821c16408298bb19bbb7fcd505`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:33.275012 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5ad8f7f3-b033-4e48-89ab-9d79924886fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:33.480297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1191/2356] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:23:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:23:33.614006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef2d8b-a45d-42a5-b41c-7abd8e7fc529 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:33.620482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-05ef2d8b-a45d-42a5-b41c-7abd8e7fc529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:33.702791 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef2d8b-a45d-42a5-b41c-7abd8e7fc529 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:33.737840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52152de-9582-43b8-a7a2-45b65190721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:33.739199 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52152de-9582-43b8-a7a2-45b65190721c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:33.739825 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52152de-9582-43b8-a7a2-45b65190721c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:33.740455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52152de-9582-43b8-a7a2-45b65190721c admin admin] PATH_INFO: `/v3/users/888ccdc35e2848aaa7da7f7d70540db5` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:33.743532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52152de-9582-43b8-a7a2-45b65190721c admin admin] RBAC: Authorizing `identity:delete_user(user_id=888ccdc35e2848aaa7da7f7d70540db5)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:33.753816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52152de-9582-43b8-a7a2-45b65190721c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:34.202230 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b52152de-9582-43b8-a7a2-45b65190721c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888ccdc35e2848aaa7da7f7d70540db5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:34.203768 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b52152de-9582-43b8-a7a2-45b65190721c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888ccdc35e2848aaa7da7f7d70540db5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:34.234816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b52152de-9582-43b8-a7a2-45b65190721c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888ccdc35e2848aaa7da7f7d70540db5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:34.236068 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b52152de-9582-43b8-a7a2-45b65190721c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888ccdc35e2848aaa7da7f7d70540db5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:34.394159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b52152de-9582-43b8-a7a2-45b65190721c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888ccdc35e2848aaa7da7f7d70540db5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:34.453682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1166/2357] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:23:33 2022] DELETE /identity/v3/users/888ccdc35e2848aaa7da7f7d70540db5 => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:23:34.470508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ef24e-b516-43b6-8a81-3daf4d6cad80 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:34.472298 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ef24e-b516-43b6-8a81-3daf4d6cad80 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:34.472298 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ef24e-b516-43b6-8a81-3daf4d6cad80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:34.532510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-108ef24e-b516-43b6-8a81-3daf4d6cad80 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:34.543428 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-108ef24e-b516-43b6-8a81-3daf4d6cad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:34.672173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:34.743419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1192/2358] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:23:34.790298 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52152de-9582-43b8-a7a2-45b65190721c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:34.792761 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b52152de-9582-43b8-a7a2-45b65190721c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:35.011039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52152de-9582-43b8-a7a2-45b65190721c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:35.019575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb1298-07ce-48ef-a429-ebcd60fa14ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:35.021212 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb1298-07ce-48ef-a429-ebcd60fa14ae service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:35.022218 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb1298-07ce-48ef-a429-ebcd60fa14ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:35.023084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb1298-07ce-48ef-a429-ebcd60fa14ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:35.055945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb1298-07ce-48ef-a429-ebcd60fa14ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:35.107509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb1298-07ce-48ef-a429-ebcd60fa14ae service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:35.107509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1167/2359] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:35.887681 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:36.005684 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d24a6-48f9-4f71-9c7f-3b42bf7a182b None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:36.006115 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d24a6-48f9-4f71-9c7f-3b42bf7a182b None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:36.006500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d24a6-48f9-4f71-9c7f-3b42bf7a182b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:36.031304 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-6d0d24a6-48f9-4f71-9c7f-3b42bf7a182b None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:36.035627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6d0d24a6-48f9-4f71-9c7f-3b42bf7a182b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:36.135488 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1193/2360] 10.222.0.98 () {58 vars in 1009 bytes} [Tue Jul 26 15:23:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:36.149958 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb1298-07ce-48ef-a429-ebcd60fa14ae service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:36.151626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-78bb1298-07ce-48ef-a429-ebcd60fa14ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:36.191288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d24a6-48f9-4f71-9c7f-3b42bf7a182b None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:36.192953 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6d0d24a6-48f9-4f71-9c7f-3b42bf7a182b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:36.223755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d24a6-48f9-4f71-9c7f-3b42bf7a182b None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:36.233083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8880dff-b194-49f6-9673-bb80288336dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:36.233774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8880dff-b194-49f6-9673-bb80288336dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:36.234227 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8880dff-b194-49f6-9673-bb80288336dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:36.234691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8880dff-b194-49f6-9673-bb80288336dd admin admin] PATH_INFO: `/v3/projects/b83a616fb2674d59a0f09dce57937bf7` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:36.238034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8880dff-b194-49f6-9673-bb80288336dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b83a616fb2674d59a0f09dce57937bf7)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:36.243994 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8880dff-b194-49f6-9673-bb80288336dd admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:36.321656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb1298-07ce-48ef-a429-ebcd60fa14ae service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:36.327946 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd8cf0-92c5-4d45-9362-6c0036c2ec37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:36.328610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8cf0-92c5-4d45-9362-6c0036c2ec37 service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:36.329050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8cf0-92c5-4d45-9362-6c0036c2ec37 service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:36.329565 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8cf0-92c5-4d45-9362-6c0036c2ec37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:36.342218 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd8cf0-92c5-4d45-9362-6c0036c2ec37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:36.344045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd8cf0-92c5-4d45-9362-6c0036c2ec37 service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:36.365679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1168/2361] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:23:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:23:36.428002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d8880dff-b194-49f6-9673-bb80288336dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b83a616fb2674d59a0f09dce57937bf7', 'request_id': 'req-d8880dff-b194-49f6-9673-bb80288336dd'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:36.531982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d8880dff-b194-49f6-9673-bb80288336dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b83a616fb2674d59a0f09dce57937bf7', 'request_id': 'req-d8880dff-b194-49f6-9673-bb80288336dd'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:36.566201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d8880dff-b194-49f6-9673-bb80288336dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b83a616fb2674d59a0f09dce57937bf7', 'request_id': 'req-d8880dff-b194-49f6-9673-bb80288336dd'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:36.598129 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d8880dff-b194-49f6-9673-bb80288336dd admin admin] The token cache is being invalidate because project b83a616fb2674d59a0f09dce57937bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:23:36.598762 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d8880dff-b194-49f6-9673-bb80288336dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:36.606436 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-d8880dff-b194-49f6-9673-bb80288336dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:36.610561 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1194/2362] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:23:36 2022] DELETE /identity/v3/projects/b83a616fb2674d59a0f09dce57937bf7 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:23:36.618556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd7e67-f0c9-4c35-beeb-39f723751168 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:36.618906 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd7e67-f0c9-4c35-beeb-39f723751168 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:36.619405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd7e67-f0c9-4c35-beeb-39f723751168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:36.671622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-18dd7e67-f0c9-4c35-beeb-39f723751168 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:36.679566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-18dd7e67-f0c9-4c35-beeb-39f723751168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:36.901985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1169/2363] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:36.915643 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09f7a4-824e-4ac9-85f0-32472fe75cd7 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:36.916853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09f7a4-824e-4ac9-85f0-32472fe75cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:36.917350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09f7a4-824e-4ac9-85f0-32472fe75cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:36.992480 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-6e09f7a4-824e-4ac9-85f0-32472fe75cd7 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:36.994849 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6e09f7a4-824e-4ac9-85f0-32472fe75cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:37.030999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1195/2364] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:37.033369 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd7e67-f0c9-4c35-beeb-39f723751168 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:37.116140 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd7e67-f0c9-4c35-beeb-39f723751168 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:37.144812 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54febd89-b102-4520-9ad9-4c6473d77b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:37.145917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54febd89-b102-4520-9ad9-4c6473d77b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:37.146448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54febd89-b102-4520-9ad9-4c6473d77b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:37.146943 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54febd89-b102-4520-9ad9-4c6473d77b05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:37.148281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54febd89-b102-4520-9ad9-4c6473d77b05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:23:37.148840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54febd89-b102-4520-9ad9-4c6473d77b05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:37.164896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54febd89-b102-4520-9ad9-4c6473d77b05 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:37.263644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1170/2365] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:23:37.264315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09f7a4-824e-4ac9-85f0-32472fe75cd7 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:37.275697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09f7a4-824e-4ac9-85f0-32472fe75cd7 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:37.327510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22cc36-f5f9-453b-9219-dd9a472daaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:37.328185 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22cc36-f5f9-453b-9219-dd9a472daaf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:37.328475 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22cc36-f5f9-453b-9219-dd9a472daaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:37.332604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22cc36-f5f9-453b-9219-dd9a472daaf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:37.337105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22cc36-f5f9-453b-9219-dd9a472daaf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:37.345456 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22cc36-f5f9-453b-9219-dd9a472daaf1 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:37.564955 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1196/2366] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:23:37 2022] POST /identity/v3/projects => generated 397 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:23:37.570954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54febd89-b102-4520-9ad9-4c6473d77b05 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:37.588880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:37.626109 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54febd89-b102-4520-9ad9-4c6473d77b05 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:37.660833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:37.965718 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298bb77-08ed-4b78-80b0-0884a4e6002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:37.966905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298bb77-08ed-4b78-80b0-0884a4e6002f admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:37.970713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298bb77-08ed-4b78-80b0-0884a4e6002f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:37.970713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298bb77-08ed-4b78-80b0-0884a4e6002f admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:37.970713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298bb77-08ed-4b78-80b0-0884a4e6002f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:37.977843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298bb77-08ed-4b78-80b0-0884a4e6002f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:38.205364 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1171/2367] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:23:37 2022] POST /identity/v3/users => generated 299 bytes in 634 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:23:38.211872 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22cc36-f5f9-453b-9219-dd9a472daaf1 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:38.251332 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22cc36-f5f9-453b-9219-dd9a472daaf1 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:38.258726 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbfb9b-4b3e-420a-9a6e-6062e83f6e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:38.259654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbfb9b-4b3e-420a-9a6e-6062e83f6e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:38.260016 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbfb9b-4b3e-420a-9a6e-6062e83f6e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:38.260371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbfb9b-4b3e-420a-9a6e-6062e83f6e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:38.261213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbfb9b-4b3e-420a-9a6e-6062e83f6e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:38.263634 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbfb9b-4b3e-420a-9a6e-6062e83f6e29 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:38.316263 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1197/2368] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:23:38.323466 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298bb77-08ed-4b78-80b0-0884a4e6002f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:38.356260 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298bb77-08ed-4b78-80b0-0884a4e6002f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:38.370086 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb605ac-1536-4707-bc74-4376dee5e501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:38.374223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb605ac-1536-4707-bc74-4376dee5e501 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:38.375216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb605ac-1536-4707-bc74-4376dee5e501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:38.377393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb605ac-1536-4707-bc74-4376dee5e501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:38.378993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb605ac-1536-4707-bc74-4376dee5e501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:38.382616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb605ac-1536-4707-bc74-4376dee5e501 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:38.433061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1172/2369] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:23:38.437214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbfb9b-4b3e-420a-9a6e-6062e83f6e29 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:38.500301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:38.530110 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbfb9b-4b3e-420a-9a6e-6062e83f6e29 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:38.570089 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff2755-e25e-4a79-b0d6-9d5f2b740123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:38.572279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff2755-e25e-4a79-b0d6-9d5f2b740123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:38.574888 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff2755-e25e-4a79-b0d6-9d5f2b740123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:38.576594 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff2755-e25e-4a79-b0d6-9d5f2b740123 admin admin] PATH_INFO: `/v3/projects/4762adcea31c44a784aaee62fcda5480/users/8020e5a06a714932a3d418dec0c64b28/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:38.656351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff2755-e25e-4a79-b0d6-9d5f2b740123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4762adcea31c44a784aaee62fcda5480, user_id=8020e5a06a714932a3d418dec0c64b28, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:38.662063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff2755-e25e-4a79-b0d6-9d5f2b740123 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:38.803417 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1198/2370] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:23:38 2022] PUT /identity/v3/projects/4762adcea31c44a784aaee62fcda5480/users/8020e5a06a714932a3d418dec0c64b28/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:23:38.830072 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a268a-6d2e-469b-a14d-bc7fde7acce0 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:38.833391 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a268a-6d2e-469b-a14d-bc7fde7acce0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:38.834774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a268a-6d2e-469b-a14d-bc7fde7acce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:39.001842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1a5a268a-6d2e-469b-a14d-bc7fde7acce0 None None] MFA Rules not processed for user `8020e5a06a714932a3d418dec0c64b28`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:39.006957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1a5a268a-6d2e-469b-a14d-bc7fde7acce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:39.198114 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1173/2371] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:23:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:39.213149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff2755-e25e-4a79-b0d6-9d5f2b740123 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:39.216093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-61ff2755-e25e-4a79-b0d6-9d5f2b740123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:39.322007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff2755-e25e-4a79-b0d6-9d5f2b740123 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:39.328674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ce220-8990-48cc-9d11-26cbe9fe1d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:39.331105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ce220-8990-48cc-9d11-26cbe9fe1d5a service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:39.332079 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ce220-8990-48cc-9d11-26cbe9fe1d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:39.332613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ce220-8990-48cc-9d11-26cbe9fe1d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:39.349399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ce220-8990-48cc-9d11-26cbe9fe1d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:39.353195 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ce220-8990-48cc-9d11-26cbe9fe1d5a service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:39.373575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1199/2372] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:23:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:39.870328 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:39.918213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:40.279823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:40.830324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:41.477635 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:41.510949 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:42.185015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:43.230944 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:44.043321 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:44.784827 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:46.469525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:49.131783 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f160c-8d9e-4c07-9cef-9c09cd1db31c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:49.132865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f160c-8d9e-4c07-9cef-9c09cd1db31c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:49.132865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f160c-8d9e-4c07-9cef-9c09cd1db31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:49.214854 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5f6f160c-8d9e-4c07-9cef-9c09cd1db31c None None] MFA Rules not processed for user `e9fe8b6818fa44d6a459589de462c8da`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:49.217246 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5f6f160c-8d9e-4c07-9cef-9c09cd1db31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:49.409717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1174/2373] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:23:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:49.410448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ce220-8990-48cc-9d11-26cbe9fe1d5a service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:49.412388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-1f9ce220-8990-48cc-9d11-26cbe9fe1d5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:49.700028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ce220-8990-48cc-9d11-26cbe9fe1d5a service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:49.713615 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c4a22-69f1-4ee6-bbc9-5b720f982c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:49.716935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c4a22-69f1-4ee6-bbc9-5b720f982c07 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:49.717776 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c4a22-69f1-4ee6-bbc9-5b720f982c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:49.719855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c4a22-69f1-4ee6-bbc9-5b720f982c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:49.724364 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c4a22-69f1-4ee6-bbc9-5b720f982c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:49.729940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c4a22-69f1-4ee6-bbc9-5b720f982c07 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:49.781411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:49.916552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1200/2374] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:23:49 2022] POST /identity/v3/projects => generated 385 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:23:49.922213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f160c-8d9e-4c07-9cef-9c09cd1db31c None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:49.967619 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f160c-8d9e-4c07-9cef-9c09cd1db31c None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:50.193094 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c107ee1-f694-4201-936c-29e9c1968bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:50.194232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c107ee1-f694-4201-936c-29e9c1968bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:50.211411 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c107ee1-f694-4201-936c-29e9c1968bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:50.212088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c107ee1-f694-4201-936c-29e9c1968bdd admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:50.213463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c107ee1-f694-4201-936c-29e9c1968bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:50.227439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c107ee1-f694-4201-936c-29e9c1968bdd admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:50.492340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c4a22-69f1-4ee6-bbc9-5b720f982c07 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:50.501459 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1175/2375] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:23:49 2022] POST /identity/v3/users => generated 299 bytes in 581 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:23:50.522071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c4a22-69f1-4ee6-bbc9-5b720f982c07 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:50.534992 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145bd0c-5f4b-4d0e-b25e-a7ae283d8731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:50.536518 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145bd0c-5f4b-4d0e-b25e-a7ae283d8731 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:50.537394 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145bd0c-5f4b-4d0e-b25e-a7ae283d8731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:50.538096 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145bd0c-5f4b-4d0e-b25e-a7ae283d8731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:50.539699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145bd0c-5f4b-4d0e-b25e-a7ae283d8731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:50.546463 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145bd0c-5f4b-4d0e-b25e-a7ae283d8731 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:50.579265 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1201/2376] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:23:50.592083 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c107ee1-f694-4201-936c-29e9c1968bdd admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:50.651509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c107ee1-f694-4201-936c-29e9c1968bdd admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:50.659719 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566557a3-34a9-4a7d-8410-e69834dd20ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:50.660775 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566557a3-34a9-4a7d-8410-e69834dd20ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:50.661215 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566557a3-34a9-4a7d-8410-e69834dd20ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:50.661679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566557a3-34a9-4a7d-8410-e69834dd20ac admin admin] PATH_INFO: `/v3/projects/c82f8ab2ff8b4a27a984b7d5a5680d0f/users/cef21c06a45b4f32b69078ff8e85f293/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:50.701329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566557a3-34a9-4a7d-8410-e69834dd20ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82f8ab2ff8b4a27a984b7d5a5680d0f, user_id=cef21c06a45b4f32b69078ff8e85f293, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:50.707543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566557a3-34a9-4a7d-8410-e69834dd20ac admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:50.817134 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:50.821112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1176/2377] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:23:50 2022] PUT /identity/v3/projects/c82f8ab2ff8b4a27a984b7d5a5680d0f/users/cef21c06a45b4f32b69078ff8e85f293/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:23:50.826910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145bd0c-5f4b-4d0e-b25e-a7ae283d8731 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:50.850003 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145bd0c-5f4b-4d0e-b25e-a7ae283d8731 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:51.084949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e1093-5f56-45a0-b746-6ad7ffa882b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:51.086176 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e1093-5f56-45a0-b746-6ad7ffa882b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:51.086730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e1093-5f56-45a0-b746-6ad7ffa882b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:51.087284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e1093-5f56-45a0-b746-6ad7ffa882b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:51.088741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e1093-5f56-45a0-b746-6ad7ffa882b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:51.092246 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e1093-5f56-45a0-b746-6ad7ffa882b0 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:51.153958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1202/2378] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:23:51.164240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566557a3-34a9-4a7d-8410-e69834dd20ac admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:51.187077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566557a3-34a9-4a7d-8410-e69834dd20ac admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:51.208692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e1093-5f56-45a0-b746-6ad7ffa882b0 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:51.209900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5a2bd-7b5c-4eb3-a318-1a6d7eed247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:51.216887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5a2bd-7b5c-4eb3-a318-1a6d7eed247a admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:51.218509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5a2bd-7b5c-4eb3-a318-1a6d7eed247a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:51.219489 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5a2bd-7b5c-4eb3-a318-1a6d7eed247a admin admin] PATH_INFO: `/v3/projects/c82f8ab2ff8b4a27a984b7d5a5680d0f/users/cef21c06a45b4f32b69078ff8e85f293/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:51.235899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5a2bd-7b5c-4eb3-a318-1a6d7eed247a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82f8ab2ff8b4a27a984b7d5a5680d0f, user_id=cef21c06a45b4f32b69078ff8e85f293, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:51.245309 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5a2bd-7b5c-4eb3-a318-1a6d7eed247a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:51.261351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e1093-5f56-45a0-b746-6ad7ffa882b0 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:51.274149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf1fa1-3a5d-45f7-8f8a-c2d3a56419df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:51.274928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf1fa1-3a5d-45f7-8f8a-c2d3a56419df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:51.275221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf1fa1-3a5d-45f7-8f8a-c2d3a56419df admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:51.275560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf1fa1-3a5d-45f7-8f8a-c2d3a56419df admin admin] PATH_INFO: `/v3/users/8020e5a06a714932a3d418dec0c64b28` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:51.277552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf1fa1-3a5d-45f7-8f8a-c2d3a56419df admin admin] RBAC: Authorizing `identity:delete_user(user_id=8020e5a06a714932a3d418dec0c64b28)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:51.281017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1177/2379] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:23:51 2022] PUT /identity/v3/projects/c82f8ab2ff8b4a27a984b7d5a5680d0f/users/cef21c06a45b4f32b69078ff8e85f293/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:23:51.286428 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf1fa1-3a5d-45f7-8f8a-c2d3a56419df admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:51.598676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-c7bf1fa1-3a5d-45f7-8f8a-c2d3a56419df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8020e5a06a714932a3d418dec0c64b28'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:51.600190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-c7bf1fa1-3a5d-45f7-8f8a-c2d3a56419df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8020e5a06a714932a3d418dec0c64b28'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:51.745143 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-c7bf1fa1-3a5d-45f7-8f8a-c2d3a56419df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8020e5a06a714932a3d418dec0c64b28'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:52.020164 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-c7bf1fa1-3a5d-45f7-8f8a-c2d3a56419df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8020e5a06a714932a3d418dec0c64b28'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:52.022629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-c7bf1fa1-3a5d-45f7-8f8a-c2d3a56419df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8020e5a06a714932a3d418dec0c64b28'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:52.110295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1203/2380] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:23:51 2022] DELETE /identity/v3/users/8020e5a06a714932a3d418dec0c64b28 => generated 0 bytes in 900 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:23:52.114603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946fd56-682a-4488-8d59-8145e3259924 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:52.114603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946fd56-682a-4488-8d59-8145e3259924 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:52.114603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946fd56-682a-4488-8d59-8145e3259924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:52.184440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a946fd56-682a-4488-8d59-8145e3259924 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:52.193032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a946fd56-682a-4488-8d59-8145e3259924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:52.592213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1178/2381] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:52.604521 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf1fa1-3a5d-45f7-8f8a-c2d3a56419df admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:52.609076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c7bf1fa1-3a5d-45f7-8f8a-c2d3a56419df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:52.822830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf1fa1-3a5d-45f7-8f8a-c2d3a56419df admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:52.829588 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb7160-8f3c-4edf-8dac-a44a2ef0dbff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:52.831331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb7160-8f3c-4edf-8dac-a44a2ef0dbff service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:52.831933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb7160-8f3c-4edf-8dac-a44a2ef0dbff service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:52.832443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb7160-8f3c-4edf-8dac-a44a2ef0dbff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:52.844143 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:52.853125 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb7160-8f3c-4edf-8dac-a44a2ef0dbff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:52.856127 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb7160-8f3c-4edf-8dac-a44a2ef0dbff service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:52.874773 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1204/2382] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:53.930378 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946fd56-682a-4488-8d59-8145e3259924 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:53.932739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a946fd56-682a-4488-8d59-8145e3259924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:53.962738 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946fd56-682a-4488-8d59-8145e3259924 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:53.994114 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11c7c6-2b61-47a9-b601-54b3813d6389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:53.996952 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11c7c6-2b61-47a9-b601-54b3813d6389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:53.997373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11c7c6-2b61-47a9-b601-54b3813d6389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:53.997789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11c7c6-2b61-47a9-b601-54b3813d6389 admin admin] PATH_INFO: `/v3/projects/4762adcea31c44a784aaee62fcda5480` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:54.000133 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11c7c6-2b61-47a9-b601-54b3813d6389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4762adcea31c44a784aaee62fcda5480)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:54.004627 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11c7c6-2b61-47a9-b601-54b3813d6389 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:54.247730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bd11c7c6-2b61-47a9-b601-54b3813d6389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4762adcea31c44a784aaee62fcda5480', 'request_id': 'req-bd11c7c6-2b61-47a9-b601-54b3813d6389'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:54.259361 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bd11c7c6-2b61-47a9-b601-54b3813d6389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4762adcea31c44a784aaee62fcda5480', 'request_id': 'req-bd11c7c6-2b61-47a9-b601-54b3813d6389'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:54.272334 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bd11c7c6-2b61-47a9-b601-54b3813d6389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4762adcea31c44a784aaee62fcda5480', 'request_id': 'req-bd11c7c6-2b61-47a9-b601-54b3813d6389'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:54.425834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bd11c7c6-2b61-47a9-b601-54b3813d6389 admin admin] The token cache is being invalidate because project 4762adcea31c44a784aaee62fcda5480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:23:54.426576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bd11c7c6-2b61-47a9-b601-54b3813d6389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:54.427826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bd11c7c6-2b61-47a9-b601-54b3813d6389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:23:54.430709 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1179/2383] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:23:53 2022] DELETE /identity/v3/projects/4762adcea31c44a784aaee62fcda5480 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:24:00.444602 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb7160-8f3c-4edf-8dac-a44a2ef0dbff service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:00.446861 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-53fb7160-8f3c-4edf-8dac-a44a2ef0dbff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:00.470530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb7160-8f3c-4edf-8dac-a44a2ef0dbff service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:00.546596 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e95d7f-7ff6-413e-b6a1-ed7929328d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:00.547697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e95d7f-7ff6-413e-b6a1-ed7929328d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:00.548175 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e95d7f-7ff6-413e-b6a1-ed7929328d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:00.548634 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e95d7f-7ff6-413e-b6a1-ed7929328d4b admin admin] PATH_INFO: `/v3/users/7d2ac4abe7f04f7e861157588e42485c` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:00.550416 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e95d7f-7ff6-413e-b6a1-ed7929328d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d2ac4abe7f04f7e861157588e42485c)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:00.552686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e95d7f-7ff6-413e-b6a1-ed7929328d4b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:00.823884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-85e95d7f-7ff6-413e-b6a1-ed7929328d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d2ac4abe7f04f7e861157588e42485c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:00.824605 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-85e95d7f-7ff6-413e-b6a1-ed7929328d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d2ac4abe7f04f7e861157588e42485c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:00.840007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-85e95d7f-7ff6-413e-b6a1-ed7929328d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d2ac4abe7f04f7e861157588e42485c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:00.950912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-85e95d7f-7ff6-413e-b6a1-ed7929328d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d2ac4abe7f04f7e861157588e42485c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:00.952113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-85e95d7f-7ff6-413e-b6a1-ed7929328d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d2ac4abe7f04f7e861157588e42485c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:00.980489 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1205/2384] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:24:00 2022] DELETE /identity/v3/users/7d2ac4abe7f04f7e861157588e42485c => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:24:01.507682 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11c7c6-2b61-47a9-b601-54b3813d6389 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:01.512286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bd11c7c6-2b61-47a9-b601-54b3813d6389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:01.562070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11c7c6-2b61-47a9-b601-54b3813d6389 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:01.678462 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed371d-7da1-4fe7-8377-4d0519f78cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:01.679451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed371d-7da1-4fe7-8377-4d0519f78cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:01.679749 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed371d-7da1-4fe7-8377-4d0519f78cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:01.680038 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed371d-7da1-4fe7-8377-4d0519f78cce admin admin] PATH_INFO: `/v3/projects/cdeb1ef208c84b018a3d160c42a8d448` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:01.683820 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed371d-7da1-4fe7-8377-4d0519f78cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdeb1ef208c84b018a3d160c42a8d448)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:01.686816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed371d-7da1-4fe7-8377-4d0519f78cce admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:01.709059 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:01.978570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-00ed371d-7da1-4fe7-8377-4d0519f78cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdeb1ef208c84b018a3d160c42a8d448', 'request_id': 'req-00ed371d-7da1-4fe7-8377-4d0519f78cce'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:02.005582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-00ed371d-7da1-4fe7-8377-4d0519f78cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdeb1ef208c84b018a3d160c42a8d448', 'request_id': 'req-00ed371d-7da1-4fe7-8377-4d0519f78cce'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:02.055814 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-00ed371d-7da1-4fe7-8377-4d0519f78cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdeb1ef208c84b018a3d160c42a8d448', 'request_id': 'req-00ed371d-7da1-4fe7-8377-4d0519f78cce'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:02.157843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-00ed371d-7da1-4fe7-8377-4d0519f78cce admin admin] The token cache is being invalidate because project cdeb1ef208c84b018a3d160c42a8d448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:24:02.159403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-00ed371d-7da1-4fe7-8377-4d0519f78cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:02.161082 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-00ed371d-7da1-4fe7-8377-4d0519f78cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:02.166440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1180/2385] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:24:01 2022] DELETE /identity/v3/projects/cdeb1ef208c84b018a3d160c42a8d448 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:24:02.169702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e95d7f-7ff6-413e-b6a1-ed7929328d4b admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:02.173949 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-85e95d7f-7ff6-413e-b6a1-ed7929328d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:02.199170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e95d7f-7ff6-413e-b6a1-ed7929328d4b admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:02.358381 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56e4a2-f966-45aa-b438-445a6482c76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:02.361384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56e4a2-f966-45aa-b438-445a6482c76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:02.362574 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56e4a2-f966-45aa-b438-445a6482c76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:02.363007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56e4a2-f966-45aa-b438-445a6482c76e admin admin] PATH_INFO: `/v3/users/d8a260d24b67412982e0d79165b20d8e` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:02.368848 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56e4a2-f966-45aa-b438-445a6482c76e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a260d24b67412982e0d79165b20d8e)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:02.375643 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56e4a2-f966-45aa-b438-445a6482c76e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:02.441337 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:02.736274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1a56e4a2-f966-45aa-b438-445a6482c76e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a260d24b67412982e0d79165b20d8e'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:02.739009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1a56e4a2-f966-45aa-b438-445a6482c76e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a260d24b67412982e0d79165b20d8e'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:02.775787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1a56e4a2-f966-45aa-b438-445a6482c76e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a260d24b67412982e0d79165b20d8e'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:02.911832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1a56e4a2-f966-45aa-b438-445a6482c76e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a260d24b67412982e0d79165b20d8e'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:02.912511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1a56e4a2-f966-45aa-b438-445a6482c76e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a260d24b67412982e0d79165b20d8e'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:02.958045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1206/2386] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:24:02 2022] DELETE /identity/v3/users/d8a260d24b67412982e0d79165b20d8e => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:24:03.032919 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c17f96-0986-43ba-8ac6-08b79b54111f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:03.035958 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c17f96-0986-43ba-8ac6-08b79b54111f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:03.036785 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c17f96-0986-43ba-8ac6-08b79b54111f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:03.106528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c6c17f96-0986-43ba-8ac6-08b79b54111f None None] MFA Rules not processed for user `cef21c06a45b4f32b69078ff8e85f293`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:03.108801 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c6c17f96-0986-43ba-8ac6-08b79b54111f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:03.318132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1181/2387] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:24:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:03.351863 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56e4a2-f966-45aa-b438-445a6482c76e admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:03.355912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-1a56e4a2-f966-45aa-b438-445a6482c76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:03.639310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56e4a2-f966-45aa-b438-445a6482c76e admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:03.647896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeaf54e-eeca-4ca3-9acb-3a22311e544d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d85dc9f9f15480db927e617c992e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:03.650170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaf54e-eeca-4ca3-9acb-3a22311e544d service glance] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:03.650170 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaf54e-eeca-4ca3-9acb-3a22311e544d service glance] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:03.652961 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaf54e-eeca-4ca3-9acb-3a22311e544d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:03.653891 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-afeaf54e-eeca-4ca3-9acb-3a22311e544d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:03.691238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c17f96-0986-43ba-8ac6-08b79b54111f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:03.693673 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c6c17f96-0986-43ba-8ac6-08b79b54111f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:03.887884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeaf54e-eeca-4ca3-9acb-3a22311e544d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:03.891819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeaf54e-eeca-4ca3-9acb-3a22311e544d service glance] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:03.902350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c17f96-0986-43ba-8ac6-08b79b54111f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:03.913257 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b1fba-4438-465f-bd72-ac32362a921f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:03.914654 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b1fba-4438-465f-bd72-ac32362a921f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:03.915362 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b1fba-4438-465f-bd72-ac32362a921f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:03.915858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b1fba-4438-465f-bd72-ac32362a921f admin admin] PATH_INFO: `/v3/projects/b4dc5d5e79ef42b39acfdf6bbf7a4883` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:03.918314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b1fba-4438-465f-bd72-ac32362a921f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4dc5d5e79ef42b39acfdf6bbf7a4883)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:03.921941 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b1fba-4438-465f-bd72-ac32362a921f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:03.925476 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1207/2388] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:24:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:04.085445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:04.182211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6c5b1fba-4438-465f-bd72-ac32362a921f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4dc5d5e79ef42b39acfdf6bbf7a4883', 'request_id': 'req-6c5b1fba-4438-465f-bd72-ac32362a921f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:04.206516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6c5b1fba-4438-465f-bd72-ac32362a921f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4dc5d5e79ef42b39acfdf6bbf7a4883', 'request_id': 'req-6c5b1fba-4438-465f-bd72-ac32362a921f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:04.219014 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6c5b1fba-4438-465f-bd72-ac32362a921f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4dc5d5e79ef42b39acfdf6bbf7a4883', 'request_id': 'req-6c5b1fba-4438-465f-bd72-ac32362a921f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:04.319725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6c5b1fba-4438-465f-bd72-ac32362a921f admin admin] The token cache is being invalidate because project b4dc5d5e79ef42b39acfdf6bbf7a4883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:24:04.320552 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6c5b1fba-4438-465f-bd72-ac32362a921f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:04.321964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6c5b1fba-4438-465f-bd72-ac32362a921f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:04.325197 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1182/2389] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:24:03 2022] DELETE /identity/v3/projects/b4dc5d5e79ef42b39acfdf6bbf7a4883 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:24:04.333403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf8eb3-9f90-42f1-b3d1-0d8456c1260a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:04.334288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf8eb3-9f90-42f1-b3d1-0d8456c1260a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:04.334845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf8eb3-9f90-42f1-b3d1-0d8456c1260a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:04.385311 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-5fbf8eb3-9f90-42f1-b3d1-0d8456c1260a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:04.389987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdb13e-2032-4752-b652-589a3201c9b5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:04.390850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdb13e-2032-4752-b652-589a3201c9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:04.391175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdb13e-2032-4752-b652-589a3201c9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:04.396839 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5fbf8eb3-9f90-42f1-b3d1-0d8456c1260a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:04.447001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c1bdb13e-2032-4752-b652-589a3201c9b5 None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:04.448314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c1bdb13e-2032-4752-b652-589a3201c9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:04.544672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:04.585466 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1208/2390] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:04.688376 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1183/2391] 10.222.0.98 () {58 vars in 1009 bytes} [Tue Jul 26 15:24:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:04.699081 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5cde2-80ae-4a2c-82c0-6417bbf3f2ac None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:04.699922 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5cde2-80ae-4a2c-82c0-6417bbf3f2ac None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:04.700775 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5cde2-80ae-4a2c-82c0-6417bbf3f2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:04.739138 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdb13e-2032-4752-b652-589a3201c9b5 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:04.750651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c1bdb13e-2032-4752-b652-589a3201c9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:04.755290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-19e5cde2-80ae-4a2c-82c0-6417bbf3f2ac None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:04.756604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-19e5cde2-80ae-4a2c-82c0-6417bbf3f2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:04.770420 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1209/2392] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:04.775236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5cde2-80ae-4a2c-82c0-6417bbf3f2ac None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:04.812660 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5cde2-80ae-4a2c-82c0-6417bbf3f2ac None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:04.844077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5eeeb-e119-4bb6-aa5f-67c0eb186775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:04.848115 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5eeeb-e119-4bb6-aa5f-67c0eb186775 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:04.849411 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5eeeb-e119-4bb6-aa5f-67c0eb186775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:04.852720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5eeeb-e119-4bb6-aa5f-67c0eb186775 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:04.855331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5eeeb-e119-4bb6-aa5f-67c0eb186775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:04.855697 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5eeeb-e119-4bb6-aa5f-67c0eb186775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:04.859701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5eeeb-e119-4bb6-aa5f-67c0eb186775 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:04.884024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1210/2393] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:04.884024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0cac3-06b6-4c6f-ba5a-9336cff32eab None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:04.884024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0cac3-06b6-4c6f-ba5a-9336cff32eab None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:04.884024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0cac3-06b6-4c6f-ba5a-9336cff32eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:04.913558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d6e0cac3-06b6-4c6f-ba5a-9336cff32eab None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:04.915177 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d6e0cac3-06b6-4c6f-ba5a-9336cff32eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:04.930796 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1211/2394] 10.222.0.98 () {58 vars in 967 bytes} [Tue Jul 26 15:24:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:04.932274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0cac3-06b6-4c6f-ba5a-9336cff32eab None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:04.955026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0cac3-06b6-4c6f-ba5a-9336cff32eab None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:04.960891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdb13e-2032-4752-b652-589a3201c9b5 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:04.962921 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88876169-6105-4c2f-a2a4-4a2024bc3af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:04.963580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88876169-6105-4c2f-a2a4-4a2024bc3af1 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:04.963905 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88876169-6105-4c2f-a2a4-4a2024bc3af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:04.964132 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88876169-6105-4c2f-a2a4-4a2024bc3af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:04.964815 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88876169-6105-4c2f-a2a4-4a2024bc3af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:04.966875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88876169-6105-4c2f-a2a4-4a2024bc3af1 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:04.972093 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf9f58-c797-4e91-8196-cbb01fb345a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:04.974014 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf9f58-c797-4e91-8196-cbb01fb345a0 service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:04.975025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf9f58-c797-4e91-8196-cbb01fb345a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:04.975548 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf9f58-c797-4e91-8196-cbb01fb345a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:04.995780 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf9f58-c797-4e91-8196-cbb01fb345a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:04.998975 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf9f58-c797-4e91-8196-cbb01fb345a0 service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:05.017491 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1184/2395] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:24:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:24:05.019145 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf9f58-c797-4e91-8196-cbb01fb345a0 service swift] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:05.062632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf9f58-c797-4e91-8196-cbb01fb345a0 service swift] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:05.083678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec442-5d9e-44a1-acd2-fa93e81d930d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:05.085168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec442-5d9e-44a1-acd2-fa93e81d930d service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:05.086026 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec442-5d9e-44a1-acd2-fa93e81d930d service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:05.087829 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec442-5d9e-44a1-acd2-fa93e81d930d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:05.111358 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec442-5d9e-44a1-acd2-fa93e81d930d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:05.116123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec442-5d9e-44a1-acd2-fa93e81d930d service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:05.133397 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1185/2396] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:24:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:24:05.147459 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1212/2397] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:24:04 2022] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:24:05.159184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec442-5d9e-44a1-acd2-fa93e81d930d service swift] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:05.181634 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec442-5d9e-44a1-acd2-fa93e81d930d service swift] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:05.337477 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:05.431178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151694c3-2a49-4353-8a31-0fe5c11015a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:05.436565 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151694c3-2a49-4353-8a31-0fe5c11015a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:05.436565 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151694c3-2a49-4353-8a31-0fe5c11015a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:05.436565 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151694c3-2a49-4353-8a31-0fe5c11015a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:05.436565 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151694c3-2a49-4353-8a31-0fe5c11015a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:05.436565 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151694c3-2a49-4353-8a31-0fe5c11015a4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:05.621394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1186/2398] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:24:05 2022] POST /identity/v3/users => generated 287 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:24:05.627969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88876169-6105-4c2f-a2a4-4a2024bc3af1 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:05.664357 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88876169-6105-4c2f-a2a4-4a2024bc3af1 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:05.680390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933db11c-9b3d-4192-9658-8782a2c7e6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:05.681129 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933db11c-9b3d-4192-9658-8782a2c7e6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:05.681415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933db11c-9b3d-4192-9658-8782a2c7e6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:05.703063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933db11c-9b3d-4192-9658-8782a2c7e6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:05.704475 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933db11c-9b3d-4192-9658-8782a2c7e6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:05.707845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933db11c-9b3d-4192-9658-8782a2c7e6d6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:05.742295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1213/2399] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:24:05.747896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151694c3-2a49-4353-8a31-0fe5c11015a4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:05.770447 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151694c3-2a49-4353-8a31-0fe5c11015a4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:05.792944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d3f8b-96ad-491d-84be-e2d5871e2ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:05.793607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3f8b-96ad-491d-84be-e2d5871e2ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:05.793978 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3f8b-96ad-491d-84be-e2d5871e2ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:05.794433 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3f8b-96ad-491d-84be-e2d5871e2ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:05.795620 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d3f8b-96ad-491d-84be-e2d5871e2ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:05.797817 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d3f8b-96ad-491d-84be-e2d5871e2ffc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:05.842948 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933db11c-9b3d-4192-9658-8782a2c7e6d6 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:05.844121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1187/2400] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:24:05.858067 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933db11c-9b3d-4192-9658-8782a2c7e6d6 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:05.884136 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08e61b-c47a-48f2-a0a1-331d9436bafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:05.888740 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08e61b-c47a-48f2-a0a1-331d9436bafd admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:05.889253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08e61b-c47a-48f2-a0a1-331d9436bafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:05.892434 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08e61b-c47a-48f2-a0a1-331d9436bafd admin admin] PATH_INFO: `/v3/projects/97aceb2e90c54cb79c80cf2ec2eef15d/users/25ea3b1f1fe34b179a3f6ebc1c137428/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:05.974831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08e61b-c47a-48f2-a0a1-331d9436bafd admin admin] RBAC: Authorizing `identity:create_grant(project_id=97aceb2e90c54cb79c80cf2ec2eef15d, user_id=25ea3b1f1fe34b179a3f6ebc1c137428, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:05.980554 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08e61b-c47a-48f2-a0a1-331d9436bafd admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:06.114831 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1214/2401] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:24:05 2022] PUT /identity/v3/projects/97aceb2e90c54cb79c80cf2ec2eef15d/users/25ea3b1f1fe34b179a3f6ebc1c137428/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:24:06.124719 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056c84f-ff33-467b-8829-0067b11982eb None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:06.125451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056c84f-ff33-467b-8829-0067b11982eb None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:06.125451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056c84f-ff33-467b-8829-0067b11982eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:06.177228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a056c84f-ff33-467b-8829-0067b11982eb None None] MFA Rules not processed for user `25ea3b1f1fe34b179a3f6ebc1c137428`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:06.179632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a056c84f-ff33-467b-8829-0067b11982eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:06.324994 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1188/2402] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:24:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:06.338757 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08e61b-c47a-48f2-a0a1-331d9436bafd admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:06.340892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8c08e61b-c47a-48f2-a0a1-331d9436bafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:06.516954 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08e61b-c47a-48f2-a0a1-331d9436bafd admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:06.536134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e18e0-b31c-4dc8-8239-043efa2ea304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:06.539382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e18e0-b31c-4dc8-8239-043efa2ea304 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:06.539670 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e18e0-b31c-4dc8-8239-043efa2ea304 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:06.539956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e18e0-b31c-4dc8-8239-043efa2ea304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:06.571736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e18e0-b31c-4dc8-8239-043efa2ea304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:06.572426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e18e0-b31c-4dc8-8239-043efa2ea304 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:06.592940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1215/2403] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:24:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:13.457340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056c84f-ff33-467b-8829-0067b11982eb None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:13.729201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056c84f-ff33-467b-8829-0067b11982eb None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:13.737126 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb71e3-bf2c-4470-8b42-e12d9bd7df93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:13.737556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb71e3-bf2c-4470-8b42-e12d9bd7df93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:13.737832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb71e3-bf2c-4470-8b42-e12d9bd7df93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:13.738105 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb71e3-bf2c-4470-8b42-e12d9bd7df93 admin admin] PATH_INFO: `/v3/users/25ea3b1f1fe34b179a3f6ebc1c137428` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:13.739576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb71e3-bf2c-4470-8b42-e12d9bd7df93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25ea3b1f1fe34b179a3f6ebc1c137428)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:13.745182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb71e3-bf2c-4470-8b42-e12d9bd7df93 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:14.068211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:14.071163 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1fbb71e3-bf2c-4470-8b42-e12d9bd7df93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25ea3b1f1fe34b179a3f6ebc1c137428'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:14.075503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1fbb71e3-bf2c-4470-8b42-e12d9bd7df93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25ea3b1f1fe34b179a3f6ebc1c137428'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:14.119364 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1fbb71e3-bf2c-4470-8b42-e12d9bd7df93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25ea3b1f1fe34b179a3f6ebc1c137428'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:14.120372 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1fbb71e3-bf2c-4470-8b42-e12d9bd7df93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25ea3b1f1fe34b179a3f6ebc1c137428'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:14.202305 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1fbb71e3-bf2c-4470-8b42-e12d9bd7df93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25ea3b1f1fe34b179a3f6ebc1c137428'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:14.221896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1189/2404] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:24:13 2022] DELETE /identity/v3/users/25ea3b1f1fe34b179a3f6ebc1c137428 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:24:14.226409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfd77d-0726-4148-bbc4-61e52c6bcef4 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:14.227103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfd77d-0726-4148-bbc4-61e52c6bcef4 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:14.227103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfd77d-0726-4148-bbc4-61e52c6bcef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:14.256109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-5abfd77d-0726-4148-bbc4-61e52c6bcef4 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:14.257397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5abfd77d-0726-4148-bbc4-61e52c6bcef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:14.387331 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1216/2405] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:14.398111 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb71e3-bf2c-4470-8b42-e12d9bd7df93 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:14.399983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1fbb71e3-bf2c-4470-8b42-e12d9bd7df93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:14.558614 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb71e3-bf2c-4470-8b42-e12d9bd7df93 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:14.565430 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc9730-0e22-45eb-8048-25814e7aacfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:14.566726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc9730-0e22-45eb-8048-25814e7aacfd service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:14.567478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc9730-0e22-45eb-8048-25814e7aacfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:14.567940 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc9730-0e22-45eb-8048-25814e7aacfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:14.598595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc9730-0e22-45eb-8048-25814e7aacfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:14.598595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc9730-0e22-45eb-8048-25814e7aacfd service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:14.611158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1190/2406] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:24:15.818070 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfd77d-0726-4148-bbc4-61e52c6bcef4 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:15.822444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5abfd77d-0726-4148-bbc4-61e52c6bcef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:15.877776 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfd77d-0726-4148-bbc4-61e52c6bcef4 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:15.891278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee73a4a-f6ad-4e85-9069-742b6dd5d05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:15.892743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee73a4a-f6ad-4e85-9069-742b6dd5d05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:15.894095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee73a4a-f6ad-4e85-9069-742b6dd5d05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:15.894974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee73a4a-f6ad-4e85-9069-742b6dd5d05c admin admin] PATH_INFO: `/v3/projects/97aceb2e90c54cb79c80cf2ec2eef15d` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:15.897840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee73a4a-f6ad-4e85-9069-742b6dd5d05c admin admin] RBAC: Authorizing `identity:delete_project(project_id=97aceb2e90c54cb79c80cf2ec2eef15d)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:15.904910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee73a4a-f6ad-4e85-9069-742b6dd5d05c admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:15.910823 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:16.207934 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9ee73a4a-f6ad-4e85-9069-742b6dd5d05c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97aceb2e90c54cb79c80cf2ec2eef15d', 'request_id': 'req-9ee73a4a-f6ad-4e85-9069-742b6dd5d05c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:16.346981 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9ee73a4a-f6ad-4e85-9069-742b6dd5d05c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97aceb2e90c54cb79c80cf2ec2eef15d', 'request_id': 'req-9ee73a4a-f6ad-4e85-9069-742b6dd5d05c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:16.363161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9ee73a4a-f6ad-4e85-9069-742b6dd5d05c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97aceb2e90c54cb79c80cf2ec2eef15d', 'request_id': 'req-9ee73a4a-f6ad-4e85-9069-742b6dd5d05c'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:16.406755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9ee73a4a-f6ad-4e85-9069-742b6dd5d05c admin admin] The token cache is being invalidate because project 97aceb2e90c54cb79c80cf2ec2eef15d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:24:16.407124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9ee73a4a-f6ad-4e85-9069-742b6dd5d05c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:16.407782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9ee73a4a-f6ad-4e85-9069-742b6dd5d05c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:24:16.414715 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1217/2407] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:24:15 2022] DELETE /identity/v3/projects/97aceb2e90c54cb79c80cf2ec2eef15d => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:24:16.421925 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc71a39-906d-4fba-989d-8d6adccddb58 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.423630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc71a39-906d-4fba-989d-8d6adccddb58 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.424464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc71a39-906d-4fba-989d-8d6adccddb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.478514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-0fc71a39-906d-4fba-989d-8d6adccddb58 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:16.482476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0fc71a39-906d-4fba-989d-8d6adccddb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:16.695173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1191/2408] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:16.704016 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eab587-3868-4069-b70a-ead9cce4ccf3 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.704373 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eab587-3868-4069-b70a-ead9cce4ccf3 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.704688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eab587-3868-4069-b70a-ead9cce4ccf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.736042 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-14eab587-3868-4069-b70a-ead9cce4ccf3 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:16.739941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-14eab587-3868-4069-b70a-ead9cce4ccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:16.766002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1218/2409] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:16.768826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc71a39-906d-4fba-989d-8d6adccddb58 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:16.800717 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc71a39-906d-4fba-989d-8d6adccddb58 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:16.806547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fcf34-2888-4326-9f0d-4cba634cce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:16.808446 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fcf34-2888-4326-9f0d-4cba634cce8a admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.808446 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fcf34-2888-4326-9f0d-4cba634cce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.808446 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fcf34-2888-4326-9f0d-4cba634cce8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.809073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fcf34-2888-4326-9f0d-4cba634cce8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:16.809830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fcf34-2888-4326-9f0d-4cba634cce8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:16.811643 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fcf34-2888-4326-9f0d-4cba634cce8a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:16.839859 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eab587-3868-4069-b70a-ead9cce4ccf3 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:16.855603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eab587-3868-4069-b70a-ead9cce4ccf3 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:16.856587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1192/2410] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:16.864021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b7be0-9ae5-43a3-a460-d661d7453f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:16.865665 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b7be0-9ae5-43a3-a460-d661d7453f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.865900 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b7be0-9ae5-43a3-a460-d661d7453f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.866104 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b7be0-9ae5-43a3-a460-d661d7453f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.866753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b7be0-9ae5-43a3-a460-d661d7453f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:16.868743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b7be0-9ae5-43a3-a460-d661d7453f08 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:16.993480 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1219/2411] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:24:16 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:24:16.999142 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fcf34-2888-4326-9f0d-4cba634cce8a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:17.038729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fcf34-2888-4326-9f0d-4cba634cce8a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:17.149528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:17.164274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962c979-8600-4a76-a351-9f8d4aed1dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:17.165227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962c979-8600-4a76-a351-9f8d4aed1dcb admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:17.165716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962c979-8600-4a76-a351-9f8d4aed1dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:17.166167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962c979-8600-4a76-a351-9f8d4aed1dcb admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:17.167066 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962c979-8600-4a76-a351-9f8d4aed1dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:17.176512 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962c979-8600-4a76-a351-9f8d4aed1dcb admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:17.320578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1193/2412] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:24:16 2022] POST /identity/v3/users => generated 287 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:24:17.334032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b7be0-9ae5-43a3-a460-d661d7453f08 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:17.388532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b7be0-9ae5-43a3-a460-d661d7453f08 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:17.417803 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a6afe-c67b-4fcd-86fb-54733d1ba81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:17.421242 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a6afe-c67b-4fcd-86fb-54733d1ba81d admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:17.426616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a6afe-c67b-4fcd-86fb-54733d1ba81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:17.427471 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a6afe-c67b-4fcd-86fb-54733d1ba81d admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:17.428995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a6afe-c67b-4fcd-86fb-54733d1ba81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:17.432366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a6afe-c67b-4fcd-86fb-54733d1ba81d admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:17.468046 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1220/2413] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:24:17.470285 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962c979-8600-4a76-a351-9f8d4aed1dcb admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:17.490316 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962c979-8600-4a76-a351-9f8d4aed1dcb admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:17.511154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccbd17-2096-4c91-b176-e39df75359d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:17.512152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccbd17-2096-4c91-b176-e39df75359d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:17.512749 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccbd17-2096-4c91-b176-e39df75359d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:17.513175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccbd17-2096-4c91-b176-e39df75359d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:17.514180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccbd17-2096-4c91-b176-e39df75359d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:17.517325 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccbd17-2096-4c91-b176-e39df75359d3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:17.539244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1194/2414] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:24:17.546440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a6afe-c67b-4fcd-86fb-54733d1ba81d admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:17.563706 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a6afe-c67b-4fcd-86fb-54733d1ba81d admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:17.576541 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042fa84-d8a5-4391-8931-00726d9321e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:17.577406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042fa84-d8a5-4391-8931-00726d9321e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:17.577825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042fa84-d8a5-4391-8931-00726d9321e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:17.578202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042fa84-d8a5-4391-8931-00726d9321e7 admin admin] PATH_INFO: `/v3/projects/f0538f0c8a684994b1073fe0799fcc63/users/ecf4d21703524c848358fa365987339b/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:17.620701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042fa84-d8a5-4391-8931-00726d9321e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0538f0c8a684994b1073fe0799fcc63, user_id=ecf4d21703524c848358fa365987339b, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:17.625420 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042fa84-d8a5-4391-8931-00726d9321e7 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:17.767413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1221/2415] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:24:17 2022] PUT /identity/v3/projects/f0538f0c8a684994b1073fe0799fcc63/users/ecf4d21703524c848358fa365987339b/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:24:17.770237 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcc2f9-cdf0-4090-a1e3-f6f19c58ee62 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:17.770575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcc2f9-cdf0-4090-a1e3-f6f19c58ee62 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:17.770794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcc2f9-cdf0-4090-a1e3-f6f19c58ee62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:17.822172 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-46dcc2f9-cdf0-4090-a1e3-f6f19c58ee62 None None] MFA Rules not processed for user `ecf4d21703524c848358fa365987339b`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:17.824258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-46dcc2f9-cdf0-4090-a1e3-f6f19c58ee62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:18.016394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1195/2416] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:24:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:18.026567 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042fa84-d8a5-4391-8931-00726d9321e7 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:18.030102 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4042fa84-d8a5-4391-8931-00726d9321e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:18.179541 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042fa84-d8a5-4391-8931-00726d9321e7 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:18.188362 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517cd24-ce67-4e01-961e-2d52a6f4f945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:18.190398 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517cd24-ce67-4e01-961e-2d52a6f4f945 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:18.190932 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517cd24-ce67-4e01-961e-2d52a6f4f945 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:18.191441 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517cd24-ce67-4e01-961e-2d52a6f4f945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:18.210705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517cd24-ce67-4e01-961e-2d52a6f4f945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:18.213745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517cd24-ce67-4e01-961e-2d52a6f4f945 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:18.256423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1222/2417] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:24:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:21.818239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e9977-17d0-43ef-aa4a-f839f997d095 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:21.818888 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e9977-17d0-43ef-aa4a-f839f997d095 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:21.819230 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e9977-17d0-43ef-aa4a-f839f997d095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:21.855506 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a82e9977-17d0-43ef-aa4a-f839f997d095 None None] MFA Rules not processed for user `ecf4d21703524c848358fa365987339b`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:21.857876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a82e9977-17d0-43ef-aa4a-f839f997d095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:21.871771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1196/2418] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:24:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:21.880043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64632df-8bda-4ff0-832e-826280686b11 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:21.881072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64632df-8bda-4ff0-832e-826280686b11 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:21.881364 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64632df-8bda-4ff0-832e-826280686b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:21.906743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b64632df-8bda-4ff0-832e-826280686b11 None None] MFA Rules not processed for user `e9fe8b6818fa44d6a459589de462c8da`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:21.909410 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b64632df-8bda-4ff0-832e-826280686b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:21.961236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:22.028729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1223/2419] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:24:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:23.472032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e9977-17d0-43ef-aa4a-f839f997d095 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:23.474884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a82e9977-17d0-43ef-aa4a-f839f997d095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:23.554131 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e9977-17d0-43ef-aa4a-f839f997d095 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:23.558386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3916a-afbc-4000-8b50-000bc2a9aa0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:23.559038 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3916a-afbc-4000-8b50-000bc2a9aa0f service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:23.559512 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3916a-afbc-4000-8b50-000bc2a9aa0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:23.559845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3916a-afbc-4000-8b50-000bc2a9aa0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:23.562686 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b3c3916a-afbc-4000-8b50-000bc2a9aa0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:23.652510 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3916a-afbc-4000-8b50-000bc2a9aa0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:23.654193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3916a-afbc-4000-8b50-000bc2a9aa0f service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:23.666315 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1197/2420] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:24:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:28.870515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bc222-f185-4742-8009-59cbac04630e None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:28.870515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bc222-f185-4742-8009-59cbac04630e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:28.870515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bc222-f185-4742-8009-59cbac04630e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:28.923118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-498bc222-f185-4742-8009-59cbac04630e None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:28.927935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-498bc222-f185-4742-8009-59cbac04630e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:29.091608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1224/2421] 10.222.0.98 () {58 vars in 1009 bytes} [Tue Jul 26 15:24:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:24:29.108582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3916a-afbc-4000-8b50-000bc2a9aa0f service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:29.111303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b3c3916a-afbc-4000-8b50-000bc2a9aa0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:29.118696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:29.208907 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3916a-afbc-4000-8b50-000bc2a9aa0f service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:29.224499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537c035-a628-4b8e-a9c5-0b74b43af0c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:29.224938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537c035-a628-4b8e-a9c5-0b74b43af0c2 service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:29.225300 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537c035-a628-4b8e-a9c5-0b74b43af0c2 service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:29.225803 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537c035-a628-4b8e-a9c5-0b74b43af0c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:29.240863 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537c035-a628-4b8e-a9c5-0b74b43af0c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:29.242817 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537c035-a628-4b8e-a9c5-0b74b43af0c2 service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:29.254866 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1198/2422] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:24:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 15:24:39.081513 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=37 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:39.499922 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=30 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:03.394596 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f02483-3d59-469c-b2d9-d9a097bf6d74 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:03.395503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f02483-3d59-469c-b2d9-d9a097bf6d74 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:03.395503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f02483-3d59-469c-b2d9-d9a097bf6d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:03.441349 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-10f02483-3d59-469c-b2d9-d9a097bf6d74 None None] MFA Rules not processed for user `5182476e94ea4f0c8049001bebd351bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:03.441349 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-10f02483-3d59-469c-b2d9-d9a097bf6d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:03.547439 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1225/2423] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:25:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:25:04.728625 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537c035-a628-4b8e-a9c5-0b74b43af0c2 service swift] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:04.745854 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537c035-a628-4b8e-a9c5-0b74b43af0c2 service swift] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:04.752944 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ac861-1cc4-4da0-b8c3-b6f740e1c1d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:04.753963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ac861-1cc4-4da0-b8c3-b6f740e1c1d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:04.754505 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ac861-1cc4-4da0-b8c3-b6f740e1c1d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:04.755002 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ac861-1cc4-4da0-b8c3-b6f740e1c1d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:04.759055 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bc1ac861-1cc4-4da0-b8c3-b6f740e1c1d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:04.846489 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ac861-1cc4-4da0-b8c3-b6f740e1c1d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:04.848313 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ac861-1cc4-4da0-b8c3-b6f740e1c1d9 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:04.862496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1199/2424] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:25:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:25:05.399246 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cc985-1a8b-4255-b005-836d834fdc3b None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:05.399993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cc985-1a8b-4255-b005-836d834fdc3b None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:05.399993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cc985-1a8b-4255-b005-836d834fdc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:05.428771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-716cc985-1a8b-4255-b005-836d834fdc3b None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:05.433566 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-716cc985-1a8b-4255-b005-836d834fdc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:05.459566 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1226/2425] 10.222.0.98 () {58 vars in 1009 bytes} [Tue Jul 26 15:25:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:25:05.497845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ac861-1cc4-4da0-b8c3-b6f740e1c1d9 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:05.515128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ac861-1cc4-4da0-b8c3-b6f740e1c1d9 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:05.526020 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917b13-4075-476b-bbf0-ef8673e45c7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:05.527615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917b13-4075-476b-bbf0-ef8673e45c7e service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:05.528352 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917b13-4075-476b-bbf0-ef8673e45c7e service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:05.529139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917b13-4075-476b-bbf0-ef8673e45c7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:05.545279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5917b13-4075-476b-bbf0-ef8673e45c7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:05.547284 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5917b13-4075-476b-bbf0-ef8673e45c7e service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:05.559990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1200/2426] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:25:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:25:06.587703 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82141232-0fca-4919-83b1-762d67404649 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:06.588260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82141232-0fca-4919-83b1-762d67404649 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:06.588361 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82141232-0fca-4919-83b1-762d67404649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:06.611048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-82141232-0fca-4919-83b1-762d67404649 None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:06.612282 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-82141232-0fca-4919-83b1-762d67404649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:06.619816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1227/2427] 10.222.0.98 () {58 vars in 967 bytes} [Tue Jul 26 15:25:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:06.633802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917b13-4075-476b-bbf0-ef8673e45c7e service swift] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:06.648658 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917b13-4075-476b-bbf0-ef8673e45c7e service swift] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:06.656677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76657d-7116-42f7-aa40-59a9180bcc3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:06.657774 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76657d-7116-42f7-aa40-59a9180bcc3b service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:06.658189 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76657d-7116-42f7-aa40-59a9180bcc3b service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:06.659139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76657d-7116-42f7-aa40-59a9180bcc3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:06.671043 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76657d-7116-42f7-aa40-59a9180bcc3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:06.672880 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76657d-7116-42f7-aa40-59a9180bcc3b service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:06.694025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1201/2428] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:25:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:25:07.556587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccd27e-3405-4142-9fa9-8266a06ebca7 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:07.557047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccd27e-3405-4142-9fa9-8266a06ebca7 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:07.557520 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccd27e-3405-4142-9fa9-8266a06ebca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:07.591622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-bcccd27e-3405-4142-9fa9-8266a06ebca7 None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:07.593268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-bcccd27e-3405-4142-9fa9-8266a06ebca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:07.604392 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1228/2429] 10.222.0.98 () {58 vars in 1009 bytes} [Tue Jul 26 15:25:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:07.618346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76657d-7116-42f7-aa40-59a9180bcc3b service swift] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:07.631469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76657d-7116-42f7-aa40-59a9180bcc3b service swift] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:07.638769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102863d2-21d1-485b-ac1e-ce06b2814c31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:07.640143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102863d2-21d1-485b-ac1e-ce06b2814c31 service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:07.640529 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102863d2-21d1-485b-ac1e-ce06b2814c31 service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:07.640966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102863d2-21d1-485b-ac1e-ce06b2814c31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:07.652461 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102863d2-21d1-485b-ac1e-ce06b2814c31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:07.655142 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102863d2-21d1-485b-ac1e-ce06b2814c31 service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:07.674732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1202/2430] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:25:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:25:08.530548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9f8e6-7fee-49ae-88a7-45ff6b5eec4c None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:08.530858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9f8e6-7fee-49ae-88a7-45ff6b5eec4c None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:08.531099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9f8e6-7fee-49ae-88a7-45ff6b5eec4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:08.562776 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-74b9f8e6-7fee-49ae-88a7-45ff6b5eec4c None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:08.570913 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-74b9f8e6-7fee-49ae-88a7-45ff6b5eec4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:08.574993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1229/2431] 10.222.0.98 () {58 vars in 967 bytes} [Tue Jul 26 15:25:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:08.594984 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102863d2-21d1-485b-ac1e-ce06b2814c31 service swift] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:08.614527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102863d2-21d1-485b-ac1e-ce06b2814c31 service swift] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:08.620438 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeebdde-1b05-4fce-b963-900522792383 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:08.621083 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeebdde-1b05-4fce-b963-900522792383 service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:08.621367 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeebdde-1b05-4fce-b963-900522792383 service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:08.621646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeebdde-1b05-4fce-b963-900522792383 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:08.633803 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeebdde-1b05-4fce-b963-900522792383 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:08.636454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeebdde-1b05-4fce-b963-900522792383 service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:08.648227 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1203/2432] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:25:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:25:12.986560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9f8e6-7fee-49ae-88a7-45ff6b5eec4c None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:13.140670 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9f8e6-7fee-49ae-88a7-45ff6b5eec4c None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:13.148012 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48d082-c966-47b7-9e6e-c93dca32c958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:13.149033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48d082-c966-47b7-9e6e-c93dca32c958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:13.149365 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48d082-c966-47b7-9e6e-c93dca32c958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:13.149726 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48d082-c966-47b7-9e6e-c93dca32c958 admin admin] PATH_INFO: `/v3/users/ecf4d21703524c848358fa365987339b` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:13.151702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48d082-c966-47b7-9e6e-c93dca32c958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf4d21703524c848358fa365987339b)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:13.153855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48d082-c966-47b7-9e6e-c93dca32c958 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:13.421282 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-be48d082-c966-47b7-9e6e-c93dca32c958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf4d21703524c848358fa365987339b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:25:13.422449 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-be48d082-c966-47b7-9e6e-c93dca32c958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf4d21703524c848358fa365987339b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:25:13.448452 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-be48d082-c966-47b7-9e6e-c93dca32c958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf4d21703524c848358fa365987339b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:25:13.552437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-be48d082-c966-47b7-9e6e-c93dca32c958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf4d21703524c848358fa365987339b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:25:13.553566 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-be48d082-c966-47b7-9e6e-c93dca32c958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf4d21703524c848358fa365987339b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:25:13.584430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:13.600145 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1230/2433] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:25:12 2022] DELETE /identity/v3/users/ecf4d21703524c848358fa365987339b => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:25:13.607016 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56511259-fee0-4fb5-bb90-aa90e182c64a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:13.607907 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56511259-fee0-4fb5-bb90-aa90e182c64a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:13.608240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56511259-fee0-4fb5-bb90-aa90e182c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:13.649689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-56511259-fee0-4fb5-bb90-aa90e182c64a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:13.651636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-56511259-fee0-4fb5-bb90-aa90e182c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:13.809149 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1204/2434] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:13.884939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48d082-c966-47b7-9e6e-c93dca32c958 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:13.887977 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-be48d082-c966-47b7-9e6e-c93dca32c958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:13.975803 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48d082-c966-47b7-9e6e-c93dca32c958 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:13.981866 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f93e8e-feca-44ee-98f2-005836406948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:13.982974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f93e8e-feca-44ee-98f2-005836406948 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:13.984207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f93e8e-feca-44ee-98f2-005836406948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:13.984207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f93e8e-feca-44ee-98f2-005836406948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:13.998500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f93e8e-feca-44ee-98f2-005836406948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:14.000185 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f93e8e-feca-44ee-98f2-005836406948 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:14.014726 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1231/2435] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:25:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:25:14.031581 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509a442-e332-4d79-8bce-2e489cf244bf None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:14.031967 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509a442-e332-4d79-8bce-2e489cf244bf None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:14.032253 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509a442-e332-4d79-8bce-2e489cf244bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:14.055890 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7509a442-e332-4d79-8bce-2e489cf244bf None None] MFA Rules not processed for user `1a89102e82bf400880ffb0b28b7e9aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:14.057162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7509a442-e332-4d79-8bce-2e489cf244bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:14.170609 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:14.203243 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1205/2436] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:25:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:14.425221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f93e8e-feca-44ee-98f2-005836406948 service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:14.428933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a8f93e8e-feca-44ee-98f2-005836406948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:14.469698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f93e8e-feca-44ee-98f2-005836406948 service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:14.475644 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5030-d6c5-4415-907c-a468d62725fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:14.479980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5030-d6c5-4415-907c-a468d62725fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:14.479980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5030-d6c5-4415-907c-a468d62725fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:14.479980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5030-d6c5-4415-907c-a468d62725fc admin admin] PATH_INFO: `/v3/projects/f0538f0c8a684994b1073fe0799fcc63` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:14.479980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c5030-d6c5-4415-907c-a468d62725fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0538f0c8a684994b1073fe0799fcc63)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:14.480400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c5030-d6c5-4415-907c-a468d62725fc admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:14.633609 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-259c5030-d6c5-4415-907c-a468d62725fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0538f0c8a684994b1073fe0799fcc63', 'request_id': 'req-259c5030-d6c5-4415-907c-a468d62725fc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:25:14.753061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-259c5030-d6c5-4415-907c-a468d62725fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0538f0c8a684994b1073fe0799fcc63', 'request_id': 'req-259c5030-d6c5-4415-907c-a468d62725fc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:25:14.768937 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-259c5030-d6c5-4415-907c-a468d62725fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0538f0c8a684994b1073fe0799fcc63', 'request_id': 'req-259c5030-d6c5-4415-907c-a468d62725fc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:25:14.791363 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-259c5030-d6c5-4415-907c-a468d62725fc admin admin] The token cache is being invalidate because project f0538f0c8a684994b1073fe0799fcc63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:25:14.791884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-259c5030-d6c5-4415-907c-a468d62725fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:25:14.793122 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-259c5030-d6c5-4415-907c-a468d62725fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:25:14.796042 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1232/2437] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:25:14 2022] DELETE /identity/v3/projects/f0538f0c8a684994b1073fe0799fcc63 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:25:24.238089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=6 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:24.784259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:26.537628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509a442-e332-4d79-8bce-2e489cf244bf None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:26.550173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509a442-e332-4d79-8bce-2e489cf244bf None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:26.614073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb98a4-284f-4f98-b53d-9d994198a9c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:26.614857 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb98a4-284f-4f98-b53d-9d994198a9c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:26.615314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb98a4-284f-4f98-b53d-9d994198a9c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:26.615879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb98a4-284f-4f98-b53d-9d994198a9c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:26.618190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-eccb98a4-284f-4f98-b53d-9d994198a9c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:26.771855 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb98a4-284f-4f98-b53d-9d994198a9c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:26.774680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb98a4-284f-4f98-b53d-9d994198a9c3 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:26.793415 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1206/2438] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:25:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:25:29.322861 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5030-d6c5-4415-907c-a468d62725fc admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:29.324464 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-259c5030-d6c5-4415-907c-a468d62725fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:29.339881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5030-d6c5-4415-907c-a468d62725fc admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:29.346174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899281e-a71a-4430-aec5-85da2f299dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:29.347186 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899281e-a71a-4430-aec5-85da2f299dae service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:29.347476 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899281e-a71a-4430-aec5-85da2f299dae service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:29.347757 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899281e-a71a-4430-aec5-85da2f299dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:29.350600 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8899281e-a71a-4430-aec5-85da2f299dae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:29.378617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899281e-a71a-4430-aec5-85da2f299dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:29.381645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899281e-a71a-4430-aec5-85da2f299dae service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:29.403259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1233/2439] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:25:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:25:36.787419 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=54 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:39.394647 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=6 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:52.683293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb98a4-284f-4f98-b53d-9d994198a9c3 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:52.684871 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-eccb98a4-284f-4f98-b53d-9d994198a9c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:52.753431 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb98a4-284f-4f98-b53d-9d994198a9c3 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:52.759688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5057032-78d3-48a2-8f91-1c939e67638d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:52.759688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5057032-78d3-48a2-8f91-1c939e67638d service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:52.759688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5057032-78d3-48a2-8f91-1c939e67638d service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:52.759688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5057032-78d3-48a2-8f91-1c939e67638d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:52.761555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c5057032-78d3-48a2-8f91-1c939e67638d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:52.838087 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5057032-78d3-48a2-8f91-1c939e67638d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:52.839830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5057032-78d3-48a2-8f91-1c939e67638d service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:52.852645 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1207/2440] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:25:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:26:02.847274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=48 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:12.154285 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899281e-a71a-4430-aec5-85da2f299dae service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:12.155983 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8899281e-a71a-4430-aec5-85da2f299dae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:12.246989 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899281e-a71a-4430-aec5-85da2f299dae service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:12.255188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853c687-ac17-400f-8619-4c52a3ef1f41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:12.255891 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853c687-ac17-400f-8619-4c52a3ef1f41 service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:12.256217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853c687-ac17-400f-8619-4c52a3ef1f41 service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:12.256536 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853c687-ac17-400f-8619-4c52a3ef1f41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:12.258628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-1853c687-ac17-400f-8619-4c52a3ef1f41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:12.341635 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853c687-ac17-400f-8619-4c52a3ef1f41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:12.344674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853c687-ac17-400f-8619-4c52a3ef1f41 service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:12.363448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1234/2441] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:26:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:26:13.385224 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5057032-78d3-48a2-8f91-1c939e67638d service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:13.388349 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c5057032-78d3-48a2-8f91-1c939e67638d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:13.484572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5057032-78d3-48a2-8f91-1c939e67638d service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:13.494240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352712c8-8457-43fe-ace9-a0c44a92df61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:13.494240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352712c8-8457-43fe-ace9-a0c44a92df61 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:13.494240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352712c8-8457-43fe-ace9-a0c44a92df61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:13.494240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352712c8-8457-43fe-ace9-a0c44a92df61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:13.498980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-352712c8-8457-43fe-ace9-a0c44a92df61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:13.515925 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352712c8-8457-43fe-ace9-a0c44a92df61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:13.525947 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352712c8-8457-43fe-ace9-a0c44a92df61 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:13.537012 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1208/2442] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:26:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:26:14.733112 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853c687-ac17-400f-8619-4c52a3ef1f41 service nova] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:14.736565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-1853c687-ac17-400f-8619-4c52a3ef1f41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:14.792684 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853c687-ac17-400f-8619-4c52a3ef1f41 service nova] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:14.802187 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98deb7-d04f-4e58-9f70-7366f5fe8612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:14.802779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98deb7-d04f-4e58-9f70-7366f5fe8612 service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:14.803292 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98deb7-d04f-4e58-9f70-7366f5fe8612 service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:14.803813 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98deb7-d04f-4e58-9f70-7366f5fe8612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:14.806806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-dc98deb7-d04f-4e58-9f70-7366f5fe8612 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:14.833077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98deb7-d04f-4e58-9f70-7366f5fe8612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:14.835272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98deb7-d04f-4e58-9f70-7366f5fe8612 service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:14.856193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1235/2443] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:26:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:26:23.545778 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=24 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:23.880575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e25e4-15c6-401d-8e45-2254f6bd1f0a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:23.881381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e25e4-15c6-401d-8e45-2254f6bd1f0a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:23.881928 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e25e4-15c6-401d-8e45-2254f6bd1f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:23.927653 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-977e25e4-15c6-401d-8e45-2254f6bd1f0a None None] MFA Rules not processed for user `090eeca8e41c4f24b6337c773e87e00e`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:23.930006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-977e25e4-15c6-401d-8e45-2254f6bd1f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:24.044095 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1209/2444] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:26:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:26:24.510216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98deb7-d04f-4e58-9f70-7366f5fe8612 service nova] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:24.526765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98deb7-d04f-4e58-9f70-7366f5fe8612 service nova] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:24.531293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5f766-2c51-4c7b-ba5e-9ca5733a6d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:24.532254 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5f766-2c51-4c7b-ba5e-9ca5733a6d7d service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:24.533187 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5f766-2c51-4c7b-ba5e-9ca5733a6d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:24.533604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5f766-2c51-4c7b-ba5e-9ca5733a6d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:24.536000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f2a5f766-2c51-4c7b-ba5e-9ca5733a6d7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:24.551225 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5f766-2c51-4c7b-ba5e-9ca5733a6d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:24.552822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5f766-2c51-4c7b-ba5e-9ca5733a6d7d service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:24.563036 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1236/2445] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:26:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:26:25.190239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e25e4-15c6-401d-8e45-2254f6bd1f0a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:25.192204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-977e25e4-15c6-401d-8e45-2254f6bd1f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:25.317542 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e25e4-15c6-401d-8e45-2254f6bd1f0a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:25.323991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ea39e-4790-4eb8-aef9-1442932f95a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:25.324642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ea39e-4790-4eb8-aef9-1442932f95a2 service placement] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:25.324932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ea39e-4790-4eb8-aef9-1442932f95a2 service placement] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:25.325210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ea39e-4790-4eb8-aef9-1442932f95a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:25.327184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ec8ea39e-4790-4eb8-aef9-1442932f95a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:25.340921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ea39e-4790-4eb8-aef9-1442932f95a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:25.342897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ea39e-4790-4eb8-aef9-1442932f95a2 service placement] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:25.358232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1210/2446] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:26:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:26:26.088812 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5f766-2c51-4c7b-ba5e-9ca5733a6d7d service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:26.101184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5f766-2c51-4c7b-ba5e-9ca5733a6d7d service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:26.106088 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28036cf8-5dd8-4190-8c52-7a3d4327f7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:26.107279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28036cf8-5dd8-4190-8c52-7a3d4327f7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:26.108118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28036cf8-5dd8-4190-8c52-7a3d4327f7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:26.108910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28036cf8-5dd8-4190-8c52-7a3d4327f7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:26.113550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-28036cf8-5dd8-4190-8c52-7a3d4327f7c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:26.250852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28036cf8-5dd8-4190-8c52-7a3d4327f7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:26.253708 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28036cf8-5dd8-4190-8c52-7a3d4327f7c2 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:26.268921 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:26.296568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1237/2447] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:26:32.624042 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ea39e-4790-4eb8-aef9-1442932f95a2 service placement] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:32.645809 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ea39e-4790-4eb8-aef9-1442932f95a2 service placement] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:32.656273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06a4df-f5e4-4fd4-a04d-37cb954af8c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:32.658229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06a4df-f5e4-4fd4-a04d-37cb954af8c0 service placement] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:32.658912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06a4df-f5e4-4fd4-a04d-37cb954af8c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:32.659476 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06a4df-f5e4-4fd4-a04d-37cb954af8c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:32.662899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3d06a4df-f5e4-4fd4-a04d-37cb954af8c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:32.685539 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06a4df-f5e4-4fd4-a04d-37cb954af8c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:32.689314 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06a4df-f5e4-4fd4-a04d-37cb954af8c0 service placement] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:32.708319 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1211/2448] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:26:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:26:32.834014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28036cf8-5dd8-4190-8c52-7a3d4327f7c2 service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:32.836106 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-28036cf8-5dd8-4190-8c52-7a3d4327f7c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:32.863860 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28036cf8-5dd8-4190-8c52-7a3d4327f7c2 service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:32.869067 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df88654-b2bd-4753-b62b-14a6ba979739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:32.869750 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df88654-b2bd-4753-b62b-14a6ba979739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:32.870030 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df88654-b2bd-4753-b62b-14a6ba979739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:32.870309 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df88654-b2bd-4753-b62b-14a6ba979739 admin admin] PATH_INFO: `/v3/users/5182476e94ea4f0c8049001bebd351bc` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:32.871953 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df88654-b2bd-4753-b62b-14a6ba979739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5182476e94ea4f0c8049001bebd351bc)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:32.874687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df88654-b2bd-4753-b62b-14a6ba979739 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:33.249940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3df88654-b2bd-4753-b62b-14a6ba979739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5182476e94ea4f0c8049001bebd351bc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:26:33.251945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3df88654-b2bd-4753-b62b-14a6ba979739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5182476e94ea4f0c8049001bebd351bc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:26:33.279118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3df88654-b2bd-4753-b62b-14a6ba979739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5182476e94ea4f0c8049001bebd351bc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:26:33.398352 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3df88654-b2bd-4753-b62b-14a6ba979739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5182476e94ea4f0c8049001bebd351bc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:26:33.399318 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3df88654-b2bd-4753-b62b-14a6ba979739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5182476e94ea4f0c8049001bebd351bc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:26:33.416819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1238/2449] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:26:32 2022] DELETE /identity/v3/users/5182476e94ea4f0c8049001bebd351bc => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:26:33.904117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06a4df-f5e4-4fd4-a04d-37cb954af8c0 service placement] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:33.943145 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06a4df-f5e4-4fd4-a04d-37cb954af8c0 service placement] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:34.096448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b130e-4bb0-4482-a721-280aa99c5011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:34.097549 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b130e-4bb0-4482-a721-280aa99c5011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:34.097957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b130e-4bb0-4482-a721-280aa99c5011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:34.098383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b130e-4bb0-4482-a721-280aa99c5011 admin admin] PATH_INFO: `/v3/projects/bba684def2874171a706fa80ad3b52f8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:34.100091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b130e-4bb0-4482-a721-280aa99c5011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba684def2874171a706fa80ad3b52f8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:34.102662 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b130e-4bb0-4482-a721-280aa99c5011 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:34.140518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:34.259491 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ed5b130e-4bb0-4482-a721-280aa99c5011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba684def2874171a706fa80ad3b52f8', 'request_id': 'req-ed5b130e-4bb0-4482-a721-280aa99c5011'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:26:34.268213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ed5b130e-4bb0-4482-a721-280aa99c5011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba684def2874171a706fa80ad3b52f8', 'request_id': 'req-ed5b130e-4bb0-4482-a721-280aa99c5011'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:26:34.280909 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ed5b130e-4bb0-4482-a721-280aa99c5011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba684def2874171a706fa80ad3b52f8', 'request_id': 'req-ed5b130e-4bb0-4482-a721-280aa99c5011'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:26:34.464823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ed5b130e-4bb0-4482-a721-280aa99c5011 admin admin] The token cache is being invalidate because project bba684def2874171a706fa80ad3b52f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:26:34.465117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ed5b130e-4bb0-4482-a721-280aa99c5011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:26:34.466281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ed5b130e-4bb0-4482-a721-280aa99c5011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:26:34.467713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1212/2450] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:26:33 2022] DELETE /identity/v3/projects/bba684def2874171a706fa80ad3b52f8 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:26:34.472981 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a43ef-8ce5-446e-94b8-841bd94c8b99 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:34.473702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a43ef-8ce5-446e-94b8-841bd94c8b99 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:34.473702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a43ef-8ce5-446e-94b8-841bd94c8b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:34.572123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-9c0a43ef-8ce5-446e-94b8-841bd94c8b99 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:34.574076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-9c0a43ef-8ce5-446e-94b8-841bd94c8b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:34.664485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1239/2451] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:26:34.673016 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e6aa1-3f5d-457e-8e23-20a1c67fa943 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:34.675130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e6aa1-3f5d-457e-8e23-20a1c67fa943 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:34.675637 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e6aa1-3f5d-457e-8e23-20a1c67fa943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:34.703929 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c53e6aa1-3f5d-457e-8e23-20a1c67fa943 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:34.707011 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c53e6aa1-3f5d-457e-8e23-20a1c67fa943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:34.717926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1213/2452] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:26:34.723383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a43ef-8ce5-446e-94b8-841bd94c8b99 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:34.737147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a43ef-8ce5-446e-94b8-841bd94c8b99 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:34.743855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d03b56-a030-4b68-a280-7941558a851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:34.744933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d03b56-a030-4b68-a280-7941558a851c admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:34.745371 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d03b56-a030-4b68-a280-7941558a851c admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:34.745693 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d03b56-a030-4b68-a280-7941558a851c admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:34.746591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d03b56-a030-4b68-a280-7941558a851c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:34.747093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d03b56-a030-4b68-a280-7941558a851c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:34.749242 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d03b56-a030-4b68-a280-7941558a851c admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:34.764094 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1240/2453] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:34.771526 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e6aa1-3f5d-457e-8e23-20a1c67fa943 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:34.790278 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e6aa1-3f5d-457e-8e23-20a1c67fa943 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:34.800037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fab40-af87-4608-98ce-7d110ac23baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:34.801129 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fab40-af87-4608-98ce-7d110ac23baa admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:34.801683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fab40-af87-4608-98ce-7d110ac23baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:34.802191 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fab40-af87-4608-98ce-7d110ac23baa admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:34.803594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fab40-af87-4608-98ce-7d110ac23baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:34.807358 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fab40-af87-4608-98ce-7d110ac23baa admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:34.962030 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1214/2454] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:26:34 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:26:34.966749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d03b56-a030-4b68-a280-7941558a851c admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:34.978502 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d03b56-a030-4b68-a280-7941558a851c admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:35.000620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:35.064906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda17e37-0fcd-4845-8f1d-6cf8f8ee5228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:35.065719 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda17e37-0fcd-4845-8f1d-6cf8f8ee5228 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:35.066117 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda17e37-0fcd-4845-8f1d-6cf8f8ee5228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:35.066556 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda17e37-0fcd-4845-8f1d-6cf8f8ee5228 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:35.067360 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda17e37-0fcd-4845-8f1d-6cf8f8ee5228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:35.070083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda17e37-0fcd-4845-8f1d-6cf8f8ee5228 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:35.186040 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1241/2455] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:26:34 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:26:35.187665 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fab40-af87-4608-98ce-7d110ac23baa admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:35.201392 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fab40-af87-4608-98ce-7d110ac23baa admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:35.207614 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eadbe7-a6e8-4a41-9300-731defa55cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:35.208501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eadbe7-a6e8-4a41-9300-731defa55cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:35.208857 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eadbe7-a6e8-4a41-9300-731defa55cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:35.209198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eadbe7-a6e8-4a41-9300-731defa55cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:35.209978 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eadbe7-a6e8-4a41-9300-731defa55cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:35.211716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eadbe7-a6e8-4a41-9300-731defa55cf2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:35.223249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1215/2456] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:26:35.229101 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda17e37-0fcd-4845-8f1d-6cf8f8ee5228 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:35.243566 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda17e37-0fcd-4845-8f1d-6cf8f8ee5228 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:35.250199 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dda0a-f935-434e-8325-077c433800a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:35.250776 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dda0a-f935-434e-8325-077c433800a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:35.252493 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dda0a-f935-434e-8325-077c433800a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:35.252493 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dda0a-f935-434e-8325-077c433800a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:35.252829 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dda0a-f935-434e-8325-077c433800a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:35.254989 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dda0a-f935-434e-8325-077c433800a6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:35.268234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1242/2457] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:26:35.275462 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eadbe7-a6e8-4a41-9300-731defa55cf2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:35.290173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eadbe7-a6e8-4a41-9300-731defa55cf2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:35.295762 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f08300-31a4-4f79-ac82-fb74fc02a99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:35.296801 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f08300-31a4-4f79-ac82-fb74fc02a99c admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:35.297089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f08300-31a4-4f79-ac82-fb74fc02a99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:35.297366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f08300-31a4-4f79-ac82-fb74fc02a99c admin admin] PATH_INFO: `/v3/projects/ce6794e25ead4ab395563c91f9b2a7e1/users/66a1a31e3bfb4b929965a6e52bd6ec72/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:35.316750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f08300-31a4-4f79-ac82-fb74fc02a99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6794e25ead4ab395563c91f9b2a7e1, user_id=66a1a31e3bfb4b929965a6e52bd6ec72, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:35.320052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f08300-31a4-4f79-ac82-fb74fc02a99c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:35.420558 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1216/2458] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:26:35 2022] PUT /identity/v3/projects/ce6794e25ead4ab395563c91f9b2a7e1/users/66a1a31e3bfb4b929965a6e52bd6ec72/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:26:35.428133 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e836a-691b-4be1-96cf-404d52fac270 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:35.431847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e836a-691b-4be1-96cf-404d52fac270 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:35.431847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e836a-691b-4be1-96cf-404d52fac270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:35.451330 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-013e836a-691b-4be1-96cf-404d52fac270 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:35.452718 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-013e836a-691b-4be1-96cf-404d52fac270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:35.537843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1243/2459] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:26:35.547021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f08300-31a4-4f79-ac82-fb74fc02a99c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:35.550823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-62f08300-31a4-4f79-ac82-fb74fc02a99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:35.628583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f08300-31a4-4f79-ac82-fb74fc02a99c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:35.633556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84b973-9b5a-436e-8649-37d2bce6b63f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:35.636686 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84b973-9b5a-436e-8649-37d2bce6b63f service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:35.636686 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84b973-9b5a-436e-8649-37d2bce6b63f service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:35.636686 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84b973-9b5a-436e-8649-37d2bce6b63f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:35.646765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84b973-9b5a-436e-8649-37d2bce6b63f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:35.648298 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84b973-9b5a-436e-8649-37d2bce6b63f service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:35.664541 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1217/2460] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:26:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:26:41.262149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac846b-04ee-4b40-99c9-2c37100e5d0f None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:41.262767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac846b-04ee-4b40-99c9-2c37100e5d0f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:41.263279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac846b-04ee-4b40-99c9-2c37100e5d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:41.339229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-58ac846b-04ee-4b40-99c9-2c37100e5d0f None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:41.340673 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-58ac846b-04ee-4b40-99c9-2c37100e5d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:41.481742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1244/2461] 10.222.0.98 () {58 vars in 1009 bytes} [Tue Jul 26 15:26:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:26:41.825119 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84b973-9b5a-436e-8649-37d2bce6b63f service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:41.826851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6f84b973-9b5a-436e-8649-37d2bce6b63f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:41.935985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:41.982937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84b973-9b5a-436e-8649-37d2bce6b63f service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:41.997472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df777d-c944-4d1a-a124-18dacd94b2f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:41.998238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df777d-c944-4d1a-a124-18dacd94b2f5 service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:41.998632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df777d-c944-4d1a-a124-18dacd94b2f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:41.998974 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df777d-c944-4d1a-a124-18dacd94b2f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:42.021052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df777d-c944-4d1a-a124-18dacd94b2f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:42.023216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df777d-c944-4d1a-a124-18dacd94b2f5 service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:42.044194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1218/2462] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:26:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 15:26:42.474874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac846b-04ee-4b40-99c9-2c37100e5d0f None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:42.540536 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-58ac846b-04ee-4b40-99c9-2c37100e5d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:42.576853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:42.675781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac846b-04ee-4b40-99c9-2c37100e5d0f None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:42.706205 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19361b8-2cb1-4c5b-a69c-7c32b21e0f32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:42.707334 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19361b8-2cb1-4c5b-a69c-7c32b21e0f32 service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:42.707846 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19361b8-2cb1-4c5b-a69c-7c32b21e0f32 service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:42.708345 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19361b8-2cb1-4c5b-a69c-7c32b21e0f32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:42.711741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e19361b8-2cb1-4c5b-a69c-7c32b21e0f32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:42.771264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19361b8-2cb1-4c5b-a69c-7c32b21e0f32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:42.774029 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19361b8-2cb1-4c5b-a69c-7c32b21e0f32 service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:42.795021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1245/2463] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:26:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:26:51.137269 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed31aa-66ec-4db9-94e3-0df43b66f16d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:51.138168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed31aa-66ec-4db9-94e3-0df43b66f16d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:51.138706 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed31aa-66ec-4db9-94e3-0df43b66f16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:51.394344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e0ed31aa-66ec-4db9-94e3-0df43b66f16d None None] MFA Rules not processed for user `66a1a31e3bfb4b929965a6e52bd6ec72`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:51.420881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e0ed31aa-66ec-4db9-94e3-0df43b66f16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:51.648118 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1219/2464] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:26:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:26:51.681566 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19361b8-2cb1-4c5b-a69c-7c32b21e0f32 service nova] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:51.711045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19361b8-2cb1-4c5b-a69c-7c32b21e0f32 service nova] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:51.733242 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde61e2f-634b-4746-bbab-0cc79ab154fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:51.734761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde61e2f-634b-4746-bbab-0cc79ab154fb service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:51.736407 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde61e2f-634b-4746-bbab-0cc79ab154fb service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:51.737184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde61e2f-634b-4746-bbab-0cc79ab154fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:51.795135 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde61e2f-634b-4746-bbab-0cc79ab154fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:51.801039 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde61e2f-634b-4746-bbab-0cc79ab154fb service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:51.864140 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1246/2465] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:26:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:26:54.249458 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dc20e-55ee-4953-86b5-96315a40ea84 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:54.249458 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dc20e-55ee-4953-86b5-96315a40ea84 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:54.257451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dc20e-55ee-4953-86b5-96315a40ea84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:54.346163 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-501dc20e-55ee-4953-86b5-96315a40ea84 None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:54.349746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-501dc20e-55ee-4953-86b5-96315a40ea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:54.371960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1220/2466] 10.222.0.98 () {58 vars in 967 bytes} [Tue Jul 26 15:26:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:26:54.389097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde61e2f-634b-4746-bbab-0cc79ab154fb service nova] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:54.425795 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde61e2f-634b-4746-bbab-0cc79ab154fb service nova] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:54.452061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6fdbc-a686-4df6-89b4-2e03ca8174f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:54.456335 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6fdbc-a686-4df6-89b4-2e03ca8174f1 service swift] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:54.457358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6fdbc-a686-4df6-89b4-2e03ca8174f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:54.461419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6fdbc-a686-4df6-89b4-2e03ca8174f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:54.508446 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6fdbc-a686-4df6-89b4-2e03ca8174f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:54.511889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6fdbc-a686-4df6-89b4-2e03ca8174f1 service swift] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:54.536102 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1247/2467] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:26:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:26:54.770802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dc20e-55ee-4953-86b5-96315a40ea84 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:54.775580 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-501dc20e-55ee-4953-86b5-96315a40ea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:54.822013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dc20e-55ee-4953-86b5-96315a40ea84 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:54.833019 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea3b74-3819-447b-8aad-21a1a3d8d929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:54.834862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea3b74-3819-447b-8aad-21a1a3d8d929 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:54.835514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea3b74-3819-447b-8aad-21a1a3d8d929 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:54.836097 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea3b74-3819-447b-8aad-21a1a3d8d929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:54.839860 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0cea3b74-3819-447b-8aad-21a1a3d8d929 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:54.875727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea3b74-3819-447b-8aad-21a1a3d8d929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:54.877515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea3b74-3819-447b-8aad-21a1a3d8d929 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:54.908831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1221/2468] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:26:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:26:58.787444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8007bbe-132c-4973-999e-59bcf2aa6997 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:58.788006 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8007bbe-132c-4973-999e-59bcf2aa6997 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:58.788771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8007bbe-132c-4973-999e-59bcf2aa6997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:58.833770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d8007bbe-132c-4973-999e-59bcf2aa6997 None None] MFA Rules not processed for user `66a1a31e3bfb4b929965a6e52bd6ec72`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:58.839217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d8007bbe-132c-4973-999e-59bcf2aa6997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:58.877226 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1248/2469] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:26:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:27:00.665726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea3b74-3819-447b-8aad-21a1a3d8d929 service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:00.665726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0cea3b74-3819-447b-8aad-21a1a3d8d929 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:00.680287 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea3b74-3819-447b-8aad-21a1a3d8d929 service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:00.684776 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac84a3a-e9e4-422c-a56d-9a245ac5e08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:00.686029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac84a3a-e9e4-422c-a56d-9a245ac5e08b service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:00.687715 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac84a3a-e9e4-422c-a56d-9a245ac5e08b service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:00.688309 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac84a3a-e9e4-422c-a56d-9a245ac5e08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:00.691467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5ac84a3a-e9e4-422c-a56d-9a245ac5e08b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:00.705712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac84a3a-e9e4-422c-a56d-9a245ac5e08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:00.707296 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac84a3a-e9e4-422c-a56d-9a245ac5e08b service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:00.718982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1222/2470] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:27:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:27:08.821010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=34 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:10.714321 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=60 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:13.661212 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8007bbe-132c-4973-999e-59bcf2aa6997 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:13.665649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d8007bbe-132c-4973-999e-59bcf2aa6997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:13.814937 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8007bbe-132c-4973-999e-59bcf2aa6997 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:13.821965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1532c5a-2876-4c67-b5d7-d749139e42ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:13.822954 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1532c5a-2876-4c67-b5d7-d749139e42ff service placement] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:13.823459 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1532c5a-2876-4c67-b5d7-d749139e42ff service placement] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:13.824598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1532c5a-2876-4c67-b5d7-d749139e42ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:13.827458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f1532c5a-2876-4c67-b5d7-d749139e42ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:13.844232 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1532c5a-2876-4c67-b5d7-d749139e42ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:13.847830 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1532c5a-2876-4c67-b5d7-d749139e42ff service placement] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:13.864094 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1249/2471] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:27:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:27:13.903781 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac84a3a-e9e4-422c-a56d-9a245ac5e08b service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:13.905235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5ac84a3a-e9e4-422c-a56d-9a245ac5e08b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:13.934583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac84a3a-e9e4-422c-a56d-9a245ac5e08b service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:13.949574 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc38e7-a892-4f7c-b7b2-15cd3ed72c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:13.950946 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc38e7-a892-4f7c-b7b2-15cd3ed72c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:13.951436 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc38e7-a892-4f7c-b7b2-15cd3ed72c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:13.951980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc38e7-a892-4f7c-b7b2-15cd3ed72c3f admin admin] PATH_INFO: `/v3/users/e9fe8b6818fa44d6a459589de462c8da` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:13.967465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc38e7-a892-4f7c-b7b2-15cd3ed72c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9fe8b6818fa44d6a459589de462c8da)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:13.967465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc38e7-a892-4f7c-b7b2-15cd3ed72c3f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:14.271382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-09fc38e7-a892-4f7c-b7b2-15cd3ed72c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9fe8b6818fa44d6a459589de462c8da'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:14.272189 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-09fc38e7-a892-4f7c-b7b2-15cd3ed72c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9fe8b6818fa44d6a459589de462c8da'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:14.305480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-09fc38e7-a892-4f7c-b7b2-15cd3ed72c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9fe8b6818fa44d6a459589de462c8da'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:14.306600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-09fc38e7-a892-4f7c-b7b2-15cd3ed72c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9fe8b6818fa44d6a459589de462c8da'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:14.405553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-09fc38e7-a892-4f7c-b7b2-15cd3ed72c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9fe8b6818fa44d6a459589de462c8da'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:14.424629 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1223/2472] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:27:13 2022] DELETE /identity/v3/users/e9fe8b6818fa44d6a459589de462c8da => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:27:14.888479 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1532c5a-2876-4c67-b5d7-d749139e42ff service placement] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:14.910251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1532c5a-2876-4c67-b5d7-d749139e42ff service placement] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:15.039024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea591a8-f89c-4666-842f-c8c84a26fd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:15.040939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea591a8-f89c-4666-842f-c8c84a26fd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:15.041274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea591a8-f89c-4666-842f-c8c84a26fd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:15.041847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea591a8-f89c-4666-842f-c8c84a26fd54 admin admin] PATH_INFO: `/v3/projects/01d4389cc0a1470cb879aaf5c4d55286` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:15.044326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea591a8-f89c-4666-842f-c8c84a26fd54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d4389cc0a1470cb879aaf5c4d55286)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:15.048604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea591a8-f89c-4666-842f-c8c84a26fd54 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:15.290101 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6ea591a8-f89c-4666-842f-c8c84a26fd54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d4389cc0a1470cb879aaf5c4d55286', 'request_id': 'req-6ea591a8-f89c-4666-842f-c8c84a26fd54'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:15.400138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6ea591a8-f89c-4666-842f-c8c84a26fd54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d4389cc0a1470cb879aaf5c4d55286', 'request_id': 'req-6ea591a8-f89c-4666-842f-c8c84a26fd54'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:15.413609 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6ea591a8-f89c-4666-842f-c8c84a26fd54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d4389cc0a1470cb879aaf5c4d55286', 'request_id': 'req-6ea591a8-f89c-4666-842f-c8c84a26fd54'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:15.430875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6ea591a8-f89c-4666-842f-c8c84a26fd54 admin admin] The token cache is being invalidate because project 01d4389cc0a1470cb879aaf5c4d55286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:27:15.431286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6ea591a8-f89c-4666-842f-c8c84a26fd54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:15.431879 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6ea591a8-f89c-4666-842f-c8c84a26fd54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:15.433483 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1250/2473] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:27:14 2022] DELETE /identity/v3/projects/01d4389cc0a1470cb879aaf5c4d55286 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:27:15.437661 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc38e7-a892-4f7c-b7b2-15cd3ed72c3f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:15.440665 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-09fc38e7-a892-4f7c-b7b2-15cd3ed72c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:15.459419 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc38e7-a892-4f7c-b7b2-15cd3ed72c3f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:15.538130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bce82-a939-4b42-b8e7-a572578dcf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:15.539901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bce82-a939-4b42-b8e7-a572578dcf22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:15.539901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bce82-a939-4b42-b8e7-a572578dcf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:15.539901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bce82-a939-4b42-b8e7-a572578dcf22 admin admin] PATH_INFO: `/v3/users/cef21c06a45b4f32b69078ff8e85f293` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:15.541196 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bce82-a939-4b42-b8e7-a572578dcf22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef21c06a45b4f32b69078ff8e85f293)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:15.547558 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bce82-a939-4b42-b8e7-a572578dcf22 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:15.969287 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-572bce82-a939-4b42-b8e7-a572578dcf22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef21c06a45b4f32b69078ff8e85f293'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:15.970675 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-572bce82-a939-4b42-b8e7-a572578dcf22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef21c06a45b4f32b69078ff8e85f293'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:15.988423 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-572bce82-a939-4b42-b8e7-a572578dcf22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef21c06a45b4f32b69078ff8e85f293'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:15.989175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-572bce82-a939-4b42-b8e7-a572578dcf22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef21c06a45b4f32b69078ff8e85f293'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:16.170508 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-572bce82-a939-4b42-b8e7-a572578dcf22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef21c06a45b4f32b69078ff8e85f293'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:16.175433 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:16.202680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1224/2474] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:27:15 2022] DELETE /identity/v3/users/cef21c06a45b4f32b69078ff8e85f293 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:27:16.710247 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea591a8-f89c-4666-842f-c8c84a26fd54 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:16.712256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6ea591a8-f89c-4666-842f-c8c84a26fd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:16.737330 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea591a8-f89c-4666-842f-c8c84a26fd54 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:16.777388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:16.847179 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87626d8-d1d5-41c9-a047-2019b2f16db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:16.848305 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87626d8-d1d5-41c9-a047-2019b2f16db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:16.848822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87626d8-d1d5-41c9-a047-2019b2f16db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:16.849338 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87626d8-d1d5-41c9-a047-2019b2f16db2 admin admin] PATH_INFO: `/v3/projects/c82f8ab2ff8b4a27a984b7d5a5680d0f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:16.851504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87626d8-d1d5-41c9-a047-2019b2f16db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82f8ab2ff8b4a27a984b7d5a5680d0f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:16.855420 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87626d8-d1d5-41c9-a047-2019b2f16db2 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:17.055878 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e87626d8-d1d5-41c9-a047-2019b2f16db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82f8ab2ff8b4a27a984b7d5a5680d0f', 'request_id': 'req-e87626d8-d1d5-41c9-a047-2019b2f16db2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:17.261724 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e87626d8-d1d5-41c9-a047-2019b2f16db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82f8ab2ff8b4a27a984b7d5a5680d0f', 'request_id': 'req-e87626d8-d1d5-41c9-a047-2019b2f16db2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:17.270120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e87626d8-d1d5-41c9-a047-2019b2f16db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82f8ab2ff8b4a27a984b7d5a5680d0f', 'request_id': 'req-e87626d8-d1d5-41c9-a047-2019b2f16db2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:17.283162 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e87626d8-d1d5-41c9-a047-2019b2f16db2 admin admin] The token cache is being invalidate because project c82f8ab2ff8b4a27a984b7d5a5680d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:27:17.283509 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e87626d8-d1d5-41c9-a047-2019b2f16db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:17.284259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-e87626d8-d1d5-41c9-a047-2019b2f16db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:17.285935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1251/2475] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:27:16 2022] DELETE /identity/v3/projects/c82f8ab2ff8b4a27a984b7d5a5680d0f => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:27:20.622109 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e64755-a02b-4822-a7d0-c300a7e5cf17 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:20.622988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e64755-a02b-4822-a7d0-c300a7e5cf17 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:20.623253 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e64755-a02b-4822-a7d0-c300a7e5cf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:20.658003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-25e64755-a02b-4822-a7d0-c300a7e5cf17 None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:27:20.660155 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-25e64755-a02b-4822-a7d0-c300a7e5cf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:20.739865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1225/2476] 10.222.0.98 () {58 vars in 1009 bytes} [Tue Jul 26 15:27:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:27:20.753614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87626d8-d1d5-41c9-a047-2019b2f16db2 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:20.755424 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e87626d8-d1d5-41c9-a047-2019b2f16db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:20.840819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87626d8-d1d5-41c9-a047-2019b2f16db2 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:20.848360 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af462911-bcf0-4ad8-b574-af4aa5e0f74a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:20.849022 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af462911-bcf0-4ad8-b574-af4aa5e0f74a service swift] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:20.849311 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af462911-bcf0-4ad8-b574-af4aa5e0f74a service swift] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:20.849591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af462911-bcf0-4ad8-b574-af4aa5e0f74a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:20.860218 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af462911-bcf0-4ad8-b574-af4aa5e0f74a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:20.862945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af462911-bcf0-4ad8-b574-af4aa5e0f74a service swift] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:20.873121 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1252/2477] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:27:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:27:28.573061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e64755-a02b-4822-a7d0-c300a7e5cf17 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:28.575511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-25e64755-a02b-4822-a7d0-c300a7e5cf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:28.710518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e64755-a02b-4822-a7d0-c300a7e5cf17 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:28.722545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50af14-be72-4e66-aade-a008eb8b7d34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:28.723687 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50af14-be72-4e66-aade-a008eb8b7d34 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:28.724200 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50af14-be72-4e66-aade-a008eb8b7d34 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:28.724685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50af14-be72-4e66-aade-a008eb8b7d34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:28.728240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4f50af14-be72-4e66-aade-a008eb8b7d34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:28.845597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50af14-be72-4e66-aade-a008eb8b7d34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:28.847509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50af14-be72-4e66-aade-a008eb8b7d34 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:28.861132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1226/2478] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:27:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:27:30.868629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:38.853516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=85 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:40.631813 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8837e8d-540b-48a8-88a5-3f774a2b586b None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:40.632809 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8837e8d-540b-48a8-88a5-3f774a2b586b None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:40.633306 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8837e8d-540b-48a8-88a5-3f774a2b586b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:40.657463 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-e8837e8d-540b-48a8-88a5-3f774a2b586b None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:27:40.658791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e8837e8d-540b-48a8-88a5-3f774a2b586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:40.669076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1253/2479] 10.222.0.98 () {58 vars in 967 bytes} [Tue Jul 26 15:27:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:27:40.686241 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50af14-be72-4e66-aade-a008eb8b7d34 service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:40.704600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50af14-be72-4e66-aade-a008eb8b7d34 service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:40.713632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfecde-7cfd-470a-9144-38b4419efd06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:40.714942 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfecde-7cfd-470a-9144-38b4419efd06 service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:40.715538 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfecde-7cfd-470a-9144-38b4419efd06 service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:40.716124 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfecde-7cfd-470a-9144-38b4419efd06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:40.733036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfecde-7cfd-470a-9144-38b4419efd06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:40.738114 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfecde-7cfd-470a-9144-38b4419efd06 service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:40.756270 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1227/2480] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:27:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 15:27:50.654593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:50.747950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=6 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:01.792327 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8837e8d-540b-48a8-88a5-3f774a2b586b None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:01.793972 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e8837e8d-540b-48a8-88a5-3f774a2b586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:01.875889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8837e8d-540b-48a8-88a5-3f774a2b586b None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:01.880149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fff1d9-ddce-4c75-951b-916e91a9d58f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:01.880802 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fff1d9-ddce-4c75-951b-916e91a9d58f service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:01.881086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fff1d9-ddce-4c75-951b-916e91a9d58f service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:01.881362 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fff1d9-ddce-4c75-951b-916e91a9d58f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:01.883282 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e9fff1d9-ddce-4c75-951b-916e91a9d58f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:01.961099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fff1d9-ddce-4c75-951b-916e91a9d58f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:01.962608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fff1d9-ddce-4c75-951b-916e91a9d58f service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:01.975514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1254/2481] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:07.134125 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfecde-7cfd-470a-9144-38b4419efd06 service swift] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:07.135751 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-fdbfecde-7cfd-470a-9144-38b4419efd06 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:07.156668 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfecde-7cfd-470a-9144-38b4419efd06 service swift] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:07.162875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2c387-ea87-4d60-8f61-62473f6bf65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:07.163631 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2c387-ea87-4d60-8f61-62473f6bf65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:07.163958 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2c387-ea87-4d60-8f61-62473f6bf65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:07.164298 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2c387-ea87-4d60-8f61-62473f6bf65c admin admin] PATH_INFO: `/v3/users/090eeca8e41c4f24b6337c773e87e00e` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:07.165807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2c387-ea87-4d60-8f61-62473f6bf65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=090eeca8e41c4f24b6337c773e87e00e)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:07.168184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2c387-ea87-4d60-8f61-62473f6bf65c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:07.404324 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8af2c387-ea87-4d60-8f61-62473f6bf65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090eeca8e41c4f24b6337c773e87e00e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:07.405482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8af2c387-ea87-4d60-8f61-62473f6bf65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090eeca8e41c4f24b6337c773e87e00e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:07.430441 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8af2c387-ea87-4d60-8f61-62473f6bf65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090eeca8e41c4f24b6337c773e87e00e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:07.431340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8af2c387-ea87-4d60-8f61-62473f6bf65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090eeca8e41c4f24b6337c773e87e00e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:07.530209 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8af2c387-ea87-4d60-8f61-62473f6bf65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090eeca8e41c4f24b6337c773e87e00e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:07.555298 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1228/2482] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:28:07 2022] DELETE /identity/v3/users/090eeca8e41c4f24b6337c773e87e00e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:08.016235 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fff1d9-ddce-4c75-951b-916e91a9d58f service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:08.033349 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fff1d9-ddce-4c75-951b-916e91a9d58f service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:08.137825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f105d-6781-47e7-aa2e-444775702421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:08.138619 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f105d-6781-47e7-aa2e-444775702421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:08.138977 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f105d-6781-47e7-aa2e-444775702421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:08.139428 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f105d-6781-47e7-aa2e-444775702421 admin admin] PATH_INFO: `/v3/projects/0affb9ddc4ba46479993542885bfe6e8` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:08.142397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f105d-6781-47e7-aa2e-444775702421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0affb9ddc4ba46479993542885bfe6e8)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:08.146456 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f105d-6781-47e7-aa2e-444775702421 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:08.306695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7d6f105d-6781-47e7-aa2e-444775702421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0affb9ddc4ba46479993542885bfe6e8', 'request_id': 'req-7d6f105d-6781-47e7-aa2e-444775702421'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:08.310000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:08.445426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7d6f105d-6781-47e7-aa2e-444775702421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0affb9ddc4ba46479993542885bfe6e8', 'request_id': 'req-7d6f105d-6781-47e7-aa2e-444775702421'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:08.455101 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7d6f105d-6781-47e7-aa2e-444775702421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0affb9ddc4ba46479993542885bfe6e8', 'request_id': 'req-7d6f105d-6781-47e7-aa2e-444775702421'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:08.467614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7d6f105d-6781-47e7-aa2e-444775702421 admin admin] The token cache is being invalidate because project 0affb9ddc4ba46479993542885bfe6e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:28:08.467890 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7d6f105d-6781-47e7-aa2e-444775702421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:08.469881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7d6f105d-6781-47e7-aa2e-444775702421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:08.471555 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1255/2483] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:28:08 2022] DELETE /identity/v3/projects/0affb9ddc4ba46479993542885bfe6e8 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:08.479816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454c466-82f1-466c-8304-4bdba26fac0f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:08.479816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454c466-82f1-466c-8304-4bdba26fac0f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:08.479816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454c466-82f1-466c-8304-4bdba26fac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:08.508140 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-4454c466-82f1-466c-8304-4bdba26fac0f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:08.509925 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4454c466-82f1-466c-8304-4bdba26fac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:08.614303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1229/2484] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:08.624108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298f8d8-9f4f-4720-b1ef-babe62a21d28 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:08.625100 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298f8d8-9f4f-4720-b1ef-babe62a21d28 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:08.626076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298f8d8-9f4f-4720-b1ef-babe62a21d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:08.651977 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-7298f8d8-9f4f-4720-b1ef-babe62a21d28 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:08.653461 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7298f8d8-9f4f-4720-b1ef-babe62a21d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:08.662734 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1256/2485] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:08.669171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454c466-82f1-466c-8304-4bdba26fac0f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:08.681247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454c466-82f1-466c-8304-4bdba26fac0f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:08.687939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8f823-365e-4caa-8392-7be4c769dd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:08.700368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8f823-365e-4caa-8392-7be4c769dd1b admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:08.700368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8f823-365e-4caa-8392-7be4c769dd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:08.700368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8f823-365e-4caa-8392-7be4c769dd1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:08.700368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8f823-365e-4caa-8392-7be4c769dd1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:08.700368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8f823-365e-4caa-8392-7be4c769dd1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:08.700368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8f823-365e-4caa-8392-7be4c769dd1b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:08.711750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1230/2486] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:08.718645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298f8d8-9f4f-4720-b1ef-babe62a21d28 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:08.731211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298f8d8-9f4f-4720-b1ef-babe62a21d28 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:08.740386 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97321145-8d9e-4558-8853-2352f9cde8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:08.742233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97321145-8d9e-4558-8853-2352f9cde8dd admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:08.742591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97321145-8d9e-4558-8853-2352f9cde8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:08.742863 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97321145-8d9e-4558-8853-2352f9cde8dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:08.743568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97321145-8d9e-4558-8853-2352f9cde8dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:08.746108 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97321145-8d9e-4558-8853-2352f9cde8dd admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:08.922959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1257/2487] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:28:08 2022] POST /identity/v3/projects => generated 367 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:08.928032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8f823-365e-4caa-8392-7be4c769dd1b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:08.948699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8f823-365e-4caa-8392-7be4c769dd1b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:09.031982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb183d11-67a6-4998-9f05-f8b101bbd091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:09.032887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb183d11-67a6-4998-9f05-f8b101bbd091 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:09.033168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb183d11-67a6-4998-9f05-f8b101bbd091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:09.033437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb183d11-67a6-4998-9f05-f8b101bbd091 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:09.034126 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb183d11-67a6-4998-9f05-f8b101bbd091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:09.036153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb183d11-67a6-4998-9f05-f8b101bbd091 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:09.045200 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:09.201137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1231/2488] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:28:08 2022] POST /identity/v3/users => generated 284 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:09.206758 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97321145-8d9e-4558-8853-2352f9cde8dd admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:09.218836 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97321145-8d9e-4558-8853-2352f9cde8dd admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:09.224749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e3a13-075a-4309-a0dd-95f1c573b083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:09.225446 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e3a13-075a-4309-a0dd-95f1c573b083 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:09.225733 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e3a13-075a-4309-a0dd-95f1c573b083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:09.226012 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e3a13-075a-4309-a0dd-95f1c573b083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:09.226782 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e3a13-075a-4309-a0dd-95f1c573b083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:09.228497 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e3a13-075a-4309-a0dd-95f1c573b083 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:09.241268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1258/2489] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:28:09.245601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb183d11-67a6-4998-9f05-f8b101bbd091 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:09.257452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb183d11-67a6-4998-9f05-f8b101bbd091 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:09.262811 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef6c9d-454a-4028-aeac-1009fc744034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:09.263496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef6c9d-454a-4028-aeac-1009fc744034 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:09.263836 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef6c9d-454a-4028-aeac-1009fc744034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:09.264193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef6c9d-454a-4028-aeac-1009fc744034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:09.265337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef6c9d-454a-4028-aeac-1009fc744034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:09.267189 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef6c9d-454a-4028-aeac-1009fc744034 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:09.280372 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1232/2490] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:28:09.285154 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e3a13-075a-4309-a0dd-95f1c573b083 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:09.296732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e3a13-075a-4309-a0dd-95f1c573b083 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:09.301975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112079a-012d-4eb9-bd40-6a3a8ffec818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:09.302756 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112079a-012d-4eb9-bd40-6a3a8ffec818 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:09.303040 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112079a-012d-4eb9-bd40-6a3a8ffec818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:09.303329 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112079a-012d-4eb9-bd40-6a3a8ffec818 admin admin] PATH_INFO: `/v3/projects/524b6ac4d30d4af198930afd481270f9/users/65553eda98bf446e801de022453ae923/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:09.323380 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112079a-012d-4eb9-bd40-6a3a8ffec818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=524b6ac4d30d4af198930afd481270f9, user_id=65553eda98bf446e801de022453ae923, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:09.326098 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112079a-012d-4eb9-bd40-6a3a8ffec818 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:09.411255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1259/2491] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:28:09 2022] PUT /identity/v3/projects/524b6ac4d30d4af198930afd481270f9/users/65553eda98bf446e801de022453ae923/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:09.424868 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c9f7a-d23b-460c-8afc-36436c91f125 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:09.425356 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c9f7a-d23b-460c-8afc-36436c91f125 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:09.425820 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c9f7a-d23b-460c-8afc-36436c91f125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:09.474901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b65c9f7a-d23b-460c-8afc-36436c91f125 None None] MFA Rules not processed for user `65553eda98bf446e801de022453ae923`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:09.476811 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b65c9f7a-d23b-460c-8afc-36436c91f125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:09.583239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1233/2492] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:09.596380 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112079a-012d-4eb9-bd40-6a3a8ffec818 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:09.598265 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7112079a-012d-4eb9-bd40-6a3a8ffec818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:09.727333 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112079a-012d-4eb9-bd40-6a3a8ffec818 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:09.733285 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731a84f-cb5a-4967-953a-30ae9489d473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:09.734924 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731a84f-cb5a-4967-953a-30ae9489d473 service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:09.735213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731a84f-cb5a-4967-953a-30ae9489d473 service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:09.735637 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731a84f-cb5a-4967-953a-30ae9489d473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:09.745512 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731a84f-cb5a-4967-953a-30ae9489d473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:09.747367 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731a84f-cb5a-4967-953a-30ae9489d473 service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:09.759206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1260/2493] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:28:13.314136 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c9f7a-d23b-460c-8afc-36436c91f125 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:13.412930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c9f7a-d23b-460c-8afc-36436c91f125 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:13.420151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12339b40-6f02-4998-a69d-f2e8407fb90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:13.421984 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12339b40-6f02-4998-a69d-f2e8407fb90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:13.422654 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12339b40-6f02-4998-a69d-f2e8407fb90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:13.423247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12339b40-6f02-4998-a69d-f2e8407fb90f admin admin] PATH_INFO: `/v3/users/65553eda98bf446e801de022453ae923` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:13.425888 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12339b40-6f02-4998-a69d-f2e8407fb90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=65553eda98bf446e801de022453ae923)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:13.429845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12339b40-6f02-4998-a69d-f2e8407fb90f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:13.801273 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-12339b40-6f02-4998-a69d-f2e8407fb90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65553eda98bf446e801de022453ae923'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:13.801983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-12339b40-6f02-4998-a69d-f2e8407fb90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65553eda98bf446e801de022453ae923'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:13.817095 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-12339b40-6f02-4998-a69d-f2e8407fb90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65553eda98bf446e801de022453ae923'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:13.817856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-12339b40-6f02-4998-a69d-f2e8407fb90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65553eda98bf446e801de022453ae923'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:13.822294 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:13.936410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-12339b40-6f02-4998-a69d-f2e8407fb90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65553eda98bf446e801de022453ae923'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:13.958398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1234/2494] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:28:13 2022] DELETE /identity/v3/users/65553eda98bf446e801de022453ae923 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:13.963444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abefd5-2e9b-4a69-bde6-aec9a2d2cac9 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:13.964337 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abefd5-2e9b-4a69-bde6-aec9a2d2cac9 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:13.964337 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abefd5-2e9b-4a69-bde6-aec9a2d2cac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:13.985728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-31abefd5-2e9b-4a69-bde6-aec9a2d2cac9 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:13.987029 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-31abefd5-2e9b-4a69-bde6-aec9a2d2cac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:14.027674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:14.074451 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1261/2495] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:14.092688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12339b40-6f02-4998-a69d-f2e8407fb90f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:14.095518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-12339b40-6f02-4998-a69d-f2e8407fb90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:14.190622 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12339b40-6f02-4998-a69d-f2e8407fb90f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:14.197413 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13db5f2-b791-4ba8-a884-df39daa59fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:14.198465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13db5f2-b791-4ba8-a884-df39daa59fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:14.198962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13db5f2-b791-4ba8-a884-df39daa59fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:14.199472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13db5f2-b791-4ba8-a884-df39daa59fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:14.218493 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13db5f2-b791-4ba8-a884-df39daa59fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:14.221150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13db5f2-b791-4ba8-a884-df39daa59fb3 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:14.241371 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1235/2496] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:14.601194 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223d869-d56a-4b2a-9f12-1ae77c710d3f None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:14.601645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223d869-d56a-4b2a-9f12-1ae77c710d3f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:14.602051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223d869-d56a-4b2a-9f12-1ae77c710d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:14.628465 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-3223d869-d56a-4b2a-9f12-1ae77c710d3f None None] MFA Rules not processed for user `66a1a31e3bfb4b929965a6e52bd6ec72`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:14.629915 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3223d869-d56a-4b2a-9f12-1ae77c710d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:14.745450 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1262/2497] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:28:14.984882 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13db5f2-b791-4ba8-a884-df39daa59fb3 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:14.987890 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d13db5f2-b791-4ba8-a884-df39daa59fb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:15.013504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13db5f2-b791-4ba8-a884-df39daa59fb3 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:15.024639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b9100-1d46-457f-bd16-c5dda7694989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:15.026031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b9100-1d46-457f-bd16-c5dda7694989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:15.026559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b9100-1d46-457f-bd16-c5dda7694989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:15.027104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b9100-1d46-457f-bd16-c5dda7694989 admin admin] PATH_INFO: `/v3/projects/524b6ac4d30d4af198930afd481270f9` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:15.029547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b9100-1d46-457f-bd16-c5dda7694989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=524b6ac4d30d4af198930afd481270f9)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:15.034530 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b9100-1d46-457f-bd16-c5dda7694989 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:15.226812 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-065b9100-1d46-457f-bd16-c5dda7694989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524b6ac4d30d4af198930afd481270f9', 'request_id': 'req-065b9100-1d46-457f-bd16-c5dda7694989'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:15.240880 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-065b9100-1d46-457f-bd16-c5dda7694989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524b6ac4d30d4af198930afd481270f9', 'request_id': 'req-065b9100-1d46-457f-bd16-c5dda7694989'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:15.255572 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-065b9100-1d46-457f-bd16-c5dda7694989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524b6ac4d30d4af198930afd481270f9', 'request_id': 'req-065b9100-1d46-457f-bd16-c5dda7694989'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:15.358818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-065b9100-1d46-457f-bd16-c5dda7694989 admin admin] The token cache is being invalidate because project 524b6ac4d30d4af198930afd481270f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:28:15.359357 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-065b9100-1d46-457f-bd16-c5dda7694989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:15.360429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-065b9100-1d46-457f-bd16-c5dda7694989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:15.363051 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1236/2498] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:28:14 2022] DELETE /identity/v3/projects/524b6ac4d30d4af198930afd481270f9 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:15.371780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee865b4-f1b5-4538-b828-e93f37e97bdb None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:15.372408 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee865b4-f1b5-4538-b828-e93f37e97bdb None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:15.372791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee865b4-f1b5-4538-b828-e93f37e97bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:15.412101 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-2ee865b4-f1b5-4538-b828-e93f37e97bdb None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:15.414548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2ee865b4-f1b5-4538-b828-e93f37e97bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:15.524876 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1263/2499] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:15.536009 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca802ee-58e4-430c-95fb-8a349b28e7bb None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:15.536455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca802ee-58e4-430c-95fb-8a349b28e7bb None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:15.536594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca802ee-58e4-430c-95fb-8a349b28e7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:15.559540 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1ca802ee-58e4-430c-95fb-8a349b28e7bb None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:15.560796 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1ca802ee-58e4-430c-95fb-8a349b28e7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:15.570623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1237/2500] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:28:15.575735 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee865b4-f1b5-4538-b828-e93f37e97bdb None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:15.594845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee865b4-f1b5-4538-b828-e93f37e97bdb None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:15.602992 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23becb4-7d01-4c54-b74a-db49d81f18b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:15.604053 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23becb4-7d01-4c54-b74a-db49d81f18b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:15.604534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23becb4-7d01-4c54-b74a-db49d81f18b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:15.604933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23becb4-7d01-4c54-b74a-db49d81f18b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:15.606029 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23becb4-7d01-4c54-b74a-db49d81f18b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:15.606617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23becb4-7d01-4c54-b74a-db49d81f18b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:15.609904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23becb4-7d01-4c54-b74a-db49d81f18b8 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:15.631017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1264/2501] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:15.635739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca802ee-58e4-430c-95fb-8a349b28e7bb None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:15.647881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca802ee-58e4-430c-95fb-8a349b28e7bb None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:15.655365 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb567b6-e3f0-471d-be68-b2dff49f7f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:15.656673 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb567b6-e3f0-471d-be68-b2dff49f7f0c admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:15.656841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb567b6-e3f0-471d-be68-b2dff49f7f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:15.657170 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb567b6-e3f0-471d-be68-b2dff49f7f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:15.658230 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb567b6-e3f0-471d-be68-b2dff49f7f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:15.662150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb567b6-e3f0-471d-be68-b2dff49f7f0c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:15.847732 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1238/2502] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:28:15 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:15.852626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23becb4-7d01-4c54-b74a-db49d81f18b8 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:15.872245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23becb4-7d01-4c54-b74a-db49d81f18b8 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:15.978570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817af90-5fad-4aa3-8234-69342f30589e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:15.982889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817af90-5fad-4aa3-8234-69342f30589e admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:15.982889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817af90-5fad-4aa3-8234-69342f30589e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:15.982889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817af90-5fad-4aa3-8234-69342f30589e admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:15.982889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817af90-5fad-4aa3-8234-69342f30589e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:15.982889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817af90-5fad-4aa3-8234-69342f30589e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:16.063813 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:16.071179 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1265/2503] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:28:15 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:28:16.076138 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb567b6-e3f0-471d-be68-b2dff49f7f0c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:16.088373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb567b6-e3f0-471d-be68-b2dff49f7f0c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:16.095513 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db95454-f987-4de7-8fd3-3a3a05ef544a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:16.096181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db95454-f987-4de7-8fd3-3a3a05ef544a admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:16.096466 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db95454-f987-4de7-8fd3-3a3a05ef544a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:16.096748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db95454-f987-4de7-8fd3-3a3a05ef544a admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:16.097478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db95454-f987-4de7-8fd3-3a3a05ef544a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:16.099219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db95454-f987-4de7-8fd3-3a3a05ef544a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:16.116239 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1239/2504] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:28:16.121327 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817af90-5fad-4aa3-8234-69342f30589e admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:16.133696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817af90-5fad-4aa3-8234-69342f30589e admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:16.139528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb746e-8c2f-4ec2-af86-dfef1c15cf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:16.143810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb746e-8c2f-4ec2-af86-dfef1c15cf90 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:16.143810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb746e-8c2f-4ec2-af86-dfef1c15cf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:16.143810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb746e-8c2f-4ec2-af86-dfef1c15cf90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:16.143810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb746e-8c2f-4ec2-af86-dfef1c15cf90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:16.144652 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb746e-8c2f-4ec2-af86-dfef1c15cf90 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:16.158696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1266/2505] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:28:16.163137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db95454-f987-4de7-8fd3-3a3a05ef544a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:16.175257 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db95454-f987-4de7-8fd3-3a3a05ef544a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:16.183883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc861de-c160-4514-b75b-2facf5e5e197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:16.183883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc861de-c160-4514-b75b-2facf5e5e197 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:16.183883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc861de-c160-4514-b75b-2facf5e5e197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:16.183883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc861de-c160-4514-b75b-2facf5e5e197 admin admin] PATH_INFO: `/v3/projects/a93aa7eb58914baabcc5d9d834be7c27/users/c04410bb04fc4347a9830f6ec0797f53/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:16.200208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc861de-c160-4514-b75b-2facf5e5e197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a93aa7eb58914baabcc5d9d834be7c27, user_id=c04410bb04fc4347a9830f6ec0797f53, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:16.203699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc861de-c160-4514-b75b-2facf5e5e197 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:16.303604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1240/2506] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:28:16 2022] PUT /identity/v3/projects/a93aa7eb58914baabcc5d9d834be7c27/users/c04410bb04fc4347a9830f6ec0797f53/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:16.318531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49d74c-8687-4ef2-bd49-36e4670a0c9b None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:16.319050 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49d74c-8687-4ef2-bd49-36e4670a0c9b None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:16.319418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49d74c-8687-4ef2-bd49-36e4670a0c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:16.353325 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-5d49d74c-8687-4ef2-bd49-36e4670a0c9b None None] MFA Rules not processed for user `c04410bb04fc4347a9830f6ec0797f53`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:16.354926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5d49d74c-8687-4ef2-bd49-36e4670a0c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:16.440648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1267/2507] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:16.465665 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc861de-c160-4514-b75b-2facf5e5e197 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:16.471773 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-dbc861de-c160-4514-b75b-2facf5e5e197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:16.510678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:16.601165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc861de-c160-4514-b75b-2facf5e5e197 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:16.610982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce3ad2-f230-4069-bd7b-ae2139cb8202 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:16.611920 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3ad2-f230-4069-bd7b-ae2139cb8202 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:16.612351 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3ad2-f230-4069-bd7b-ae2139cb8202 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:16.612766 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3ad2-f230-4069-bd7b-ae2139cb8202 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:16.630181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce3ad2-f230-4069-bd7b-ae2139cb8202 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:16.631903 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce3ad2-f230-4069-bd7b-ae2139cb8202 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:16.646895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1241/2508] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:17.052599 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49d74c-8687-4ef2-bd49-36e4670a0c9b None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:17.132893 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49d74c-8687-4ef2-bd49-36e4670a0c9b None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:17.137728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7514f7-bd3a-4561-8601-139c3d3cbaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:17.138529 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7514f7-bd3a-4561-8601-139c3d3cbaa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:17.138709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7514f7-bd3a-4561-8601-139c3d3cbaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:17.139000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7514f7-bd3a-4561-8601-139c3d3cbaa0 admin admin] PATH_INFO: `/v3/users/c04410bb04fc4347a9830f6ec0797f53` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:17.140716 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7514f7-bd3a-4561-8601-139c3d3cbaa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c04410bb04fc4347a9830f6ec0797f53)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:17.142947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7514f7-bd3a-4561-8601-139c3d3cbaa0 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:17.417554 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6d7514f7-bd3a-4561-8601-139c3d3cbaa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c04410bb04fc4347a9830f6ec0797f53'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:17.418267 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6d7514f7-bd3a-4561-8601-139c3d3cbaa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c04410bb04fc4347a9830f6ec0797f53'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:17.435349 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6d7514f7-bd3a-4561-8601-139c3d3cbaa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c04410bb04fc4347a9830f6ec0797f53'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:17.644169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6d7514f7-bd3a-4561-8601-139c3d3cbaa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c04410bb04fc4347a9830f6ec0797f53'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:17.644933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6d7514f7-bd3a-4561-8601-139c3d3cbaa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c04410bb04fc4347a9830f6ec0797f53'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:17.652110 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:17.664577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1268/2509] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:28:17 2022] DELETE /identity/v3/users/c04410bb04fc4347a9830f6ec0797f53 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:17.667044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb26ad2-1ed3-4b7b-8f0d-d146820986ce None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:17.667651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb26ad2-1ed3-4b7b-8f0d-d146820986ce None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:17.667833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb26ad2-1ed3-4b7b-8f0d-d146820986ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:17.695436 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ccb26ad2-1ed3-4b7b-8f0d-d146820986ce None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:17.697219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ccb26ad2-1ed3-4b7b-8f0d-d146820986ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:17.786782 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1242/2510] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:17.799274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7514f7-bd3a-4561-8601-139c3d3cbaa0 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:17.802555 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6d7514f7-bd3a-4561-8601-139c3d3cbaa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:17.875874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7514f7-bd3a-4561-8601-139c3d3cbaa0 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:17.879885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705ba25-72c7-461d-9adf-4c5195adbc8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:17.880527 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705ba25-72c7-461d-9adf-4c5195adbc8c service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:17.880816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705ba25-72c7-461d-9adf-4c5195adbc8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:17.881123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705ba25-72c7-461d-9adf-4c5195adbc8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:17.892691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705ba25-72c7-461d-9adf-4c5195adbc8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:17.894562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705ba25-72c7-461d-9adf-4c5195adbc8c service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:17.906756 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1269/2511] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:18.435817 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb26ad2-1ed3-4b7b-8f0d-d146820986ce None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:18.438789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ccb26ad2-1ed3-4b7b-8f0d-d146820986ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:18.461669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb26ad2-1ed3-4b7b-8f0d-d146820986ce None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:18.467643 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705ba25-72c7-461d-9adf-4c5195adbc8c service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:18.470473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0705ba25-72c7-461d-9adf-4c5195adbc8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:18.472831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a1172-1a93-4832-b6ed-82285a289afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:18.474282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a1172-1a93-4832-b6ed-82285a289afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:18.475108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a1172-1a93-4832-b6ed-82285a289afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:18.475839 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a1172-1a93-4832-b6ed-82285a289afd admin admin] PATH_INFO: `/v3/projects/a93aa7eb58914baabcc5d9d834be7c27` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:18.478521 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a1172-1a93-4832-b6ed-82285a289afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a93aa7eb58914baabcc5d9d834be7c27)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:18.482608 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a1172-1a93-4832-b6ed-82285a289afd admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:18.665706 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705ba25-72c7-461d-9adf-4c5195adbc8c service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:18.671877 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f03459-17ab-4553-a83b-8c4c5e0e8c34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:18.672788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f03459-17ab-4553-a83b-8c4c5e0e8c34 service placement] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:18.673162 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f03459-17ab-4553-a83b-8c4c5e0e8c34 service placement] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:18.673443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f03459-17ab-4553-a83b-8c4c5e0e8c34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:18.675470 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-55f03459-17ab-4553-a83b-8c4c5e0e8c34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:18.690013 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f03459-17ab-4553-a83b-8c4c5e0e8c34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:18.691674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f03459-17ab-4553-a83b-8c4c5e0e8c34 service placement] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:18.700186 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-821a1172-1a93-4832-b6ed-82285a289afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a93aa7eb58914baabcc5d9d834be7c27', 'request_id': 'req-821a1172-1a93-4832-b6ed-82285a289afd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:18.704514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1270/2512] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:28:18.712685 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-821a1172-1a93-4832-b6ed-82285a289afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a93aa7eb58914baabcc5d9d834be7c27', 'request_id': 'req-821a1172-1a93-4832-b6ed-82285a289afd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:18.725455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-821a1172-1a93-4832-b6ed-82285a289afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a93aa7eb58914baabcc5d9d834be7c27', 'request_id': 'req-821a1172-1a93-4832-b6ed-82285a289afd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:18.862434 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-821a1172-1a93-4832-b6ed-82285a289afd admin admin] The token cache is being invalidate because project a93aa7eb58914baabcc5d9d834be7c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:28:18.862738 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-821a1172-1a93-4832-b6ed-82285a289afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:18.863561 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-821a1172-1a93-4832-b6ed-82285a289afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:18.865471 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1243/2513] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:28:18 2022] DELETE /identity/v3/projects/a93aa7eb58914baabcc5d9d834be7c27 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:18.870965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809c3e0-b22f-49a4-a1ad-8aa1ca36239a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:18.871633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809c3e0-b22f-49a4-a1ad-8aa1ca36239a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:18.871946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809c3e0-b22f-49a4-a1ad-8aa1ca36239a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:18.905107 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-c809c3e0-b22f-49a4-a1ad-8aa1ca36239a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:18.907130 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c809c3e0-b22f-49a4-a1ad-8aa1ca36239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:19.010142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1271/2514] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:28:19.019656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83983dc-da71-4adf-adf3-0545613cd2c7 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:19.019971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83983dc-da71-4adf-adf3-0545613cd2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:19.020308 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83983dc-da71-4adf-adf3-0545613cd2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:19.050071 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c83983dc-da71-4adf-adf3-0545613cd2c7 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:19.051482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c83983dc-da71-4adf-adf3-0545613cd2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:19.064362 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1244/2515] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:28:19.069561 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809c3e0-b22f-49a4-a1ad-8aa1ca36239a None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:19.087792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809c3e0-b22f-49a4-a1ad-8aa1ca36239a None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:19.098068 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a77ea5-51bb-4c16-b225-babf1b3b86a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:19.099191 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77ea5-51bb-4c16-b225-babf1b3b86a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:19.099692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77ea5-51bb-4c16-b225-babf1b3b86a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:19.100628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77ea5-51bb-4c16-b225-babf1b3b86a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:19.102003 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a77ea5-51bb-4c16-b225-babf1b3b86a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:19.103528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a77ea5-51bb-4c16-b225-babf1b3b86a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:19.107062 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a77ea5-51bb-4c16-b225-babf1b3b86a1 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:19.119988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:19.145459 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1272/2516] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:19.151254 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83983dc-da71-4adf-adf3-0545613cd2c7 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:19.176627 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83983dc-da71-4adf-adf3-0545613cd2c7 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:19.183247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed402536-48f5-4e05-af2b-b632e44d87cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:19.186872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed402536-48f5-4e05-af2b-b632e44d87cd admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:19.186872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed402536-48f5-4e05-af2b-b632e44d87cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:19.186872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed402536-48f5-4e05-af2b-b632e44d87cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:19.186872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed402536-48f5-4e05-af2b-b632e44d87cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:19.188638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed402536-48f5-4e05-af2b-b632e44d87cd admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:19.202412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:19.334228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1245/2517] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:28:19 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:28:19.340675 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a77ea5-51bb-4c16-b225-babf1b3b86a1 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:19.360993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a77ea5-51bb-4c16-b225-babf1b3b86a1 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:19.477381 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e2bae-5592-46e8-9d95-e13424a914d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:19.478525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e2bae-5592-46e8-9d95-e13424a914d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:19.478525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e2bae-5592-46e8-9d95-e13424a914d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:19.479307 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e2bae-5592-46e8-9d95-e13424a914d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:19.480436 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e2bae-5592-46e8-9d95-e13424a914d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:19.484902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e2bae-5592-46e8-9d95-e13424a914d7 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:19.617591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed402536-48f5-4e05-af2b-b632e44d87cd admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:19.626845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1273/2518] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:28:19 2022] POST /identity/v3/users => generated 288 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:19.637096 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed402536-48f5-4e05-af2b-b632e44d87cd admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:19.643214 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8de91-1f40-4bed-a853-24f7e056d3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:19.643997 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8de91-1f40-4bed-a853-24f7e056d3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:19.644343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8de91-1f40-4bed-a853-24f7e056d3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:19.645591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8de91-1f40-4bed-a853-24f7e056d3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:19.645591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8de91-1f40-4bed-a853-24f7e056d3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:19.647449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8de91-1f40-4bed-a853-24f7e056d3a4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:19.669725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1246/2519] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:28:19.672908 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e2bae-5592-46e8-9d95-e13424a914d7 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:19.690295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e2bae-5592-46e8-9d95-e13424a914d7 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:19.698073 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1edb23-a80f-47ef-ac7f-e9a562c08f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:19.699340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1edb23-a80f-47ef-ac7f-e9a562c08f1d admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:19.699842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1edb23-a80f-47ef-ac7f-e9a562c08f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:19.700323 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1edb23-a80f-47ef-ac7f-e9a562c08f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:19.701486 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1edb23-a80f-47ef-ac7f-e9a562c08f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:19.704091 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1edb23-a80f-47ef-ac7f-e9a562c08f1d admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:19.728069 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1274/2520] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:28:19.729424 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8de91-1f40-4bed-a853-24f7e056d3a4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:19.748362 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8de91-1f40-4bed-a853-24f7e056d3a4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:19.757156 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e94a5-896a-4c0b-a0db-b93447b20431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:19.758385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e94a5-896a-4c0b-a0db-b93447b20431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:19.758964 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e94a5-896a-4c0b-a0db-b93447b20431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:19.759433 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e94a5-896a-4c0b-a0db-b93447b20431 admin admin] PATH_INFO: `/v3/projects/dfe8218a86f04b238c45459dea5a587a/users/31268ca3cb4942c9a4d9173b55c590b8/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:19.786646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e94a5-896a-4c0b-a0db-b93447b20431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe8218a86f04b238c45459dea5a587a, user_id=31268ca3cb4942c9a4d9173b55c590b8, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:19.789475 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e94a5-896a-4c0b-a0db-b93447b20431 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:19.922327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1247/2521] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:28:19 2022] PUT /identity/v3/projects/dfe8218a86f04b238c45459dea5a587a/users/31268ca3cb4942c9a4d9173b55c590b8/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:28:19.942573 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85165c4-429b-469a-99f1-f6f3cd9e6aa2 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:19.943310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85165c4-429b-469a-99f1-f6f3cd9e6aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:19.943988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85165c4-429b-469a-99f1-f6f3cd9e6aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:20.005763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-f85165c4-429b-469a-99f1-f6f3cd9e6aa2 None None] MFA Rules not processed for user `31268ca3cb4942c9a4d9173b55c590b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:20.008946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f85165c4-429b-469a-99f1-f6f3cd9e6aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:20.156200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1275/2522] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:20.163465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e94a5-896a-4c0b-a0db-b93447b20431 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:20.372266 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e94a5-896a-4c0b-a0db-b93447b20431 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:20.387928 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19074469-96f7-44d8-9bdb-41b13b3c3475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:20.390229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19074469-96f7-44d8-9bdb-41b13b3c3475 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:20.390229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19074469-96f7-44d8-9bdb-41b13b3c3475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:20.390636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19074469-96f7-44d8-9bdb-41b13b3c3475 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:20.395006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19074469-96f7-44d8-9bdb-41b13b3c3475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:20.397408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19074469-96f7-44d8-9bdb-41b13b3c3475 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:20.633757 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1248/2523] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:28:20 2022] POST /identity/v3/projects => generated 373 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:28:20.638919 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85165c4-429b-469a-99f1-f6f3cd9e6aa2 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:20.666680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85165c4-429b-469a-99f1-f6f3cd9e6aa2 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:20.801680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560c9b4-0968-4f3b-8ba1-b3469b21f422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:20.802393 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560c9b4-0968-4f3b-8ba1-b3469b21f422 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:20.802828 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560c9b4-0968-4f3b-8ba1-b3469b21f422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:20.803173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560c9b4-0968-4f3b-8ba1-b3469b21f422 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:20.803935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560c9b4-0968-4f3b-8ba1-b3469b21f422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:20.806087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560c9b4-0968-4f3b-8ba1-b3469b21f422 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:20.817596 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:20.970928 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1276/2524] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:28:20 2022] POST /identity/v3/users => generated 293 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:20.975422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19074469-96f7-44d8-9bdb-41b13b3c3475 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:21.010186 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19074469-96f7-44d8-9bdb-41b13b3c3475 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:21.018767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656eb2f-8fa1-4f86-a58f-bde56536965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:21.019871 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656eb2f-8fa1-4f86-a58f-bde56536965d admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:21.020408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656eb2f-8fa1-4f86-a58f-bde56536965d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:21.020686 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656eb2f-8fa1-4f86-a58f-bde56536965d admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:21.021549 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656eb2f-8fa1-4f86-a58f-bde56536965d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:21.023373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656eb2f-8fa1-4f86-a58f-bde56536965d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:21.039992 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1249/2525] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:28:21.046131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560c9b4-0968-4f3b-8ba1-b3469b21f422 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:21.069093 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560c9b4-0968-4f3b-8ba1-b3469b21f422 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:21.078063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52ee4e-4639-4056-babb-b154b7d47d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:21.079257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52ee4e-4639-4056-babb-b154b7d47d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:21.079756 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52ee4e-4639-4056-babb-b154b7d47d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:21.080456 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52ee4e-4639-4056-babb-b154b7d47d3e admin admin] PATH_INFO: `/v3/projects/6c7998a64cb94dd2bb3ccb3104498743/users/9df2e88efa184d3694220f7aa604c7f2/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:21.109687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52ee4e-4639-4056-babb-b154b7d47d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7998a64cb94dd2bb3ccb3104498743, user_id=9df2e88efa184d3694220f7aa604c7f2, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:21.115530 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52ee4e-4639-4056-babb-b154b7d47d3e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:21.316870 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1277/2526] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:28:21 2022] PUT /identity/v3/projects/6c7998a64cb94dd2bb3ccb3104498743/users/9df2e88efa184d3694220f7aa604c7f2/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:28:21.322326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656eb2f-8fa1-4f86-a58f-bde56536965d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:21.341585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656eb2f-8fa1-4f86-a58f-bde56536965d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:21.449672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495a330-9313-4d12-a6f4-ab8ca0dc5f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:21.450791 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495a330-9313-4d12-a6f4-ab8ca0dc5f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:21.451249 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495a330-9313-4d12-a6f4-ab8ca0dc5f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:21.451688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495a330-9313-4d12-a6f4-ab8ca0dc5f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:21.452569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495a330-9313-4d12-a6f4-ab8ca0dc5f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:21.454695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495a330-9313-4d12-a6f4-ab8ca0dc5f18 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:21.467254 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1250/2527] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:28:21.472780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52ee4e-4639-4056-babb-b154b7d47d3e admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:21.500420 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52ee4e-4639-4056-babb-b154b7d47d3e admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:21.508900 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55382f-0e61-4af4-b312-e8561538a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:21.510120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55382f-0e61-4af4-b312-e8561538a2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:21.510729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55382f-0e61-4af4-b312-e8561538a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:21.511227 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55382f-0e61-4af4-b312-e8561538a2ee admin admin] PATH_INFO: `/v3/projects/6c7998a64cb94dd2bb3ccb3104498743/users/9df2e88efa184d3694220f7aa604c7f2/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:21.515946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55382f-0e61-4af4-b312-e8561538a2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7998a64cb94dd2bb3ccb3104498743, user_id=9df2e88efa184d3694220f7aa604c7f2, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:21.521621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55382f-0e61-4af4-b312-e8561538a2ee admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:21.555508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1278/2528] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:28:21 2022] PUT /identity/v3/projects/6c7998a64cb94dd2bb3ccb3104498743/users/9df2e88efa184d3694220f7aa604c7f2/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:21.566918 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a628ac-fff9-47b3-9ef6-65b6b0eb50f3 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:21.567434 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a628ac-fff9-47b3-9ef6-65b6b0eb50f3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:21.567943 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a628ac-fff9-47b3-9ef6-65b6b0eb50f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:21.609931 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-59a628ac-fff9-47b3-9ef6-65b6b0eb50f3 None None] MFA Rules not processed for user `9df2e88efa184d3694220f7aa604c7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:21.611693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-59a628ac-fff9-47b3-9ef6-65b6b0eb50f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:21.633801 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:21.768663 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1251/2529] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:21.782919 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55382f-0e61-4af4-b312-e8561538a2ee admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:21.785179 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-fc55382f-0e61-4af4-b312-e8561538a2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:21.949996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55382f-0e61-4af4-b312-e8561538a2ee admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:21.959589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a37ac3-7283-4607-b6fd-74acc1547306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:21.962955 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a37ac3-7283-4607-b6fd-74acc1547306 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:21.964178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a37ac3-7283-4607-b6fd-74acc1547306 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:21.964178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a37ac3-7283-4607-b6fd-74acc1547306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:22.173706 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a37ac3-7283-4607-b6fd-74acc1547306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:22.173706 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a37ac3-7283-4607-b6fd-74acc1547306 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:22.173706 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1279/2530] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:26.142546 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a628ac-fff9-47b3-9ef6-65b6b0eb50f3 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:26.240753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a628ac-fff9-47b3-9ef6-65b6b0eb50f3 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:26.247379 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a35ff-96a4-421f-af72-560d10227a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:26.248286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a35ff-96a4-421f-af72-560d10227a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:26.248952 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a35ff-96a4-421f-af72-560d10227a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:26.249369 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a35ff-96a4-421f-af72-560d10227a57 admin admin] PATH_INFO: `/v3/users/31268ca3cb4942c9a4d9173b55c590b8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:26.251658 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a35ff-96a4-421f-af72-560d10227a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31268ca3cb4942c9a4d9173b55c590b8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:26.255903 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a35ff-96a4-421f-af72-560d10227a57 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:26.501178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-847a35ff-96a4-421f-af72-560d10227a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31268ca3cb4942c9a4d9173b55c590b8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:26.502509 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-847a35ff-96a4-421f-af72-560d10227a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31268ca3cb4942c9a4d9173b55c590b8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:26.524746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-847a35ff-96a4-421f-af72-560d10227a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31268ca3cb4942c9a4d9173b55c590b8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:26.524746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-847a35ff-96a4-421f-af72-560d10227a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31268ca3cb4942c9a4d9173b55c590b8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:26.707960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-847a35ff-96a4-421f-af72-560d10227a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31268ca3cb4942c9a4d9173b55c590b8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:26.727411 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1252/2531] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:28:26 2022] DELETE /identity/v3/users/31268ca3cb4942c9a4d9173b55c590b8 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:28:26.732982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f290b7-04de-46ce-99a1-c7e9583d0128 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:26.733699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f290b7-04de-46ce-99a1-c7e9583d0128 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:26.734105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f290b7-04de-46ce-99a1-c7e9583d0128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:26.756229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-c1f290b7-04de-46ce-99a1-c7e9583d0128 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:26.757454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c1f290b7-04de-46ce-99a1-c7e9583d0128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:26.820313 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:26.837245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1280/2532] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:26.849928 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a35ff-96a4-421f-af72-560d10227a57 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:26.857278 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-847a35ff-96a4-421f-af72-560d10227a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:26.917276 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:26.955587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a35ff-96a4-421f-af72-560d10227a57 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:26.959977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf81e0e-b4ab-42d7-85e4-e4c14a501b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:26.960707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf81e0e-b4ab-42d7-85e4-e4c14a501b84 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:26.960991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf81e0e-b4ab-42d7-85e4-e4c14a501b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:26.961269 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf81e0e-b4ab-42d7-85e4-e4c14a501b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:26.976681 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf81e0e-b4ab-42d7-85e4-e4c14a501b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:26.977087 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf81e0e-b4ab-42d7-85e4-e4c14a501b84 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:26.991290 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1253/2533] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:27.714005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f290b7-04de-46ce-99a1-c7e9583d0128 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:27.714005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c1f290b7-04de-46ce-99a1-c7e9583d0128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:27.739427 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f290b7-04de-46ce-99a1-c7e9583d0128 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:27.752287 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cb64e-a214-435d-adb4-e3f05086818b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:27.753524 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cb64e-a214-435d-adb4-e3f05086818b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:27.759447 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cb64e-a214-435d-adb4-e3f05086818b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:27.759447 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cb64e-a214-435d-adb4-e3f05086818b admin admin] PATH_INFO: `/v3/projects/dfe8218a86f04b238c45459dea5a587a` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:27.759447 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cb64e-a214-435d-adb4-e3f05086818b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe8218a86f04b238c45459dea5a587a)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:27.760965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cb64e-a214-435d-adb4-e3f05086818b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:28.012397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1a9cb64e-a214-435d-adb4-e3f05086818b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe8218a86f04b238c45459dea5a587a', 'request_id': 'req-1a9cb64e-a214-435d-adb4-e3f05086818b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:28.094794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf81e0e-b4ab-42d7-85e4-e4c14a501b84 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:28.096673 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-fdf81e0e-b4ab-42d7-85e4-e4c14a501b84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:28.111180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf81e0e-b4ab-42d7-85e4-e4c14a501b84 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:28.131403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1a9cb64e-a214-435d-adb4-e3f05086818b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe8218a86f04b238c45459dea5a587a', 'request_id': 'req-1a9cb64e-a214-435d-adb4-e3f05086818b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:28.139761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1a9cb64e-a214-435d-adb4-e3f05086818b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe8218a86f04b238c45459dea5a587a', 'request_id': 'req-1a9cb64e-a214-435d-adb4-e3f05086818b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:28.154224 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1a9cb64e-a214-435d-adb4-e3f05086818b admin admin] The token cache is being invalidate because project dfe8218a86f04b238c45459dea5a587a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:28:28.154735 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1a9cb64e-a214-435d-adb4-e3f05086818b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:28.156175 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1a9cb64e-a214-435d-adb4-e3f05086818b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:28.158076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1281/2534] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:28:27 2022] DELETE /identity/v3/projects/dfe8218a86f04b238c45459dea5a587a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:28.164323 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cb64e-a214-435d-adb4-e3f05086818b admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:28.166025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-1a9cb64e-a214-435d-adb4-e3f05086818b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:28.197348 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400bc7c-c309-4dfb-8886-5cedff9fbbfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:28.198143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400bc7c-c309-4dfb-8886-5cedff9fbbfe service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:28.198386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400bc7c-c309-4dfb-8886-5cedff9fbbfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:28.198687 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400bc7c-c309-4dfb-8886-5cedff9fbbfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:28.201460 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9400bc7c-c309-4dfb-8886-5cedff9fbbfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:28.289904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cb64e-a214-435d-adb4-e3f05086818b admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:28.299302 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042affe-4b6a-40ac-b69a-61fc515db5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:28.300474 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042affe-4b6a-40ac-b69a-61fc515db5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:28.300969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042affe-4b6a-40ac-b69a-61fc515db5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:28.301478 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042affe-4b6a-40ac-b69a-61fc515db5c0 admin admin] PATH_INFO: `/v3/users/9df2e88efa184d3694220f7aa604c7f2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:28.303807 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042affe-4b6a-40ac-b69a-61fc515db5c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df2e88efa184d3694220f7aa604c7f2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:28.304260 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400bc7c-c309-4dfb-8886-5cedff9fbbfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:28.305757 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400bc7c-c309-4dfb-8886-5cedff9fbbfe service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:28.307715 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042affe-4b6a-40ac-b69a-61fc515db5c0 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:28.319248 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1254/2535] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:28:28.806417 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-2042affe-4b6a-40ac-b69a-61fc515db5c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df2e88efa184d3694220f7aa604c7f2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:28.807142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-2042affe-4b6a-40ac-b69a-61fc515db5c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df2e88efa184d3694220f7aa604c7f2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:28.828439 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-2042affe-4b6a-40ac-b69a-61fc515db5c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df2e88efa184d3694220f7aa604c7f2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:28.975753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-2042affe-4b6a-40ac-b69a-61fc515db5c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df2e88efa184d3694220f7aa604c7f2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:28.976426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-2042affe-4b6a-40ac-b69a-61fc515db5c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df2e88efa184d3694220f7aa604c7f2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:28.983032 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:28.992373 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1282/2536] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:28:28 2022] DELETE /identity/v3/users/9df2e88efa184d3694220f7aa604c7f2 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:28:29.676224 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400bc7c-c309-4dfb-8886-5cedff9fbbfe service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:29.694034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400bc7c-c309-4dfb-8886-5cedff9fbbfe service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:29.838683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b0b94-3cab-472a-a632-8b9740ff461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:29.840007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b0b94-3cab-472a-a632-8b9740ff461e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:29.840578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b0b94-3cab-472a-a632-8b9740ff461e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:29.841078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b0b94-3cab-472a-a632-8b9740ff461e admin admin] PATH_INFO: `/v3/projects/6c7998a64cb94dd2bb3ccb3104498743` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:29.844293 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b0b94-3cab-472a-a632-8b9740ff461e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7998a64cb94dd2bb3ccb3104498743)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:29.848304 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b0b94-3cab-472a-a632-8b9740ff461e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:29.902562 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:30.121660 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d74b0b94-3cab-472a-a632-8b9740ff461e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7998a64cb94dd2bb3ccb3104498743', 'request_id': 'req-d74b0b94-3cab-472a-a632-8b9740ff461e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:30.131278 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d74b0b94-3cab-472a-a632-8b9740ff461e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7998a64cb94dd2bb3ccb3104498743', 'request_id': 'req-d74b0b94-3cab-472a-a632-8b9740ff461e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:30.140077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d74b0b94-3cab-472a-a632-8b9740ff461e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7998a64cb94dd2bb3ccb3104498743', 'request_id': 'req-d74b0b94-3cab-472a-a632-8b9740ff461e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:30.361107 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d74b0b94-3cab-472a-a632-8b9740ff461e admin admin] The token cache is being invalidate because project 6c7998a64cb94dd2bb3ccb3104498743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:28:30.363042 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d74b0b94-3cab-472a-a632-8b9740ff461e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:30.364608 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d74b0b94-3cab-472a-a632-8b9740ff461e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:30.367343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1255/2537] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:28:29 2022] DELETE /identity/v3/projects/6c7998a64cb94dd2bb3ccb3104498743 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:28:30.376043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515498f4-2b54-457b-acb0-4a3a53321c55 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:30.376672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515498f4-2b54-457b-acb0-4a3a53321c55 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:30.376937 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515498f4-2b54-457b-acb0-4a3a53321c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:30.412215 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-515498f4-2b54-457b-acb0-4a3a53321c55 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:30.414400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-515498f4-2b54-457b-acb0-4a3a53321c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:30.532964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1283/2538] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:30.542862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58a871-ab7b-45cc-97a8-bca3ba50c244 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:30.543262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58a871-ab7b-45cc-97a8-bca3ba50c244 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:30.543636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58a871-ab7b-45cc-97a8-bca3ba50c244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:30.570884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2a58a871-ab7b-45cc-97a8-bca3ba50c244 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:30.572409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2a58a871-ab7b-45cc-97a8-bca3ba50c244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:30.583031 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1256/2539] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:28:30.587545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515498f4-2b54-457b-acb0-4a3a53321c55 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:30.599465 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515498f4-2b54-457b-acb0-4a3a53321c55 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:30.605155 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ff99f-eb16-4862-9c6d-57b00e576d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:30.605880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ff99f-eb16-4862-9c6d-57b00e576d0f admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:30.606304 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ff99f-eb16-4862-9c6d-57b00e576d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:30.606807 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ff99f-eb16-4862-9c6d-57b00e576d0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:30.607667 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ff99f-eb16-4862-9c6d-57b00e576d0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:30.608115 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ff99f-eb16-4862-9c6d-57b00e576d0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:30.611322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ff99f-eb16-4862-9c6d-57b00e576d0f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:30.628439 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1284/2540] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:30.633654 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58a871-ab7b-45cc-97a8-bca3ba50c244 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:30.647071 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58a871-ab7b-45cc-97a8-bca3ba50c244 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:30.653735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8a14a-27f2-4eeb-8ad4-cfab9abf1a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:30.655091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8a14a-27f2-4eeb-8ad4-cfab9abf1a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:30.655531 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8a14a-27f2-4eeb-8ad4-cfab9abf1a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:30.655881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8a14a-27f2-4eeb-8ad4-cfab9abf1a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:30.656939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8a14a-27f2-4eeb-8ad4-cfab9abf1a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:30.660464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8a14a-27f2-4eeb-8ad4-cfab9abf1a60 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:30.902504 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1257/2541] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:28:30 2022] POST /identity/v3/projects => generated 371 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:28:30.906875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ff99f-eb16-4862-9c6d-57b00e576d0f admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:30.918414 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ff99f-eb16-4862-9c6d-57b00e576d0f admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:31.027513 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596551da-7dab-46ea-ac79-87bcac14f563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:31.028750 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596551da-7dab-46ea-ac79-87bcac14f563 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:31.029358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596551da-7dab-46ea-ac79-87bcac14f563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:31.031009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596551da-7dab-46ea-ac79-87bcac14f563 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:31.032025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596551da-7dab-46ea-ac79-87bcac14f563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:31.036107 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596551da-7dab-46ea-ac79-87bcac14f563 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:31.241412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1285/2542] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:28:30 2022] POST /identity/v3/users => generated 286 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:28:31.242827 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8a14a-27f2-4eeb-8ad4-cfab9abf1a60 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:31.262668 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8a14a-27f2-4eeb-8ad4-cfab9abf1a60 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:31.273524 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29405655-0ccf-4c40-994f-c6ea57cb48f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:31.274186 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29405655-0ccf-4c40-994f-c6ea57cb48f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:31.274531 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29405655-0ccf-4c40-994f-c6ea57cb48f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:31.274816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29405655-0ccf-4c40-994f-c6ea57cb48f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:31.275512 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29405655-0ccf-4c40-994f-c6ea57cb48f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:31.277224 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29405655-0ccf-4c40-994f-c6ea57cb48f4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:31.312948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1258/2543] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:28:31.316987 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596551da-7dab-46ea-ac79-87bcac14f563 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:31.339238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596551da-7dab-46ea-ac79-87bcac14f563 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:31.353738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71d6f5-c8b9-4da6-8471-ee278c937275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:31.360054 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71d6f5-c8b9-4da6-8471-ee278c937275 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:31.365161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71d6f5-c8b9-4da6-8471-ee278c937275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:31.366335 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71d6f5-c8b9-4da6-8471-ee278c937275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:31.375865 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71d6f5-c8b9-4da6-8471-ee278c937275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:31.387140 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71d6f5-c8b9-4da6-8471-ee278c937275 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:31.430553 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1286/2544] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:28:31.436038 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29405655-0ccf-4c40-994f-c6ea57cb48f4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:31.461659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29405655-0ccf-4c40-994f-c6ea57cb48f4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:31.472505 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15db2a-1a72-4244-99fa-c25c85090397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:31.473559 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15db2a-1a72-4244-99fa-c25c85090397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:31.474011 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15db2a-1a72-4244-99fa-c25c85090397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:31.474575 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15db2a-1a72-4244-99fa-c25c85090397 admin admin] PATH_INFO: `/v3/projects/4db618b8340743dbb3a5da5a6c2a8153/users/4a76e3126b83448691e5d3c56c6c3f44/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:31.507632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15db2a-1a72-4244-99fa-c25c85090397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db618b8340743dbb3a5da5a6c2a8153, user_id=4a76e3126b83448691e5d3c56c6c3f44, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:31.511180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15db2a-1a72-4244-99fa-c25c85090397 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:31.747225 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1259/2545] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:28:31 2022] PUT /identity/v3/projects/4db618b8340743dbb3a5da5a6c2a8153/users/4a76e3126b83448691e5d3c56c6c3f44/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:31.751760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446eb8c-887d-4c94-9f1c-13eadca3cbee None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:31.752192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446eb8c-887d-4c94-9f1c-13eadca3cbee None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:31.752570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446eb8c-887d-4c94-9f1c-13eadca3cbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:31.775580 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b446eb8c-887d-4c94-9f1c-13eadca3cbee None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:31.776912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b446eb8c-887d-4c94-9f1c-13eadca3cbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:31.872736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:31.895305 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1287/2546] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:28:31.926787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15db2a-1a72-4244-99fa-c25c85090397 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:31.929979 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5e15db2a-1a72-4244-99fa-c25c85090397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:32.010324 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15db2a-1a72-4244-99fa-c25c85090397 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:32.017394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d634347-4c8c-4549-a3dd-f478322e0f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:32.018550 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d634347-4c8c-4549-a3dd-f478322e0f19 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:32.019045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d634347-4c8c-4549-a3dd-f478322e0f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:32.019526 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d634347-4c8c-4549-a3dd-f478322e0f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:32.036117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d634347-4c8c-4549-a3dd-f478322e0f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:32.038281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d634347-4c8c-4549-a3dd-f478322e0f19 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:32.053707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1260/2547] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:33.538176 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446eb8c-887d-4c94-9f1c-13eadca3cbee None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:33.559832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446eb8c-887d-4c94-9f1c-13eadca3cbee None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:33.565630 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba5c22-e472-41e4-99e2-a508484a3863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:33.566311 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba5c22-e472-41e4-99e2-a508484a3863 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:33.566645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba5c22-e472-41e4-99e2-a508484a3863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:33.566927 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba5c22-e472-41e4-99e2-a508484a3863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:33.570442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ebba5c22-e472-41e4-99e2-a508484a3863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:33.693995 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba5c22-e472-41e4-99e2-a508484a3863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:33.695639 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba5c22-e472-41e4-99e2-a508484a3863 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:33.710541 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1288/2548] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:28:35.280799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d634347-4c8c-4549-a3dd-f478322e0f19 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:35.283094 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7d634347-4c8c-4549-a3dd-f478322e0f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:35.336286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d634347-4c8c-4549-a3dd-f478322e0f19 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:35.344677 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7e184-445c-4c25-ad85-cef417d0b505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:35.345513 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e184-445c-4c25-ad85-cef417d0b505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:35.357927 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e184-445c-4c25-ad85-cef417d0b505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:35.357927 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e184-445c-4c25-ad85-cef417d0b505 admin admin] PATH_INFO: `/v3/users/1a89102e82bf400880ffb0b28b7e9aa3` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:35.357927 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7e184-445c-4c25-ad85-cef417d0b505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a89102e82bf400880ffb0b28b7e9aa3)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:35.357927 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7e184-445c-4c25-ad85-cef417d0b505 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:35.497805 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7061cb2-f230-436b-b00a-d42425c6bab8 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:35.499192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7061cb2-f230-436b-b00a-d42425c6bab8 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:35.499862 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7061cb2-f230-436b-b00a-d42425c6bab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:35.559152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b7061cb2-f230-436b-b00a-d42425c6bab8 None None] MFA Rules not processed for user `4a76e3126b83448691e5d3c56c6c3f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:35.561453 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b7061cb2-f230-436b-b00a-d42425c6bab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:35.722496 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1289/2549] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:35.737883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7061cb2-f230-436b-b00a-d42425c6bab8 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:35.740758 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b7061cb2-f230-436b-b00a-d42425c6bab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:35.746491 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:35.750877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-84d7e184-445c-4c25-ad85-cef417d0b505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a89102e82bf400880ffb0b28b7e9aa3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:35.751776 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-84d7e184-445c-4c25-ad85-cef417d0b505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a89102e82bf400880ffb0b28b7e9aa3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:35.783265 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-84d7e184-445c-4c25-ad85-cef417d0b505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a89102e82bf400880ffb0b28b7e9aa3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:35.785163 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-84d7e184-445c-4c25-ad85-cef417d0b505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a89102e82bf400880ffb0b28b7e9aa3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:35.852907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7061cb2-f230-436b-b00a-d42425c6bab8 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:35.857392 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb04ef-f5e8-4e3f-ad05-d2d95e05e9e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:35.859122 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb04ef-f5e8-4e3f-ad05-d2d95e05e9e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:35.859483 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb04ef-f5e8-4e3f-ad05-d2d95e05e9e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:35.859867 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb04ef-f5e8-4e3f-ad05-d2d95e05e9e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:35.862000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-77bb04ef-f5e8-4e3f-ad05-d2d95e05e9e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:35.879669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb04ef-f5e8-4e3f-ad05-d2d95e05e9e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:35.881889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb04ef-f5e8-4e3f-ad05-d2d95e05e9e0 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:35.900548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1290/2550] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:35.913160 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-84d7e184-445c-4c25-ad85-cef417d0b505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a89102e82bf400880ffb0b28b7e9aa3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:35.935651 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1261/2551] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:28:35 2022] DELETE /identity/v3/users/1a89102e82bf400880ffb0b28b7e9aa3 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:28:36.939196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb04ef-f5e8-4e3f-ad05-d2d95e05e9e0 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:36.939196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-77bb04ef-f5e8-4e3f-ad05-d2d95e05e9e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:36.965673 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb04ef-f5e8-4e3f-ad05-d2d95e05e9e0 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:37.037923 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:37.103214 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469868f-f128-4a1c-afde-ed978d1a7674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:37.105133 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469868f-f128-4a1c-afde-ed978d1a7674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:37.105939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469868f-f128-4a1c-afde-ed978d1a7674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:37.106931 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469868f-f128-4a1c-afde-ed978d1a7674 admin admin] PATH_INFO: `/v3/projects/92fc5462238946f29c92ea50b243d4f6` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:37.110118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469868f-f128-4a1c-afde-ed978d1a7674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92fc5462238946f29c92ea50b243d4f6)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:37.114788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469868f-f128-4a1c-afde-ed978d1a7674 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:37.350534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4469868f-f128-4a1c-afde-ed978d1a7674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92fc5462238946f29c92ea50b243d4f6', 'request_id': 'req-4469868f-f128-4a1c-afde-ed978d1a7674'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:37.513621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4469868f-f128-4a1c-afde-ed978d1a7674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92fc5462238946f29c92ea50b243d4f6', 'request_id': 'req-4469868f-f128-4a1c-afde-ed978d1a7674'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:37.523085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4469868f-f128-4a1c-afde-ed978d1a7674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92fc5462238946f29c92ea50b243d4f6', 'request_id': 'req-4469868f-f128-4a1c-afde-ed978d1a7674'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:37.541883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4469868f-f128-4a1c-afde-ed978d1a7674 admin admin] The token cache is being invalidate because project 92fc5462238946f29c92ea50b243d4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:28:37.542256 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4469868f-f128-4a1c-afde-ed978d1a7674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:37.543139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-4469868f-f128-4a1c-afde-ed978d1a7674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:37.550419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1291/2552] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:28:36 2022] DELETE /identity/v3/projects/92fc5462238946f29c92ea50b243d4f6 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:37.553164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbd50a-1cc1-4eb5-991b-8cd27c6ff99b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:37.553896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbd50a-1cc1-4eb5-991b-8cd27c6ff99b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:37.554153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbd50a-1cc1-4eb5-991b-8cd27c6ff99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:37.590021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5edbd50a-1cc1-4eb5-991b-8cd27c6ff99b None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:37.592471 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5edbd50a-1cc1-4eb5-991b-8cd27c6ff99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:37.726621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1262/2553] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:37.731685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c225ebb-8fbe-4359-8f6a-32c0f7a2546f None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:37.732181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c225ebb-8fbe-4359-8f6a-32c0f7a2546f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:37.732757 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c225ebb-8fbe-4359-8f6a-32c0f7a2546f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:37.766611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-3c225ebb-8fbe-4359-8f6a-32c0f7a2546f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:37.768642 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3c225ebb-8fbe-4359-8f6a-32c0f7a2546f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:37.781819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1292/2554] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:37.787040 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbd50a-1cc1-4eb5-991b-8cd27c6ff99b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:37.800571 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbd50a-1cc1-4eb5-991b-8cd27c6ff99b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:37.805799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9285a-8be6-4ca0-8e92-9d588653ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:37.806665 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9285a-8be6-4ca0-8e92-9d588653ac51 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:37.806954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9285a-8be6-4ca0-8e92-9d588653ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:37.807230 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9285a-8be6-4ca0-8e92-9d588653ac51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:37.807965 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9285a-8be6-4ca0-8e92-9d588653ac51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:37.808318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9285a-8be6-4ca0-8e92-9d588653ac51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:37.810305 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9285a-8be6-4ca0-8e92-9d588653ac51 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:37.826569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1263/2555] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:28:37.832020 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c225ebb-8fbe-4359-8f6a-32c0f7a2546f None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:37.848189 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c225ebb-8fbe-4359-8f6a-32c0f7a2546f None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:37.855429 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536caf7b-fbfc-4f9f-9b6f-f49a430a8671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:37.856609 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536caf7b-fbfc-4f9f-9b6f-f49a430a8671 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:37.857001 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536caf7b-fbfc-4f9f-9b6f-f49a430a8671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:37.857380 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536caf7b-fbfc-4f9f-9b6f-f49a430a8671 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:37.858967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536caf7b-fbfc-4f9f-9b6f-f49a430a8671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:37.862087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536caf7b-fbfc-4f9f-9b6f-f49a430a8671 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:38.019179 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1293/2556] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:28:37 2022] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:38.023529 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9285a-8be6-4ca0-8e92-9d588653ac51 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:38.039121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9285a-8be6-4ca0-8e92-9d588653ac51 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:38.110713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be4960-c5c0-4f06-a0eb-b0f9bb62e133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:38.111392 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be4960-c5c0-4f06-a0eb-b0f9bb62e133 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:38.111675 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be4960-c5c0-4f06-a0eb-b0f9bb62e133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:38.111947 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be4960-c5c0-4f06-a0eb-b0f9bb62e133 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:38.112671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be4960-c5c0-4f06-a0eb-b0f9bb62e133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:38.114940 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be4960-c5c0-4f06-a0eb-b0f9bb62e133 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:38.257297 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1264/2557] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:28:38 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:38.269973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536caf7b-fbfc-4f9f-9b6f-f49a430a8671 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:38.276374 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536caf7b-fbfc-4f9f-9b6f-f49a430a8671 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:38.284010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f43e1-6876-460c-b5d6-3adc246ba19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:38.284772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f43e1-6876-460c-b5d6-3adc246ba19a admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:38.285142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f43e1-6876-460c-b5d6-3adc246ba19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:38.285517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f43e1-6876-460c-b5d6-3adc246ba19a admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:38.286344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f43e1-6876-460c-b5d6-3adc246ba19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:38.288122 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f43e1-6876-460c-b5d6-3adc246ba19a admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:38.302327 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1294/2558] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:28:38.307778 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be4960-c5c0-4f06-a0eb-b0f9bb62e133 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:38.325768 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be4960-c5c0-4f06-a0eb-b0f9bb62e133 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:38.334415 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15f188-e5de-4ff2-b54a-fe98e9360552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:38.334991 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15f188-e5de-4ff2-b54a-fe98e9360552 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:38.335320 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15f188-e5de-4ff2-b54a-fe98e9360552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:38.335750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15f188-e5de-4ff2-b54a-fe98e9360552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:38.336903 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15f188-e5de-4ff2-b54a-fe98e9360552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:38.340265 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15f188-e5de-4ff2-b54a-fe98e9360552 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:38.362735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1265/2559] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:28:38.365341 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f43e1-6876-460c-b5d6-3adc246ba19a admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:38.380101 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f43e1-6876-460c-b5d6-3adc246ba19a admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:38.387902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a060d5c-b46a-4623-981e-309661e6b78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:38.391109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a060d5c-b46a-4623-981e-309661e6b78f admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:38.391873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a060d5c-b46a-4623-981e-309661e6b78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:38.399591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a060d5c-b46a-4623-981e-309661e6b78f admin admin] PATH_INFO: `/v3/projects/2cf909ff7d9f4c29befbc7fba2387aea/users/fc3539ba1bdf4aa1ba9be7d95cd43f2f/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:38.417295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a060d5c-b46a-4623-981e-309661e6b78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf909ff7d9f4c29befbc7fba2387aea, user_id=fc3539ba1bdf4aa1ba9be7d95cd43f2f, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:38.420455 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a060d5c-b46a-4623-981e-309661e6b78f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:38.558322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1295/2560] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:28:38 2022] PUT /identity/v3/projects/2cf909ff7d9f4c29befbc7fba2387aea/users/fc3539ba1bdf4aa1ba9be7d95cd43f2f/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:38.570963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3a9f9-2ec7-4455-acf1-c5e091d122bb None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:38.572922 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3a9f9-2ec7-4455-acf1-c5e091d122bb None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:38.572922 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3a9f9-2ec7-4455-acf1-c5e091d122bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:38.613906 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-bec3a9f9-2ec7-4455-acf1-c5e091d122bb None None] MFA Rules not processed for user `fc3539ba1bdf4aa1ba9be7d95cd43f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:38.615374 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bec3a9f9-2ec7-4455-acf1-c5e091d122bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:38.652784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:38.710821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1266/2561] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:38.716044 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a060d5c-b46a-4623-981e-309661e6b78f admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:38.830561 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:38.836415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a060d5c-b46a-4623-981e-309661e6b78f admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:38.846819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf4737-4bf0-448b-9c50-af4e53e8328a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:38.849548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf4737-4bf0-448b-9c50-af4e53e8328a admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:38.849548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf4737-4bf0-448b-9c50-af4e53e8328a admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:38.849548 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf4737-4bf0-448b-9c50-af4e53e8328a admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:38.850425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf4737-4bf0-448b-9c50-af4e53e8328a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:38.854824 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf4737-4bf0-448b-9c50-af4e53e8328a admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:39.010307 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1296/2562] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:28:38 2022] POST /identity/v3/projects => generated 381 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:28:39.016151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3a9f9-2ec7-4455-acf1-c5e091d122bb None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:39.037741 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3a9f9-2ec7-4455-acf1-c5e091d122bb None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:39.152309 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219a74-ea28-476f-a615-dceb0091b73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:39.153445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219a74-ea28-476f-a615-dceb0091b73e admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:39.153777 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219a74-ea28-476f-a615-dceb0091b73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:39.154100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219a74-ea28-476f-a615-dceb0091b73e admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:39.155764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d219a74-ea28-476f-a615-dceb0091b73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:39.158981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d219a74-ea28-476f-a615-dceb0091b73e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:39.443083 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1267/2563] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:28:39 2022] POST /identity/v3/users => generated 297 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:39.447933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf4737-4bf0-448b-9c50-af4e53e8328a admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:39.468852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf4737-4bf0-448b-9c50-af4e53e8328a admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:39.475011 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1c589-7fbd-44fa-9d05-47d1b30d788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:39.475810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1c589-7fbd-44fa-9d05-47d1b30d788b admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:39.476209 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1c589-7fbd-44fa-9d05-47d1b30d788b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:39.476603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1c589-7fbd-44fa-9d05-47d1b30d788b admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:39.477552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1c589-7fbd-44fa-9d05-47d1b30d788b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:39.479776 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1c589-7fbd-44fa-9d05-47d1b30d788b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:39.485046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b14f7-1bb4-4631-b9b1-a148b6ad083a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:39.490714 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b14f7-1bb4-4631-b9b1-a148b6ad083a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:39.490714 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b14f7-1bb4-4631-b9b1-a148b6ad083a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:39.497539 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1297/2564] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:28:39.503410 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1c589-7fbd-44fa-9d05-47d1b30d788b admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:39.515092 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1c589-7fbd-44fa-9d05-47d1b30d788b admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:39.520433 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece2924-6ad1-4388-bcb0-b3cac27e0d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:39.521503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece2924-6ad1-4388-bcb0-b3cac27e0d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:39.522248 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece2924-6ad1-4388-bcb0-b3cac27e0d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:39.522795 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece2924-6ad1-4388-bcb0-b3cac27e0d77 admin admin] PATH_INFO: `/v3/projects/3cf6860a076b4a0c9f6724136c1c89e9/users/16ea3b14f05746fb980fa758baec4b71/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:39.529442 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c35b14f7-1bb4-4631-b9b1-a148b6ad083a None None] MFA Rules not processed for user `4a76e3126b83448691e5d3c56c6c3f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:39.531485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c35b14f7-1bb4-4631-b9b1-a148b6ad083a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:39.549304 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece2924-6ad1-4388-bcb0-b3cac27e0d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf6860a076b4a0c9f6724136c1c89e9, user_id=16ea3b14f05746fb980fa758baec4b71, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:39.554805 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece2924-6ad1-4388-bcb0-b3cac27e0d77 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:39.613911 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1268/2565] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:28:39.751462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1298/2566] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:28:39 2022] PUT /identity/v3/projects/3cf6860a076b4a0c9f6724136c1c89e9/users/16ea3b14f05746fb980fa758baec4b71/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:39.758115 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b14f7-1bb4-4631-b9b1-a148b6ad083a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:39.774080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b14f7-1bb4-4631-b9b1-a148b6ad083a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:39.915889 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fd5a1-1f5c-4f7a-b74a-56ef38951cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:39.916851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fd5a1-1f5c-4f7a-b74a-56ef38951cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:39.917407 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fd5a1-1f5c-4f7a-b74a-56ef38951cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:39.917984 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fd5a1-1f5c-4f7a-b74a-56ef38951cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:39.919021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fd5a1-1f5c-4f7a-b74a-56ef38951cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:39.921552 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fd5a1-1f5c-4f7a-b74a-56ef38951cb5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:39.935530 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1269/2567] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:28:39.941285 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece2924-6ad1-4388-bcb0-b3cac27e0d77 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:39.955350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece2924-6ad1-4388-bcb0-b3cac27e0d77 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:39.960326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a1569-1eca-4a5a-a571-d336c9aad1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:39.961038 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a1569-1eca-4a5a-a571-d336c9aad1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:39.961312 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a1569-1eca-4a5a-a571-d336c9aad1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:39.961792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a1569-1eca-4a5a-a571-d336c9aad1d5 admin admin] PATH_INFO: `/v3/projects/3cf6860a076b4a0c9f6724136c1c89e9/users/16ea3b14f05746fb980fa758baec4b71/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:39.964153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a1569-1eca-4a5a-a571-d336c9aad1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf6860a076b4a0c9f6724136c1c89e9, user_id=16ea3b14f05746fb980fa758baec4b71, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:39.966947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a1569-1eca-4a5a-a571-d336c9aad1d5 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:39.979774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1299/2568] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:28:39 2022] PUT /identity/v3/projects/3cf6860a076b4a0c9f6724136c1c89e9/users/16ea3b14f05746fb980fa758baec4b71/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:28:39.993801 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2424ec-b43e-47b8-93cb-a002b643c9ca None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:39.994412 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2424ec-b43e-47b8-93cb-a002b643c9ca None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:39.994849 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2424ec-b43e-47b8-93cb-a002b643c9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:40.036122 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9b2424ec-b43e-47b8-93cb-a002b643c9ca None None] MFA Rules not processed for user `16ea3b14f05746fb980fa758baec4b71`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:40.037472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9b2424ec-b43e-47b8-93cb-a002b643c9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:40.143539 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1270/2569] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:40.163883 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a1569-1eca-4a5a-a571-d336c9aad1d5 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:40.166576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d07a1569-1eca-4a5a-a571-d336c9aad1d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:40.193401 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:40.259098 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a1569-1eca-4a5a-a571-d336c9aad1d5 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:40.269982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b025e-3b5d-4a4f-8825-e2b46dec44cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:40.269982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b025e-3b5d-4a4f-8825-e2b46dec44cf service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:40.269982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b025e-3b5d-4a4f-8825-e2b46dec44cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:40.269982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b025e-3b5d-4a4f-8825-e2b46dec44cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:40.281495 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b025e-3b5d-4a4f-8825-e2b46dec44cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:40.283134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b025e-3b5d-4a4f-8825-e2b46dec44cf service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:40.297001 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1300/2570] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:42.312711 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2424ec-b43e-47b8-93cb-a002b643c9ca None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:42.330703 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2424ec-b43e-47b8-93cb-a002b643c9ca None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:42.336600 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310686be-afc4-44c0-b706-6686e2def422 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ea3b14f05746fb980fa758baec4b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf6860a076b4a0c9f6724136c1c89e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:42.337334 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310686be-afc4-44c0-b706-6686e2def422 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:42.337706 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310686be-afc4-44c0-b706-6686e2def422 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:42.338153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310686be-afc4-44c0-b706-6686e2def422 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:42.339091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310686be-afc4-44c0-b706-6686e2def422 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:42.339528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310686be-afc4-44c0-b706-6686e2def422 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:42.341494 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310686be-afc4-44c0-b706-6686e2def422 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:42.359966 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1271/2571] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:42.366343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b025e-3b5d-4a4f-8825-e2b46dec44cf service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:42.384053 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b025e-3b5d-4a4f-8825-e2b46dec44cf service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:42.391629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b30397-a0fc-4e69-94e5-861cd1c72eeb tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ea3b14f05746fb980fa758baec4b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf6860a076b4a0c9f6724136c1c89e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:42.392597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b30397-a0fc-4e69-94e5-861cd1c72eeb tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:42.393128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b30397-a0fc-4e69-94e5-861cd1c72eeb tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:42.393606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b30397-a0fc-4e69-94e5-861cd1c72eeb tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:42.394377 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b30397-a0fc-4e69-94e5-861cd1c72eeb tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:42.396687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b30397-a0fc-4e69-94e5-861cd1c72eeb tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:42.602276 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1301/2572] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:28:42 2022] POST /identity/v3/projects => generated 355 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:42.608893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310686be-afc4-44c0-b706-6686e2def422 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:42.625342 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310686be-afc4-44c0-b706-6686e2def422 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:42.706639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9362a5-a126-4912-a2f1-3719694ca5cf tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ea3b14f05746fb980fa758baec4b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf6860a076b4a0c9f6724136c1c89e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:42.707331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9362a5-a126-4912-a2f1-3719694ca5cf tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:42.707691 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9362a5-a126-4912-a2f1-3719694ca5cf tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:42.708004 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9362a5-a126-4912-a2f1-3719694ca5cf tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:42.708703 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9362a5-a126-4912-a2f1-3719694ca5cf tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:42.709112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9362a5-a126-4912-a2f1-3719694ca5cf tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:42.716014 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9362a5-a126-4912-a2f1-3719694ca5cf tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:42.731589 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1272/2573] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:42.743914 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b30397-a0fc-4e69-94e5-861cd1c72eeb tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:42.747463 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c3b30397-a0fc-4e69-94e5-861cd1c72eeb tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:42.813456 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9362a5-a126-4912-a2f1-3719694ca5cf tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:42.831861 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9362a5-a126-4912-a2f1-3719694ca5cf tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:42.843939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746e366-6212-4d77-a57b-6301bb89ab48 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ea3b14f05746fb980fa758baec4b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf6860a076b4a0c9f6724136c1c89e9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:42.845086 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746e366-6212-4d77-a57b-6301bb89ab48 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:42.845601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746e366-6212-4d77-a57b-6301bb89ab48 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:42.846102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746e366-6212-4d77-a57b-6301bb89ab48 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] PATH_INFO: `/v3/projects/48bd42f2d0114d77b3e2fec9dd5749f6` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:42.849141 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746e366-6212-4d77-a57b-6301bb89ab48 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] RBAC: Authorizing `identity:delete_project(project_id=48bd42f2d0114d77b3e2fec9dd5749f6)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:42.861284 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746e366-6212-4d77-a57b-6301bb89ab48 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:42.867219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b30397-a0fc-4e69-94e5-861cd1c72eeb tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:42.872425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28f7a7-ad78-45c6-b17f-5ba9328ce69a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:42.873094 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28f7a7-ad78-45c6-b17f-5ba9328ce69a service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:42.873380 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28f7a7-ad78-45c6-b17f-5ba9328ce69a service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:42.874551 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28f7a7-ad78-45c6-b17f-5ba9328ce69a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:42.876493 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7f28f7a7-ad78-45c6-b17f-5ba9328ce69a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:42.925343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:42.968000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28f7a7-ad78-45c6-b17f-5ba9328ce69a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:42.969738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28f7a7-ad78-45c6-b17f-5ba9328ce69a service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:42.982544 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1302/2574] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:43.010775 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3746e366-6212-4d77-a57b-6301bb89ab48 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48bd42f2d0114d77b3e2fec9dd5749f6', 'request_id': 'req-3746e366-6212-4d77-a57b-6301bb89ab48'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:43.012158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:43.018813 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3746e366-6212-4d77-a57b-6301bb89ab48 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48bd42f2d0114d77b3e2fec9dd5749f6', 'request_id': 'req-3746e366-6212-4d77-a57b-6301bb89ab48'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:43.027542 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3746e366-6212-4d77-a57b-6301bb89ab48 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48bd42f2d0114d77b3e2fec9dd5749f6', 'request_id': 'req-3746e366-6212-4d77-a57b-6301bb89ab48'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:43.177100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3746e366-6212-4d77-a57b-6301bb89ab48 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] The token cache is being invalidate because project 48bd42f2d0114d77b3e2fec9dd5749f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:28:43.177505 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3746e366-6212-4d77-a57b-6301bb89ab48 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:43.178218 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3746e366-6212-4d77-a57b-6301bb89ab48 tempest-VolumeQuotaClassesTest-1516801031 tempest-VolumeQuotaClassesTest-1516801031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:43.180333 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1273/2575] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:28:42 2022] DELETE /identity/v3/projects/48bd42f2d0114d77b3e2fec9dd5749f6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:28:44.306594 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28f7a7-ad78-45c6-b17f-5ba9328ce69a service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:44.319847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28f7a7-ad78-45c6-b17f-5ba9328ce69a service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:44.437385 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fa08e-1bff-4584-878f-484939ae5681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:44.438289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fa08e-1bff-4584-878f-484939ae5681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:44.438810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fa08e-1bff-4584-878f-484939ae5681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:44.439264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fa08e-1bff-4584-878f-484939ae5681 admin admin] PATH_INFO: `/v3/users/fc3539ba1bdf4aa1ba9be7d95cd43f2f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:44.441648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fa08e-1bff-4584-878f-484939ae5681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc3539ba1bdf4aa1ba9be7d95cd43f2f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:44.444150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fa08e-1bff-4584-878f-484939ae5681 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:44.831736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-468fa08e-1bff-4584-878f-484939ae5681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc3539ba1bdf4aa1ba9be7d95cd43f2f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:44.832507 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-468fa08e-1bff-4584-878f-484939ae5681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc3539ba1bdf4aa1ba9be7d95cd43f2f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:44.853628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-468fa08e-1bff-4584-878f-484939ae5681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc3539ba1bdf4aa1ba9be7d95cd43f2f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:45.063289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-468fa08e-1bff-4584-878f-484939ae5681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc3539ba1bdf4aa1ba9be7d95cd43f2f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:45.064442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-468fa08e-1bff-4584-878f-484939ae5681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc3539ba1bdf4aa1ba9be7d95cd43f2f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:45.083239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1303/2576] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:28:44 2022] DELETE /identity/v3/users/fc3539ba1bdf4aa1ba9be7d95cd43f2f => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:45.087609 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3daa5-8727-4cb5-8925-e8959dfdc6d5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:45.088232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3daa5-8727-4cb5-8925-e8959dfdc6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:45.088544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3daa5-8727-4cb5-8925-e8959dfdc6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:45.113253 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-45c3daa5-8727-4cb5-8925-e8959dfdc6d5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:45.114510 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-45c3daa5-8727-4cb5-8925-e8959dfdc6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:45.206466 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1274/2577] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:45.216384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fa08e-1bff-4584-878f-484939ae5681 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:45.218095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-468fa08e-1bff-4584-878f-484939ae5681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:45.335676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:45.355315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fa08e-1bff-4584-878f-484939ae5681 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:45.361232 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96996bf6-d7bb-4e14-937e-867ef0bf9bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:45.362131 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96996bf6-d7bb-4e14-937e-867ef0bf9bde service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:45.362708 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96996bf6-d7bb-4e14-937e-867ef0bf9bde service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:45.363142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96996bf6-d7bb-4e14-937e-867ef0bf9bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:45.383705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96996bf6-d7bb-4e14-937e-867ef0bf9bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:45.387648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96996bf6-d7bb-4e14-937e-867ef0bf9bde service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:45.402269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1304/2578] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:46.627354 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3daa5-8727-4cb5-8925-e8959dfdc6d5 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:46.630326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-45c3daa5-8727-4cb5-8925-e8959dfdc6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:46.681288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3daa5-8727-4cb5-8925-e8959dfdc6d5 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:46.697606 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ead82-9681-4aa0-b213-70354b40b731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:46.708888 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ead82-9681-4aa0-b213-70354b40b731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:46.708888 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ead82-9681-4aa0-b213-70354b40b731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:46.708888 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ead82-9681-4aa0-b213-70354b40b731 admin admin] PATH_INFO: `/v3/projects/2cf909ff7d9f4c29befbc7fba2387aea` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:46.708888 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ead82-9681-4aa0-b213-70354b40b731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cf909ff7d9f4c29befbc7fba2387aea)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:46.708888 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ead82-9681-4aa0-b213-70354b40b731 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:46.856460 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-db4ead82-9681-4aa0-b213-70354b40b731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cf909ff7d9f4c29befbc7fba2387aea', 'request_id': 'req-db4ead82-9681-4aa0-b213-70354b40b731'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:46.878804 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-db4ead82-9681-4aa0-b213-70354b40b731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cf909ff7d9f4c29befbc7fba2387aea', 'request_id': 'req-db4ead82-9681-4aa0-b213-70354b40b731'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:46.892516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-db4ead82-9681-4aa0-b213-70354b40b731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cf909ff7d9f4c29befbc7fba2387aea', 'request_id': 'req-db4ead82-9681-4aa0-b213-70354b40b731'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:47.035366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-db4ead82-9681-4aa0-b213-70354b40b731 admin admin] The token cache is being invalidate because project 2cf909ff7d9f4c29befbc7fba2387aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:28:47.035718 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-db4ead82-9681-4aa0-b213-70354b40b731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:47.037307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-db4ead82-9681-4aa0-b213-70354b40b731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:47.043350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1275/2579] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:28:46 2022] DELETE /identity/v3/projects/2cf909ff7d9f4c29befbc7fba2387aea => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:47.044664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96996bf6-d7bb-4e14-937e-867ef0bf9bde service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:47.058523 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96996bf6-d7bb-4e14-937e-867ef0bf9bde service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:47.139204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7458-fa0a-415f-b6b0-e93b4ef6583d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:47.139885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7458-fa0a-415f-b6b0-e93b4ef6583d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:47.140172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7458-fa0a-415f-b6b0-e93b4ef6583d admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:47.140455 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7458-fa0a-415f-b6b0-e93b4ef6583d admin admin] PATH_INFO: `/v3/users/16ea3b14f05746fb980fa758baec4b71` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:47.141762 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d7458-fa0a-415f-b6b0-e93b4ef6583d admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ea3b14f05746fb980fa758baec4b71)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:47.143875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d7458-fa0a-415f-b6b0-e93b4ef6583d admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:47.459981 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-af0d7458-fa0a-415f-b6b0-e93b4ef6583d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ea3b14f05746fb980fa758baec4b71'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:47.461552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-af0d7458-fa0a-415f-b6b0-e93b4ef6583d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ea3b14f05746fb980fa758baec4b71'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:47.485286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-af0d7458-fa0a-415f-b6b0-e93b4ef6583d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ea3b14f05746fb980fa758baec4b71'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:47.608904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-af0d7458-fa0a-415f-b6b0-e93b4ef6583d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ea3b14f05746fb980fa758baec4b71'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:47.616936 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-af0d7458-fa0a-415f-b6b0-e93b4ef6583d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ea3b14f05746fb980fa758baec4b71'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:47.656880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1305/2580] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:28:47 2022] DELETE /identity/v3/users/16ea3b14f05746fb980fa758baec4b71 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:48.867411 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ead82-9681-4aa0-b213-70354b40b731 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:48.869341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-db4ead82-9681-4aa0-b213-70354b40b731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:48.902037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ead82-9681-4aa0-b213-70354b40b731 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:48.986702 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfaa58-2153-4bd2-8d25-ed67d8077f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:48.987386 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfaa58-2153-4bd2-8d25-ed67d8077f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:48.987673 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfaa58-2153-4bd2-8d25-ed67d8077f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:48.987955 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfaa58-2153-4bd2-8d25-ed67d8077f31 admin admin] PATH_INFO: `/v3/projects/3cf6860a076b4a0c9f6724136c1c89e9` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:48.989259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfaa58-2153-4bd2-8d25-ed67d8077f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf6860a076b4a0c9f6724136c1c89e9)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:48.991621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfaa58-2153-4bd2-8d25-ed67d8077f31 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:48.994837 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:49.180015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b3bfaa58-2153-4bd2-8d25-ed67d8077f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf6860a076b4a0c9f6724136c1c89e9', 'request_id': 'req-b3bfaa58-2153-4bd2-8d25-ed67d8077f31'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:49.200914 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b3bfaa58-2153-4bd2-8d25-ed67d8077f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf6860a076b4a0c9f6724136c1c89e9', 'request_id': 'req-b3bfaa58-2153-4bd2-8d25-ed67d8077f31'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:49.220323 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b3bfaa58-2153-4bd2-8d25-ed67d8077f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf6860a076b4a0c9f6724136c1c89e9', 'request_id': 'req-b3bfaa58-2153-4bd2-8d25-ed67d8077f31'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:49.318213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b3bfaa58-2153-4bd2-8d25-ed67d8077f31 admin admin] The token cache is being invalidate because project 3cf6860a076b4a0c9f6724136c1c89e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:28:49.318595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b3bfaa58-2153-4bd2-8d25-ed67d8077f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:49.319478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b3bfaa58-2153-4bd2-8d25-ed67d8077f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:49.321460 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1276/2581] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:28:48 2022] DELETE /identity/v3/projects/3cf6860a076b4a0c9f6724136c1c89e9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:49.330319 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336526ba-14e2-4a2c-a4ca-4c73b5e0d1a5 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:49.331412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336526ba-14e2-4a2c-a4ca-4c73b5e0d1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:49.331940 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336526ba-14e2-4a2c-a4ca-4c73b5e0d1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:49.368316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-336526ba-14e2-4a2c-a4ca-4c73b5e0d1a5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:49.370640 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-336526ba-14e2-4a2c-a4ca-4c73b5e0d1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:49.492634 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1306/2582] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:49.503596 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5ca27-ae3f-4ff7-9f99-a6aad90cb9c5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:49.503596 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5ca27-ae3f-4ff7-9f99-a6aad90cb9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:49.503596 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5ca27-ae3f-4ff7-9f99-a6aad90cb9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:49.526068 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-70f5ca27-ae3f-4ff7-9f99-a6aad90cb9c5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:49.527372 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-70f5ca27-ae3f-4ff7-9f99-a6aad90cb9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:49.539229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1277/2583] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:28:49.554736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336526ba-14e2-4a2c-a4ca-4c73b5e0d1a5 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:49.571207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336526ba-14e2-4a2c-a4ca-4c73b5e0d1a5 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:49.580349 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf8254-3dc1-4205-b86f-65843fd873ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:49.581431 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf8254-3dc1-4205-b86f-65843fd873ef admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:49.581952 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf8254-3dc1-4205-b86f-65843fd873ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:49.582489 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf8254-3dc1-4205-b86f-65843fd873ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:49.583814 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf8254-3dc1-4205-b86f-65843fd873ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:49.584370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf8254-3dc1-4205-b86f-65843fd873ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:49.588599 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf8254-3dc1-4205-b86f-65843fd873ef admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:49.589902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:49.613253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1307/2584] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:49.614499 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5ca27-ae3f-4ff7-9f99-a6aad90cb9c5 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:49.626680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5ca27-ae3f-4ff7-9f99-a6aad90cb9c5 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:49.631666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0904e-add8-4b3f-b3c1-065ae8c7ea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:49.632313 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0904e-add8-4b3f-b3c1-065ae8c7ea98 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:49.632664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0904e-add8-4b3f-b3c1-065ae8c7ea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:49.632945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0904e-add8-4b3f-b3c1-065ae8c7ea98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:49.633636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0904e-add8-4b3f-b3c1-065ae8c7ea98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:49.635654 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0904e-add8-4b3f-b3c1-065ae8c7ea98 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:49.774164 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1278/2585] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:28:49 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:49.782103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf8254-3dc1-4205-b86f-65843fd873ef admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:49.803507 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf8254-3dc1-4205-b86f-65843fd873ef admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:49.892430 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fd91a-4ca9-4bfa-97db-451655591afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:49.893080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fd91a-4ca9-4bfa-97db-451655591afc admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:49.893358 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fd91a-4ca9-4bfa-97db-451655591afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:49.893633 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fd91a-4ca9-4bfa-97db-451655591afc admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:49.894327 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fd91a-4ca9-4bfa-97db-451655591afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:49.896365 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fd91a-4ca9-4bfa-97db-451655591afc admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:50.018264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1308/2586] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:28:49 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:28:50.023689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0904e-add8-4b3f-b3c1-065ae8c7ea98 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:50.038001 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0904e-add8-4b3f-b3c1-065ae8c7ea98 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:50.043901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e65f30-514b-48f3-ac36-021b6cef7947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:50.044608 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e65f30-514b-48f3-ac36-021b6cef7947 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:50.044876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e65f30-514b-48f3-ac36-021b6cef7947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:50.045152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e65f30-514b-48f3-ac36-021b6cef7947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:50.049468 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e65f30-514b-48f3-ac36-021b6cef7947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:50.049468 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e65f30-514b-48f3-ac36-021b6cef7947 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:50.061292 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1279/2587] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:28:50.067817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fd91a-4ca9-4bfa-97db-451655591afc admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:50.081560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fd91a-4ca9-4bfa-97db-451655591afc admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:50.086596 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ad3c3-3932-46e4-852e-c34f5f593c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:50.087460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ad3c3-3932-46e4-852e-c34f5f593c2d admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:50.087604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ad3c3-3932-46e4-852e-c34f5f593c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:50.087837 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ad3c3-3932-46e4-852e-c34f5f593c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:50.088758 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ad3c3-3932-46e4-852e-c34f5f593c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:50.090450 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ad3c3-3932-46e4-852e-c34f5f593c2d admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:50.104722 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1309/2588] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:28:50.110897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e65f30-514b-48f3-ac36-021b6cef7947 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:50.128605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e65f30-514b-48f3-ac36-021b6cef7947 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:50.136856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec293d-4ebf-4e86-b9eb-a7f526f4443d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:50.138061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec293d-4ebf-4e86-b9eb-a7f526f4443d admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:50.138604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec293d-4ebf-4e86-b9eb-a7f526f4443d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:50.139153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec293d-4ebf-4e86-b9eb-a7f526f4443d admin admin] PATH_INFO: `/v3/projects/9394723987e340da9850f1c240d63cd9/users/8a1ef099457741018f9306c37b87699b/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:50.173659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec293d-4ebf-4e86-b9eb-a7f526f4443d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9394723987e340da9850f1c240d63cd9, user_id=8a1ef099457741018f9306c37b87699b, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:50.180146 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec293d-4ebf-4e86-b9eb-a7f526f4443d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:50.395002 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1280/2589] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:28:50 2022] PUT /identity/v3/projects/9394723987e340da9850f1c240d63cd9/users/8a1ef099457741018f9306c37b87699b/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:50.415115 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca2362-063c-44e4-a4dd-05954421c9f4 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:50.415996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca2362-063c-44e4-a4dd-05954421c9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:50.415996 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca2362-063c-44e4-a4dd-05954421c9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:50.454961 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-6bca2362-063c-44e4-a4dd-05954421c9f4 None None] MFA Rules not processed for user `8a1ef099457741018f9306c37b87699b`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:50.456387 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-6bca2362-063c-44e4-a4dd-05954421c9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:50.612623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1310/2590] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:28:50.620302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec293d-4ebf-4e86-b9eb-a7f526f4443d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:50.732366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec293d-4ebf-4e86-b9eb-a7f526f4443d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:50.743215 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb90e55-f5ee-43ec-a6a2-ad86e1cf3795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:50.744388 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb90e55-f5ee-43ec-a6a2-ad86e1cf3795 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:50.744907 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb90e55-f5ee-43ec-a6a2-ad86e1cf3795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:50.745960 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb90e55-f5ee-43ec-a6a2-ad86e1cf3795 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:50.746807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb90e55-f5ee-43ec-a6a2-ad86e1cf3795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:50.751292 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb90e55-f5ee-43ec-a6a2-ad86e1cf3795 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:50.916416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1281/2591] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:28:50 2022] POST /identity/v3/projects => generated 379 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:50.922543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca2362-063c-44e4-a4dd-05954421c9f4 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:50.944394 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca2362-063c-44e4-a4dd-05954421c9f4 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:51.021670 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ceb74-a665-4785-a0d6-42a80c0eac81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:51.022314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ceb74-a665-4785-a0d6-42a80c0eac81 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:51.022648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ceb74-a665-4785-a0d6-42a80c0eac81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:51.022929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ceb74-a665-4785-a0d6-42a80c0eac81 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:51.023604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ceb74-a665-4785-a0d6-42a80c0eac81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:51.025652 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ceb74-a665-4785-a0d6-42a80c0eac81 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:51.036374 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:51.204180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1311/2592] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:28:50 2022] POST /identity/v3/users => generated 296 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:51.208181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb90e55-f5ee-43ec-a6a2-ad86e1cf3795 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:51.221612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb90e55-f5ee-43ec-a6a2-ad86e1cf3795 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:51.228512 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafcf2f-c19c-4350-8ed8-ba1115a62678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:51.229711 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafcf2f-c19c-4350-8ed8-ba1115a62678 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:51.230241 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafcf2f-c19c-4350-8ed8-ba1115a62678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:51.230724 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafcf2f-c19c-4350-8ed8-ba1115a62678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:51.231464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafcf2f-c19c-4350-8ed8-ba1115a62678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:51.233905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafcf2f-c19c-4350-8ed8-ba1115a62678 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:51.250582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1282/2593] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:28:51.259663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ceb74-a665-4785-a0d6-42a80c0eac81 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:51.270740 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ceb74-a665-4785-a0d6-42a80c0eac81 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:51.275728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f79b10-3004-4f21-a74e-d3725778b552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:51.276284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f79b10-3004-4f21-a74e-d3725778b552 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:51.276587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f79b10-3004-4f21-a74e-d3725778b552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:51.276842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f79b10-3004-4f21-a74e-d3725778b552 admin admin] PATH_INFO: `/v3/projects/d6a4a8d714ff4ed09037e53c6b028f95/users/45e69640f4424cfbb7139810a5a63574/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:51.294892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f79b10-3004-4f21-a74e-d3725778b552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a4a8d714ff4ed09037e53c6b028f95, user_id=45e69640f4424cfbb7139810a5a63574, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:51.298537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f79b10-3004-4f21-a74e-d3725778b552 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:51.548844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1312/2594] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:28:51 2022] PUT /identity/v3/projects/d6a4a8d714ff4ed09037e53c6b028f95/users/45e69640f4424cfbb7139810a5a63574/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:51.555282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafcf2f-c19c-4350-8ed8-ba1115a62678 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:51.565180 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:51.572900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafcf2f-c19c-4350-8ed8-ba1115a62678 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:51.683036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c4a02-f9a2-4334-a5b3-9b839661d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:51.686502 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c4a02-f9a2-4334-a5b3-9b839661d66d admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:51.687039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c4a02-f9a2-4334-a5b3-9b839661d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:51.687542 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c4a02-f9a2-4334-a5b3-9b839661d66d admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:51.690558 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c4a02-f9a2-4334-a5b3-9b839661d66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:51.696091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c4a02-f9a2-4334-a5b3-9b839661d66d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:51.722680 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1283/2595] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:28:51.724329 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f79b10-3004-4f21-a74e-d3725778b552 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:51.743909 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f79b10-3004-4f21-a74e-d3725778b552 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:51.756543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1149b-b334-4143-81f9-35139f5b66b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:51.758686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1149b-b334-4143-81f9-35139f5b66b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:51.758686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1149b-b334-4143-81f9-35139f5b66b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:51.758686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1149b-b334-4143-81f9-35139f5b66b5 admin admin] PATH_INFO: `/v3/projects/d6a4a8d714ff4ed09037e53c6b028f95/users/45e69640f4424cfbb7139810a5a63574/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:51.761052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1149b-b334-4143-81f9-35139f5b66b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a4a8d714ff4ed09037e53c6b028f95, user_id=45e69640f4424cfbb7139810a5a63574, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:51.764582 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1149b-b334-4143-81f9-35139f5b66b5 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:51.811799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1313/2596] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:28:51 2022] PUT /identity/v3/projects/d6a4a8d714ff4ed09037e53c6b028f95/users/45e69640f4424cfbb7139810a5a63574/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:51.814106 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0930c7-69d4-4e8a-9b33-b2e137f0fcc7 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:51.814427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0930c7-69d4-4e8a-9b33-b2e137f0fcc7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:51.814712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0930c7-69d4-4e8a-9b33-b2e137f0fcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:51.868025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cb0930c7-69d4-4e8a-9b33-b2e137f0fcc7 None None] MFA Rules not processed for user `45e69640f4424cfbb7139810a5a63574`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:51.870025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cb0930c7-69d4-4e8a-9b33-b2e137f0fcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:51.983380 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1284/2597] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:52.002399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1149b-b334-4143-81f9-35139f5b66b5 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:52.006343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c8c1149b-b334-4143-81f9-35139f5b66b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:52.100888 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1149b-b334-4143-81f9-35139f5b66b5 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:52.106689 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea53c2-4035-417f-8cb2-668513bb3be9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:52.115363 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea53c2-4035-417f-8cb2-668513bb3be9 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:52.115363 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea53c2-4035-417f-8cb2-668513bb3be9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:52.115363 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea53c2-4035-417f-8cb2-668513bb3be9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:52.120844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea53c2-4035-417f-8cb2-668513bb3be9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:52.122324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea53c2-4035-417f-8cb2-668513bb3be9 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:52.136508 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1314/2598] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:53.188889 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0930c7-69d4-4e8a-9b33-b2e137f0fcc7 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:53.280612 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0930c7-69d4-4e8a-9b33-b2e137f0fcc7 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:53.287082 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2913bc-1c5a-4afa-940a-da71f787a5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:53.287990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2913bc-1c5a-4afa-940a-da71f787a5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:53.288282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2913bc-1c5a-4afa-940a-da71f787a5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:53.288582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2913bc-1c5a-4afa-940a-da71f787a5c5 admin admin] PATH_INFO: `/v3/users/8a1ef099457741018f9306c37b87699b` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:53.290482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2913bc-1c5a-4afa-940a-da71f787a5c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a1ef099457741018f9306c37b87699b)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:53.293168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2913bc-1c5a-4afa-940a-da71f787a5c5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:53.457877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:53.681154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6d2913bc-1c5a-4afa-940a-da71f787a5c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a1ef099457741018f9306c37b87699b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:53.683482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6d2913bc-1c5a-4afa-940a-da71f787a5c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a1ef099457741018f9306c37b87699b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:53.707830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6d2913bc-1c5a-4afa-940a-da71f787a5c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a1ef099457741018f9306c37b87699b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:53.709018 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6d2913bc-1c5a-4afa-940a-da71f787a5c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a1ef099457741018f9306c37b87699b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:53.850875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6d2913bc-1c5a-4afa-940a-da71f787a5c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a1ef099457741018f9306c37b87699b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:53.877485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1285/2599] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:28:53 2022] DELETE /identity/v3/users/8a1ef099457741018f9306c37b87699b => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:53.885406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67164ac2-2b75-483f-a430-5c6d50d63099 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:53.887192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67164ac2-2b75-483f-a430-5c6d50d63099 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:53.887898 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67164ac2-2b75-483f-a430-5c6d50d63099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:53.960136 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-67164ac2-2b75-483f-a430-5c6d50d63099 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:53.961868 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-67164ac2-2b75-483f-a430-5c6d50d63099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:54.052504 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1315/2600] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:54.070318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2913bc-1c5a-4afa-940a-da71f787a5c5 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:54.071998 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6d2913bc-1c5a-4afa-940a-da71f787a5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:54.205170 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2913bc-1c5a-4afa-940a-da71f787a5c5 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:54.220151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66ef9a-992e-479a-9e55-c1ae2f938853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:54.221198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66ef9a-992e-479a-9e55-c1ae2f938853 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:54.221666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66ef9a-992e-479a-9e55-c1ae2f938853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:54.222123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66ef9a-992e-479a-9e55-c1ae2f938853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:54.250926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66ef9a-992e-479a-9e55-c1ae2f938853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:54.253670 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66ef9a-992e-479a-9e55-c1ae2f938853 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:54.282387 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1286/2601] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:28:55.243595 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67164ac2-2b75-483f-a430-5c6d50d63099 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:55.245954 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-67164ac2-2b75-483f-a430-5c6d50d63099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:55.269705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67164ac2-2b75-483f-a430-5c6d50d63099 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:55.282177 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c0a37-544b-41d5-ab52-b599309ac731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:55.282177 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c0a37-544b-41d5-ab52-b599309ac731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:55.282710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c0a37-544b-41d5-ab52-b599309ac731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:55.283053 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c0a37-544b-41d5-ab52-b599309ac731 admin admin] PATH_INFO: `/v3/projects/9394723987e340da9850f1c240d63cd9` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:55.284543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c0a37-544b-41d5-ab52-b599309ac731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9394723987e340da9850f1c240d63cd9)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:55.286604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c0a37-544b-41d5-ab52-b599309ac731 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:55.383373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66ef9a-992e-479a-9e55-c1ae2f938853 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:55.385646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5d66ef9a-992e-479a-9e55-c1ae2f938853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:55.400641 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66ef9a-992e-479a-9e55-c1ae2f938853 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:55.405638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b69ba-03ef-4731-819b-4b798eec62b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:55.406307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b69ba-03ef-4731-819b-4b798eec62b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:55.406654 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b69ba-03ef-4731-819b-4b798eec62b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:55.406939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b69ba-03ef-4731-819b-4b798eec62b7 admin admin] PATH_INFO: `/v3/users/350bc4821c16408298bb19bbb7fcd505` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:55.408191 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b69ba-03ef-4731-819b-4b798eec62b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=350bc4821c16408298bb19bbb7fcd505)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:55.410156 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b69ba-03ef-4731-819b-4b798eec62b7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:55.454762 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-422c0a37-544b-41d5-ab52-b599309ac731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9394723987e340da9850f1c240d63cd9', 'request_id': 'req-422c0a37-544b-41d5-ab52-b599309ac731'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:55.457956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:55.650702 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-422c0a37-544b-41d5-ab52-b599309ac731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9394723987e340da9850f1c240d63cd9', 'request_id': 'req-422c0a37-544b-41d5-ab52-b599309ac731'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:55.659149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-422c0a37-544b-41d5-ab52-b599309ac731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9394723987e340da9850f1c240d63cd9', 'request_id': 'req-422c0a37-544b-41d5-ab52-b599309ac731'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:55.671648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-422c0a37-544b-41d5-ab52-b599309ac731 admin admin] The token cache is being invalidate because project 9394723987e340da9850f1c240d63cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:28:55.671947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-422c0a37-544b-41d5-ab52-b599309ac731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:55.672660 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-422c0a37-544b-41d5-ab52-b599309ac731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:55.674323 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1316/2602] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:28:55 2022] DELETE /identity/v3/projects/9394723987e340da9850f1c240d63cd9 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:55.678460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c0a37-544b-41d5-ab52-b599309ac731 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:55.679862 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-422c0a37-544b-41d5-ab52-b599309ac731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:55.768047 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c0a37-544b-41d5-ab52-b599309ac731 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:55.773085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2af17d-8c22-4db2-9a15-86605e98abe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:55.774017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2af17d-8c22-4db2-9a15-86605e98abe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:55.774448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2af17d-8c22-4db2-9a15-86605e98abe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:55.774740 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2af17d-8c22-4db2-9a15-86605e98abe6 admin admin] PATH_INFO: `/v3/users/45e69640f4424cfbb7139810a5a63574` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:55.775999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2af17d-8c22-4db2-9a15-86605e98abe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e69640f4424cfbb7139810a5a63574)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:55.777945 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2af17d-8c22-4db2-9a15-86605e98abe6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:55.836452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9c6b69ba-03ef-4731-819b-4b798eec62b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350bc4821c16408298bb19bbb7fcd505'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:55.837201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9c6b69ba-03ef-4731-819b-4b798eec62b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350bc4821c16408298bb19bbb7fcd505'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:55.851217 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9c6b69ba-03ef-4731-819b-4b798eec62b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350bc4821c16408298bb19bbb7fcd505'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:55.851962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9c6b69ba-03ef-4731-819b-4b798eec62b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350bc4821c16408298bb19bbb7fcd505'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:56.028586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9c6b69ba-03ef-4731-819b-4b798eec62b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350bc4821c16408298bb19bbb7fcd505'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:56.043142 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1287/2603] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:28:55 2022] DELETE /identity/v3/users/350bc4821c16408298bb19bbb7fcd505 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:28:56.152340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-af2af17d-8c22-4db2-9a15-86605e98abe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e69640f4424cfbb7139810a5a63574'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:56.153632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-af2af17d-8c22-4db2-9a15-86605e98abe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e69640f4424cfbb7139810a5a63574'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:56.173192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-af2af17d-8c22-4db2-9a15-86605e98abe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e69640f4424cfbb7139810a5a63574'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:56.296542 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-af2af17d-8c22-4db2-9a15-86605e98abe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e69640f4424cfbb7139810a5a63574'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:56.297630 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-af2af17d-8c22-4db2-9a15-86605e98abe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e69640f4424cfbb7139810a5a63574'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:56.312507 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1317/2604] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:28:55 2022] DELETE /identity/v3/users/45e69640f4424cfbb7139810a5a63574 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:28:56.384798 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b69ba-03ef-4731-819b-4b798eec62b7 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:56.386907 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9c6b69ba-03ef-4731-819b-4b798eec62b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:56.417364 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:56.471582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b69ba-03ef-4731-819b-4b798eec62b7 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:56.533095 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584bf7e-dc66-4e02-bf9a-31f9a3133374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:56.533760 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584bf7e-dc66-4e02-bf9a-31f9a3133374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:56.534042 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584bf7e-dc66-4e02-bf9a-31f9a3133374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:56.534327 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584bf7e-dc66-4e02-bf9a-31f9a3133374 admin admin] PATH_INFO: `/v3/projects/85ea31dae6fe4fe4bb0c6ba9062fbe84` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:56.535636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584bf7e-dc66-4e02-bf9a-31f9a3133374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ea31dae6fe4fe4bb0c6ba9062fbe84)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:56.537596 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584bf7e-dc66-4e02-bf9a-31f9a3133374 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:56.774035 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b584bf7e-dc66-4e02-bf9a-31f9a3133374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ea31dae6fe4fe4bb0c6ba9062fbe84', 'request_id': 'req-b584bf7e-dc66-4e02-bf9a-31f9a3133374'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:56.783443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b584bf7e-dc66-4e02-bf9a-31f9a3133374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ea31dae6fe4fe4bb0c6ba9062fbe84', 'request_id': 'req-b584bf7e-dc66-4e02-bf9a-31f9a3133374'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:56.791091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b584bf7e-dc66-4e02-bf9a-31f9a3133374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ea31dae6fe4fe4bb0c6ba9062fbe84', 'request_id': 'req-b584bf7e-dc66-4e02-bf9a-31f9a3133374'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:56.987009 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b584bf7e-dc66-4e02-bf9a-31f9a3133374 admin admin] The token cache is being invalidate because project 85ea31dae6fe4fe4bb0c6ba9062fbe84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:28:56.987527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b584bf7e-dc66-4e02-bf9a-31f9a3133374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:56.989049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b584bf7e-dc66-4e02-bf9a-31f9a3133374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:56.991840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1288/2605] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:28:56 2022] DELETE /identity/v3/projects/85ea31dae6fe4fe4bb0c6ba9062fbe84 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:56.997315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2af17d-8c22-4db2-9a15-86605e98abe6 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:56.999477 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-af2af17d-8c22-4db2-9a15-86605e98abe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:57.015304 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2af17d-8c22-4db2-9a15-86605e98abe6 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:57.033226 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584bf7e-dc66-4e02-bf9a-31f9a3133374 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:57.035208 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b584bf7e-dc66-4e02-bf9a-31f9a3133374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:57.119726 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f7e36-e9ef-40ca-8871-8ba83dbf4c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:57.120621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f7e36-e9ef-40ca-8871-8ba83dbf4c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:57.120915 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f7e36-e9ef-40ca-8871-8ba83dbf4c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:57.121297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f7e36-e9ef-40ca-8871-8ba83dbf4c7e admin admin] PATH_INFO: `/v3/users/65a3e7a42b1b4074b916f8f9ea7bf7c6` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:57.125532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f7e36-e9ef-40ca-8871-8ba83dbf4c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a3e7a42b1b4074b916f8f9ea7bf7c6)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:57.127688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f7e36-e9ef-40ca-8871-8ba83dbf4c7e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:57.147524 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584bf7e-dc66-4e02-bf9a-31f9a3133374 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:57.152713 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eb62b-d0f8-4083-bdb2-0428b45e7571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:57.153395 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb62b-d0f8-4083-bdb2-0428b45e7571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:57.153678 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb62b-d0f8-4083-bdb2-0428b45e7571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:57.153959 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb62b-d0f8-4083-bdb2-0428b45e7571 admin admin] PATH_INFO: `/v3/projects/d6a4a8d714ff4ed09037e53c6b028f95` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:57.155865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eb62b-d0f8-4083-bdb2-0428b45e7571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a4a8d714ff4ed09037e53c6b028f95)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:57.158191 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eb62b-d0f8-4083-bdb2-0428b45e7571 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:57.434274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-391f7e36-e9ef-40ca-8871-8ba83dbf4c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a3e7a42b1b4074b916f8f9ea7bf7c6'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:57.435136 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-391f7e36-e9ef-40ca-8871-8ba83dbf4c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a3e7a42b1b4074b916f8f9ea7bf7c6'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:57.437470 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-026eb62b-d0f8-4083-bdb2-0428b45e7571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a4a8d714ff4ed09037e53c6b028f95', 'request_id': 'req-026eb62b-d0f8-4083-bdb2-0428b45e7571'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:57.444485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-026eb62b-d0f8-4083-bdb2-0428b45e7571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a4a8d714ff4ed09037e53c6b028f95', 'request_id': 'req-026eb62b-d0f8-4083-bdb2-0428b45e7571'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:57.449941 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-391f7e36-e9ef-40ca-8871-8ba83dbf4c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a3e7a42b1b4074b916f8f9ea7bf7c6'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:57.451835 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-026eb62b-d0f8-4083-bdb2-0428b45e7571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a4a8d714ff4ed09037e53c6b028f95', 'request_id': 'req-026eb62b-d0f8-4083-bdb2-0428b45e7571'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:57.576482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-391f7e36-e9ef-40ca-8871-8ba83dbf4c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a3e7a42b1b4074b916f8f9ea7bf7c6'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:57.577990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-391f7e36-e9ef-40ca-8871-8ba83dbf4c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a3e7a42b1b4074b916f8f9ea7bf7c6'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:57.595250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1318/2606] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:28:56 2022] DELETE /identity/v3/users/65a3e7a42b1b4074b916f8f9ea7bf7c6 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:28:57.713845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-026eb62b-d0f8-4083-bdb2-0428b45e7571 admin admin] The token cache is being invalidate because project d6a4a8d714ff4ed09037e53c6b028f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:28:57.723692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-026eb62b-d0f8-4083-bdb2-0428b45e7571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:57.723692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-026eb62b-d0f8-4083-bdb2-0428b45e7571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:57.723692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1289/2607] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:28:57 2022] DELETE /identity/v3/projects/d6a4a8d714ff4ed09037e53c6b028f95 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:57.725444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbaed2-b2c6-4e69-84ef-3956fef30d6f None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:57.725736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbaed2-b2c6-4e69-84ef-3956fef30d6f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:57.726017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbaed2-b2c6-4e69-84ef-3956fef30d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:57.759528 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-e6dbaed2-b2c6-4e69-84ef-3956fef30d6f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:57.761300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e6dbaed2-b2c6-4e69-84ef-3956fef30d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:57.865858 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1319/2608] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:57.876090 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876466f-c193-4182-a930-16cb9d96f7f5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:57.876594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876466f-c193-4182-a930-16cb9d96f7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:57.877145 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876466f-c193-4182-a930-16cb9d96f7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:57.912816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7876466f-c193-4182-a930-16cb9d96f7f5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:57.914100 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7876466f-c193-4182-a930-16cb9d96f7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:57.922894 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1290/2609] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:28:57.927395 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbaed2-b2c6-4e69-84ef-3956fef30d6f None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:57.933724 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876466f-c193-4182-a930-16cb9d96f7f5 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:57.935986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7876466f-c193-4182-a930-16cb9d96f7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:57.937862 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbaed2-b2c6-4e69-84ef-3956fef30d6f None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:57.951661 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c332cd-d6c9-4460-8730-4975519269a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:57.953841 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c332cd-d6c9-4460-8730-4975519269a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:57.954352 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c332cd-d6c9-4460-8730-4975519269a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:57.954895 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c332cd-d6c9-4460-8730-4975519269a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:57.956278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c332cd-d6c9-4460-8730-4975519269a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:57.956851 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c332cd-d6c9-4460-8730-4975519269a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:57.960129 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c332cd-d6c9-4460-8730-4975519269a1 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:57.961182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876466f-c193-4182-a930-16cb9d96f7f5 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:57.971279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa148d45-4064-4ab8-bffa-4d8868c6c0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:57.972408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa148d45-4064-4ab8-bffa-4d8868c6c0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:57.972888 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa148d45-4064-4ab8-bffa-4d8868c6c0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:57.973286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa148d45-4064-4ab8-bffa-4d8868c6c0df admin admin] PATH_INFO: `/v3/projects/ce05182a4a5d41629b3b73098f808eb1` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:57.975166 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa148d45-4064-4ab8-bffa-4d8868c6c0df admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce05182a4a5d41629b3b73098f808eb1)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:57.977799 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa148d45-4064-4ab8-bffa-4d8868c6c0df admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:57.984517 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1320/2610] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:57.990166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c332cd-d6c9-4460-8730-4975519269a1 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:58.005056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c332cd-d6c9-4460-8730-4975519269a1 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:58.009894 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50b06c-0240-4358-a5e1-1516b1a3037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:58.010592 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50b06c-0240-4358-a5e1-1516b1a3037f admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:58.010903 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50b06c-0240-4358-a5e1-1516b1a3037f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:58.011153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50b06c-0240-4358-a5e1-1516b1a3037f admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:58.014614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50b06c-0240-4358-a5e1-1516b1a3037f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:58.014614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50b06c-0240-4358-a5e1-1516b1a3037f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:58.182743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa148d45-4064-4ab8-bffa-4d8868c6c0df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce05182a4a5d41629b3b73098f808eb1', 'request_id': 'req-aa148d45-4064-4ab8-bffa-4d8868c6c0df'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:58.190601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa148d45-4064-4ab8-bffa-4d8868c6c0df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce05182a4a5d41629b3b73098f808eb1', 'request_id': 'req-aa148d45-4064-4ab8-bffa-4d8868c6c0df'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:58.198626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa148d45-4064-4ab8-bffa-4d8868c6c0df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce05182a4a5d41629b3b73098f808eb1', 'request_id': 'req-aa148d45-4064-4ab8-bffa-4d8868c6c0df'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:58.253158 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1321/2611] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:28:57 2022] POST /identity/v3/projects => generated 383 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:58.254632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50b06c-0240-4358-a5e1-1516b1a3037f admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:58.337577 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa148d45-4064-4ab8-bffa-4d8868c6c0df admin admin] The token cache is being invalidate because project ce05182a4a5d41629b3b73098f808eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:28:58.337934 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa148d45-4064-4ab8-bffa-4d8868c6c0df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:58.338847 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa148d45-4064-4ab8-bffa-4d8868c6c0df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:28:58.341003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1291/2612] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:28:57 2022] DELETE /identity/v3/projects/ce05182a4a5d41629b3b73098f808eb1 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:58.350741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50b06c-0240-4358-a5e1-1516b1a3037f admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:58.355062 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e398460-4f66-4316-a7c5-e17882263f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:58.356749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e398460-4f66-4316-a7c5-e17882263f9b admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:58.356749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e398460-4f66-4316-a7c5-e17882263f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:58.356749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e398460-4f66-4316-a7c5-e17882263f9b admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:58.359110 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e398460-4f66-4316-a7c5-e17882263f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:58.363183 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e398460-4f66-4316-a7c5-e17882263f9b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:58.534005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1322/2613] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:28:58 2022] POST /identity/v3/users => generated 292 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:28:58.540840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa148d45-4064-4ab8-bffa-4d8868c6c0df admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:58.543884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-aa148d45-4064-4ab8-bffa-4d8868c6c0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:58.653927 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa148d45-4064-4ab8-bffa-4d8868c6c0df admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:58.662553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbd10f-7ab4-46ad-9490-d8d5f9b9a4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:58.663218 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbd10f-7ab4-46ad-9490-d8d5f9b9a4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:58.663512 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbd10f-7ab4-46ad-9490-d8d5f9b9a4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:58.663789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbd10f-7ab4-46ad-9490-d8d5f9b9a4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:58.664525 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbd10f-7ab4-46ad-9490-d8d5f9b9a4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:58.666275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbd10f-7ab4-46ad-9490-d8d5f9b9a4b5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:58.684497 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1292/2614] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:28:58.686579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e398460-4f66-4316-a7c5-e17882263f9b admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:58.704031 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e398460-4f66-4316-a7c5-e17882263f9b admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:58.710561 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275b5cc-3231-4d01-843a-561ce6a0d08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:58.711345 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275b5cc-3231-4d01-843a-561ce6a0d08d admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:58.711828 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275b5cc-3231-4d01-843a-561ce6a0d08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:58.712208 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275b5cc-3231-4d01-843a-561ce6a0d08d admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:58.713227 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275b5cc-3231-4d01-843a-561ce6a0d08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:58.715085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275b5cc-3231-4d01-843a-561ce6a0d08d admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:58.728244 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1323/2615] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:28:58.734054 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbd10f-7ab4-46ad-9490-d8d5f9b9a4b5 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:58.744864 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbd10f-7ab4-46ad-9490-d8d5f9b9a4b5 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:58.751405 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0670-97d8-443a-a0a1-1afdd6dd823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:58.752116 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0670-97d8-443a-a0a1-1afdd6dd823f admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:58.752408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0670-97d8-443a-a0a1-1afdd6dd823f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:58.752702 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0670-97d8-443a-a0a1-1afdd6dd823f admin admin] PATH_INFO: `/v3/projects/dfbb2979026b44c98e061f3733a70cfd/users/5a62da4273794f4794fa46a2b2478f30/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:58.770742 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e0670-97d8-443a-a0a1-1afdd6dd823f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfbb2979026b44c98e061f3733a70cfd, user_id=5a62da4273794f4794fa46a2b2478f30, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:58.773750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e0670-97d8-443a-a0a1-1afdd6dd823f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:58.965126 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1293/2616] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:28:58 2022] PUT /identity/v3/projects/dfbb2979026b44c98e061f3733a70cfd/users/5a62da4273794f4794fa46a2b2478f30/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:58.976698 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b102f6-3fda-4851-afb6-67da8c6594f2 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:58.977021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b102f6-3fda-4851-afb6-67da8c6594f2 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:58.977330 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b102f6-3fda-4851-afb6-67da8c6594f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:59.012870 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-00b102f6-3fda-4851-afb6-67da8c6594f2 None None] MFA Rules not processed for user `5a62da4273794f4794fa46a2b2478f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:59.015239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-00b102f6-3fda-4851-afb6-67da8c6594f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:59.093101 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1324/2617] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:28:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:59.098104 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0670-97d8-443a-a0a1-1afdd6dd823f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:59.174396 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0670-97d8-443a-a0a1-1afdd6dd823f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:59.179341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dddca-a8ed-44bc-a62b-3bfdc85fc5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:59.180026 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dddca-a8ed-44bc-a62b-3bfdc85fc5fa admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:59.180344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dddca-a8ed-44bc-a62b-3bfdc85fc5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:59.180624 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dddca-a8ed-44bc-a62b-3bfdc85fc5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:59.181482 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dddca-a8ed-44bc-a62b-3bfdc85fc5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:59.183496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dddca-a8ed-44bc-a62b-3bfdc85fc5fa admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:59.288511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1294/2618] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:28:59 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:59.293788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b102f6-3fda-4851-afb6-67da8c6594f2 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:59.306926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b102f6-3fda-4851-afb6-67da8c6594f2 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:59.378090 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac9295-b6fd-47fb-a6e0-ad13317d8ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:59.378844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac9295-b6fd-47fb-a6e0-ad13317d8ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:59.379225 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac9295-b6fd-47fb-a6e0-ad13317d8ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:59.379671 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac9295-b6fd-47fb-a6e0-ad13317d8ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:59.380783 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac9295-b6fd-47fb-a6e0-ad13317d8ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:59.383478 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac9295-b6fd-47fb-a6e0-ad13317d8ca2 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:59.454382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:59.606056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1325/2619] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:28:59 2022] POST /identity/v3/users => generated 299 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:59.611656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dddca-a8ed-44bc-a62b-3bfdc85fc5fa admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:59.622530 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dddca-a8ed-44bc-a62b-3bfdc85fc5fa admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:59.627644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826807a-d736-49f3-be1f-2f054ffb83a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:59.628279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826807a-d736-49f3-be1f-2f054ffb83a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:59.628565 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826807a-d736-49f3-be1f-2f054ffb83a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:59.628842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826807a-d736-49f3-be1f-2f054ffb83a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:59.629562 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826807a-d736-49f3-be1f-2f054ffb83a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:59.631233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826807a-d736-49f3-be1f-2f054ffb83a0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:59.644842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1295/2620] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:28:59.652021 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac9295-b6fd-47fb-a6e0-ad13317d8ca2 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:59.663269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac9295-b6fd-47fb-a6e0-ad13317d8ca2 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:59.668139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f5bec-3aec-4fe9-88c1-9005ab8b247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:59.668857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f5bec-3aec-4fe9-88c1-9005ab8b247f admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:59.669142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f5bec-3aec-4fe9-88c1-9005ab8b247f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:59.669423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f5bec-3aec-4fe9-88c1-9005ab8b247f admin admin] PATH_INFO: `/v3/projects/b7646e0cd7d2463ab3404eb9ba008c6e/users/cfa54dbe18494c8fb68b9eb75f367f64/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:59.688892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f5bec-3aec-4fe9-88c1-9005ab8b247f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7646e0cd7d2463ab3404eb9ba008c6e, user_id=cfa54dbe18494c8fb68b9eb75f367f64, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:59.692059 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f5bec-3aec-4fe9-88c1-9005ab8b247f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:59.829621 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1326/2621] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:28:59 2022] PUT /identity/v3/projects/b7646e0cd7d2463ab3404eb9ba008c6e/users/cfa54dbe18494c8fb68b9eb75f367f64/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:59.833272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:59.834568 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826807a-d736-49f3-be1f-2f054ffb83a0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:59.846950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826807a-d736-49f3-be1f-2f054ffb83a0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:59.921710 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2c906-2176-4be0-82c9-8996a0496f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:59.922410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2c906-2176-4be0-82c9-8996a0496f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:59.922704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2c906-2176-4be0-82c9-8996a0496f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:59.922977 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2c906-2176-4be0-82c9-8996a0496f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:59.923724 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2c906-2176-4be0-82c9-8996a0496f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:59.929449 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2c906-2176-4be0-82c9-8996a0496f1a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:59.937579 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1296/2622] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:28:59.942120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f5bec-3aec-4fe9-88c1-9005ab8b247f admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:59.958628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f5bec-3aec-4fe9-88c1-9005ab8b247f admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:59.970583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12bdb4-7a2b-4793-888c-649bca3b852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:59.972087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12bdb4-7a2b-4793-888c-649bca3b852c admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:59.972826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12bdb4-7a2b-4793-888c-649bca3b852c admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:59.973860 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12bdb4-7a2b-4793-888c-649bca3b852c admin admin] PATH_INFO: `/v3/projects/b7646e0cd7d2463ab3404eb9ba008c6e/users/cfa54dbe18494c8fb68b9eb75f367f64/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:59.978853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12bdb4-7a2b-4793-888c-649bca3b852c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7646e0cd7d2463ab3404eb9ba008c6e, user_id=cfa54dbe18494c8fb68b9eb75f367f64, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:59.986132 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12bdb4-7a2b-4793-888c-649bca3b852c admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:00.003257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1327/2623] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:28:59 2022] PUT /identity/v3/projects/b7646e0cd7d2463ab3404eb9ba008c6e/users/cfa54dbe18494c8fb68b9eb75f367f64/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:29:00.015433 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052bfa3-51b2-4298-adef-e174f42058e2 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:00.015845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052bfa3-51b2-4298-adef-e174f42058e2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:00.016321 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052bfa3-51b2-4298-adef-e174f42058e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:00.050129 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-4052bfa3-51b2-4298-adef-e174f42058e2 None None] MFA Rules not processed for user `cfa54dbe18494c8fb68b9eb75f367f64`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:00.051465 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4052bfa3-51b2-4298-adef-e174f42058e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:00.141394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1297/2624] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:29:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:00.159211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12bdb4-7a2b-4793-888c-649bca3b852c admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:00.161304 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7f12bdb4-7a2b-4793-888c-649bca3b852c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:00.236015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12bdb4-7a2b-4793-888c-649bca3b852c admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:00.241066 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27646a-6efd-47a4-a7cb-c6107b0d301d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:00.241843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27646a-6efd-47a4-a7cb-c6107b0d301d service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:00.242234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27646a-6efd-47a4-a7cb-c6107b0d301d service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:00.242690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27646a-6efd-47a4-a7cb-c6107b0d301d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:00.311294 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27646a-6efd-47a4-a7cb-c6107b0d301d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:00.312982 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27646a-6efd-47a4-a7cb-c6107b0d301d service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:00.323416 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1328/2625] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:29:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:29:01.126238 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:01.238992 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:02.207163 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:02.932432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:05.180210 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf5ce6-2a86-4c0f-8e86-bd8666921b17 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:05.181198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf5ce6-2a86-4c0f-8e86-bd8666921b17 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:05.181198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf5ce6-2a86-4c0f-8e86-bd8666921b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:05.205075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-eaaf5ce6-2a86-4c0f-8e86-bd8666921b17 None None] MFA Rules not processed for user `4a76e3126b83448691e5d3c56c6c3f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:05.206983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-eaaf5ce6-2a86-4c0f-8e86-bd8666921b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:05.288567 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1298/2626] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:29:10.445889 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27646a-6efd-47a4-a7cb-c6107b0d301d service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:10.461523 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27646a-6efd-47a4-a7cb-c6107b0d301d service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:10.469219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8fc46-cd10-4627-9760-b8876d1b3729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:10.470253 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8fc46-cd10-4627-9760-b8876d1b3729 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:10.470817 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8fc46-cd10-4627-9760-b8876d1b3729 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:10.471303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8fc46-cd10-4627-9760-b8876d1b3729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:10.490129 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8fc46-cd10-4627-9760-b8876d1b3729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:10.493260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8fc46-cd10-4627-9760-b8876d1b3729 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:10.512613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1329/2627] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:29:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:29:15.280808 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=39 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:19.317279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf5ce6-2a86-4c0f-8e86-bd8666921b17 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:19.442604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf5ce6-2a86-4c0f-8e86-bd8666921b17 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:19.449862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21698947-1880-422f-b4ef-b0495351271b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:19.451380 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698947-1880-422f-b4ef-b0495351271b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:19.451778 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698947-1880-422f-b4ef-b0495351271b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:19.452129 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698947-1880-422f-b4ef-b0495351271b admin admin] PATH_INFO: `/v3/users/5a62da4273794f4794fa46a2b2478f30` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:19.453623 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21698947-1880-422f-b4ef-b0495351271b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a62da4273794f4794fa46a2b2478f30)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:19.455821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21698947-1880-422f-b4ef-b0495351271b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:19.692301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21698947-1880-422f-b4ef-b0495351271b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a62da4273794f4794fa46a2b2478f30'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:19.693219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21698947-1880-422f-b4ef-b0495351271b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a62da4273794f4794fa46a2b2478f30'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:19.708442 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21698947-1880-422f-b4ef-b0495351271b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a62da4273794f4794fa46a2b2478f30'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:19.709232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21698947-1880-422f-b4ef-b0495351271b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a62da4273794f4794fa46a2b2478f30'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:19.810607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-21698947-1880-422f-b4ef-b0495351271b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a62da4273794f4794fa46a2b2478f30'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:19.826722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1299/2628] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:29:19 2022] DELETE /identity/v3/users/5a62da4273794f4794fa46a2b2478f30 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:29:19.831696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abed537-79b1-4e3f-9822-0ba7ce7b8cc1 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:19.832236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abed537-79b1-4e3f-9822-0ba7ce7b8cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:19.832451 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abed537-79b1-4e3f-9822-0ba7ce7b8cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:19.853741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-0abed537-79b1-4e3f-9822-0ba7ce7b8cc1 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:19.855132 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0abed537-79b1-4e3f-9822-0ba7ce7b8cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:19.947019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1330/2629] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:19.958502 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21698947-1880-422f-b4ef-b0495351271b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:19.960066 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-21698947-1880-422f-b4ef-b0495351271b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:20.041495 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21698947-1880-422f-b4ef-b0495351271b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:20.047544 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad6e98-d168-4c70-95f3-e294e2567b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:20.048424 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad6e98-d168-4c70-95f3-e294e2567b6a service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:20.048721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad6e98-d168-4c70-95f3-e294e2567b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:20.049003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad6e98-d168-4c70-95f3-e294e2567b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:20.062294 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad6e98-d168-4c70-95f3-e294e2567b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:20.063890 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad6e98-d168-4c70-95f3-e294e2567b6a service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:20.078102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1300/2630] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:29:20.658990 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abed537-79b1-4e3f-9822-0ba7ce7b8cc1 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:20.661416 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0abed537-79b1-4e3f-9822-0ba7ce7b8cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:20.689705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abed537-79b1-4e3f-9822-0ba7ce7b8cc1 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:20.695201 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f28823-1199-43ab-9421-cf0fa0742d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:20.696286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f28823-1199-43ab-9421-cf0fa0742d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:20.696286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f28823-1199-43ab-9421-cf0fa0742d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:20.696654 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f28823-1199-43ab-9421-cf0fa0742d34 admin admin] PATH_INFO: `/v3/projects/dfbb2979026b44c98e061f3733a70cfd` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:20.698285 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f28823-1199-43ab-9421-cf0fa0742d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfbb2979026b44c98e061f3733a70cfd)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:20.700680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f28823-1199-43ab-9421-cf0fa0742d34 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:20.843169 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:20.849443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-09f28823-1199-43ab-9421-cf0fa0742d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfbb2979026b44c98e061f3733a70cfd', 'request_id': 'req-09f28823-1199-43ab-9421-cf0fa0742d34'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:20.976631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-09f28823-1199-43ab-9421-cf0fa0742d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfbb2979026b44c98e061f3733a70cfd', 'request_id': 'req-09f28823-1199-43ab-9421-cf0fa0742d34'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:20.985589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-09f28823-1199-43ab-9421-cf0fa0742d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfbb2979026b44c98e061f3733a70cfd', 'request_id': 'req-09f28823-1199-43ab-9421-cf0fa0742d34'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:21.001036 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-09f28823-1199-43ab-9421-cf0fa0742d34 admin admin] The token cache is being invalidate because project dfbb2979026b44c98e061f3733a70cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:29:21.001227 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-09f28823-1199-43ab-9421-cf0fa0742d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:21.002000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-09f28823-1199-43ab-9421-cf0fa0742d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:21.003772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1331/2631] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:29:20 2022] DELETE /identity/v3/projects/dfbb2979026b44c98e061f3733a70cfd => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:29:21.009216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad6e98-d168-4c70-95f3-e294e2567b6a service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:21.026833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad6e98-d168-4c70-95f3-e294e2567b6a service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:21.055834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:21.104240 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e6e19-c91b-4154-9301-3152e8d195a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:21.104790 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e6e19-c91b-4154-9301-3152e8d195a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:21.105078 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e6e19-c91b-4154-9301-3152e8d195a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:21.105385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e6e19-c91b-4154-9301-3152e8d195a5 admin admin] PATH_INFO: `/v3/users/cfa54dbe18494c8fb68b9eb75f367f64` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:21.106712 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e6e19-c91b-4154-9301-3152e8d195a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfa54dbe18494c8fb68b9eb75f367f64)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:21.108916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e6e19-c91b-4154-9301-3152e8d195a5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:21.515029 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b57e6e19-c91b-4154-9301-3152e8d195a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfa54dbe18494c8fb68b9eb75f367f64'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:21.515738 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b57e6e19-c91b-4154-9301-3152e8d195a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfa54dbe18494c8fb68b9eb75f367f64'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:21.531282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b57e6e19-c91b-4154-9301-3152e8d195a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfa54dbe18494c8fb68b9eb75f367f64'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:21.532268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b57e6e19-c91b-4154-9301-3152e8d195a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfa54dbe18494c8fb68b9eb75f367f64'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:21.730989 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b57e6e19-c91b-4154-9301-3152e8d195a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfa54dbe18494c8fb68b9eb75f367f64'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:21.748760 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1301/2632] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:29:21 2022] DELETE /identity/v3/users/cfa54dbe18494c8fb68b9eb75f367f64 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:29:22.339810 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f28823-1199-43ab-9421-cf0fa0742d34 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:22.342725 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-09f28823-1199-43ab-9421-cf0fa0742d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:22.358974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f28823-1199-43ab-9421-cf0fa0742d34 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:22.437310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced6a39-702a-4361-af2b-f31f60b921bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:22.437985 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced6a39-702a-4361-af2b-f31f60b921bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:22.438269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced6a39-702a-4361-af2b-f31f60b921bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:22.438586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced6a39-702a-4361-af2b-f31f60b921bc admin admin] PATH_INFO: `/v3/projects/b7646e0cd7d2463ab3404eb9ba008c6e` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:22.439851 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced6a39-702a-4361-af2b-f31f60b921bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7646e0cd7d2463ab3404eb9ba008c6e)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:22.441816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced6a39-702a-4361-af2b-f31f60b921bc admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:22.601167 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-eced6a39-702a-4361-af2b-f31f60b921bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7646e0cd7d2463ab3404eb9ba008c6e', 'request_id': 'req-eced6a39-702a-4361-af2b-f31f60b921bc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:22.719337 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-eced6a39-702a-4361-af2b-f31f60b921bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7646e0cd7d2463ab3404eb9ba008c6e', 'request_id': 'req-eced6a39-702a-4361-af2b-f31f60b921bc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:22.731336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-eced6a39-702a-4361-af2b-f31f60b921bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7646e0cd7d2463ab3404eb9ba008c6e', 'request_id': 'req-eced6a39-702a-4361-af2b-f31f60b921bc'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:22.745992 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-eced6a39-702a-4361-af2b-f31f60b921bc admin admin] The token cache is being invalidate because project b7646e0cd7d2463ab3404eb9ba008c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:29:22.746338 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-eced6a39-702a-4361-af2b-f31f60b921bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:22.747149 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-eced6a39-702a-4361-af2b-f31f60b921bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:22.757097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1332/2633] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:29:22 2022] DELETE /identity/v3/projects/b7646e0cd7d2463ab3404eb9ba008c6e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:29:22.760123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d4635-c97e-44eb-8f6b-8168cd26d2aa None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:22.760768 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d4635-c97e-44eb-8f6b-8168cd26d2aa None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:22.761310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d4635-c97e-44eb-8f6b-8168cd26d2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:22.790568 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-550d4635-c97e-44eb-8f6b-8168cd26d2aa None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:22.791938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-550d4635-c97e-44eb-8f6b-8168cd26d2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:22.869646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1302/2634] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:29:22.878867 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0973e91-fa25-4798-b674-1e9f83b946e7 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:22.879150 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0973e91-fa25-4798-b674-1e9f83b946e7 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:22.879426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0973e91-fa25-4798-b674-1e9f83b946e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:22.903806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-e0973e91-fa25-4798-b674-1e9f83b946e7 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:22.905221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e0973e91-fa25-4798-b674-1e9f83b946e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:22.914875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1333/2635] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:22.921481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d4635-c97e-44eb-8f6b-8168cd26d2aa None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:22.932037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d4635-c97e-44eb-8f6b-8168cd26d2aa None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:22.941390 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823209e-fffb-4116-93b4-401cde69d1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:22.943355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823209e-fffb-4116-93b4-401cde69d1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:22.943649 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823209e-fffb-4116-93b4-401cde69d1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:22.943930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823209e-fffb-4116-93b4-401cde69d1ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:22.945049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823209e-fffb-4116-93b4-401cde69d1ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:29:22.945421 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823209e-fffb-4116-93b4-401cde69d1ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:22.953261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823209e-fffb-4116-93b4-401cde69d1ae admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:22.969676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1303/2636] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:29:22.976152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0973e91-fa25-4798-b674-1e9f83b946e7 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:22.987342 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0973e91-fa25-4798-b674-1e9f83b946e7 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:22.993352 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ee2f2-2623-4b5a-afc4-090fdaed5846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:22.994075 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ee2f2-2623-4b5a-afc4-090fdaed5846 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:22.994594 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ee2f2-2623-4b5a-afc4-090fdaed5846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:22.994828 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ee2f2-2623-4b5a-afc4-090fdaed5846 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:22.995567 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ee2f2-2623-4b5a-afc4-090fdaed5846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:22.999099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ee2f2-2623-4b5a-afc4-090fdaed5846 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:23.167913 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1334/2637] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:29:22 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:29:23.171945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823209e-fffb-4116-93b4-401cde69d1ae admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:23.183055 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823209e-fffb-4116-93b4-401cde69d1ae admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:23.216689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:23.274725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d1a75-7c4c-478d-ab4d-f8f35bcd7fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:23.275709 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d1a75-7c4c-478d-ab4d-f8f35bcd7fcf admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:23.276218 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d1a75-7c4c-478d-ab4d-f8f35bcd7fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:23.276899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d1a75-7c4c-478d-ab4d-f8f35bcd7fcf admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:23.277689 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d1a75-7c4c-478d-ab4d-f8f35bcd7fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:23.280289 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d1a75-7c4c-478d-ab4d-f8f35bcd7fcf admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:23.437291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1304/2638] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:29:23 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:29:23.440415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ee2f2-2623-4b5a-afc4-090fdaed5846 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:23.453796 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ee2f2-2623-4b5a-afc4-090fdaed5846 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:23.459339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fa648-b3f9-4da5-b705-ea70acf5f935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:23.460031 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fa648-b3f9-4da5-b705-ea70acf5f935 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:23.460327 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fa648-b3f9-4da5-b705-ea70acf5f935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:23.460608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fa648-b3f9-4da5-b705-ea70acf5f935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:23.461354 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fa648-b3f9-4da5-b705-ea70acf5f935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:23.463352 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fa648-b3f9-4da5-b705-ea70acf5f935 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:23.477067 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1335/2639] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:29:23.478720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d1a75-7c4c-478d-ab4d-f8f35bcd7fcf admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:23.490254 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d1a75-7c4c-478d-ab4d-f8f35bcd7fcf admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:23.496190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b94edd-03b1-42c7-aa52-405a19a1365e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:23.496843 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b94edd-03b1-42c7-aa52-405a19a1365e admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:23.497123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b94edd-03b1-42c7-aa52-405a19a1365e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:23.498330 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b94edd-03b1-42c7-aa52-405a19a1365e admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:23.499483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b94edd-03b1-42c7-aa52-405a19a1365e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:23.500707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b94edd-03b1-42c7-aa52-405a19a1365e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:23.512701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1305/2640] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:29:23.517229 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fa648-b3f9-4da5-b705-ea70acf5f935 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:23.528183 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fa648-b3f9-4da5-b705-ea70acf5f935 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:23.533591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e95093-a84a-4854-87e7-69603c455712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:23.534387 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e95093-a84a-4854-87e7-69603c455712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:23.534733 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e95093-a84a-4854-87e7-69603c455712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:23.535056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e95093-a84a-4854-87e7-69603c455712 admin admin] PATH_INFO: `/v3/projects/f37bb8e723de493eb4f8039340fd77ac/users/c7c90066ff504083be989a0fb8a5fcbd/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:23.554028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e95093-a84a-4854-87e7-69603c455712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37bb8e723de493eb4f8039340fd77ac, user_id=c7c90066ff504083be989a0fb8a5fcbd, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:23.556764 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e95093-a84a-4854-87e7-69603c455712 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:23.560999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:23.721262 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1336/2641] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:29:23 2022] PUT /identity/v3/projects/f37bb8e723de493eb4f8039340fd77ac/users/c7c90066ff504083be989a0fb8a5fcbd/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:29:23.734282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b78582-b91b-4410-a884-321c5987ce33 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:23.734608 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b78582-b91b-4410-a884-321c5987ce33 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:23.734890 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b78582-b91b-4410-a884-321c5987ce33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:23.765599 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-95b78582-b91b-4410-a884-321c5987ce33 None None] MFA Rules not processed for user `c7c90066ff504083be989a0fb8a5fcbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:23.766753 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-95b78582-b91b-4410-a884-321c5987ce33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:23.837719 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1306/2642] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:29:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:23.850576 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e95093-a84a-4854-87e7-69603c455712 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:23.852356 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b5e95093-a84a-4854-87e7-69603c455712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:23.917202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e95093-a84a-4854-87e7-69603c455712 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:23.921804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688a461-5d91-4974-93b4-06dd5f39404f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:23.922485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688a461-5d91-4974-93b4-06dd5f39404f service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:23.922762 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688a461-5d91-4974-93b4-06dd5f39404f service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:23.923036 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688a461-5d91-4974-93b4-06dd5f39404f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:23.932691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688a461-5d91-4974-93b4-06dd5f39404f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:23.934637 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688a461-5d91-4974-93b4-06dd5f39404f service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:23.949842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1337/2643] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:29:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:29:23.971656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b78582-b91b-4410-a884-321c5987ce33 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:24.044693 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b78582-b91b-4410-a884-321c5987ce33 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:24.053385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbe784-5ab7-4577-b246-1b247cda971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:24.053385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbe784-5ab7-4577-b246-1b247cda971a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:24.053385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbe784-5ab7-4577-b246-1b247cda971a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:24.053385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbe784-5ab7-4577-b246-1b247cda971a admin admin] PATH_INFO: `/v3/users/c7c90066ff504083be989a0fb8a5fcbd` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:24.053845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbe784-5ab7-4577-b246-1b247cda971a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c90066ff504083be989a0fb8a5fcbd)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:24.054605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbe784-5ab7-4577-b246-1b247cda971a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:24.369178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:24.375813 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-39bbe784-5ab7-4577-b246-1b247cda971a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c90066ff504083be989a0fb8a5fcbd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:24.376721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-39bbe784-5ab7-4577-b246-1b247cda971a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c90066ff504083be989a0fb8a5fcbd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:24.389454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-39bbe784-5ab7-4577-b246-1b247cda971a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c90066ff504083be989a0fb8a5fcbd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:24.390443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-39bbe784-5ab7-4577-b246-1b247cda971a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c90066ff504083be989a0fb8a5fcbd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:24.518798 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-39bbe784-5ab7-4577-b246-1b247cda971a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c90066ff504083be989a0fb8a5fcbd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:24.539782 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1307/2644] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:29:23 2022] DELETE /identity/v3/users/c7c90066ff504083be989a0fb8a5fcbd => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:29:24.545971 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441fc6d-a76c-45e4-9dd4-74f8e73e2543 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:24.546803 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441fc6d-a76c-45e4-9dd4-74f8e73e2543 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:24.547364 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441fc6d-a76c-45e4-9dd4-74f8e73e2543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:24.572425 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-7441fc6d-a76c-45e4-9dd4-74f8e73e2543 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:24.576899 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7441fc6d-a76c-45e4-9dd4-74f8e73e2543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:24.664107 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1338/2645] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:29:24.675637 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbe784-5ab7-4577-b246-1b247cda971a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:24.677171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-39bbe784-5ab7-4577-b246-1b247cda971a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:24.753819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbe784-5ab7-4577-b246-1b247cda971a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:24.758587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd37c23-32ea-4255-aeed-0e8533027e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:24.759356 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd37c23-32ea-4255-aeed-0e8533027e43 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:24.759645 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd37c23-32ea-4255-aeed-0e8533027e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:24.759916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd37c23-32ea-4255-aeed-0e8533027e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:24.771139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd37c23-32ea-4255-aeed-0e8533027e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:24.772595 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd37c23-32ea-4255-aeed-0e8533027e43 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:24.784182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1308/2646] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:29:25.342768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441fc6d-a76c-45e4-9dd4-74f8e73e2543 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:25.348466 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7441fc6d-a76c-45e4-9dd4-74f8e73e2543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:25.359910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441fc6d-a76c-45e4-9dd4-74f8e73e2543 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:25.364616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de310f6-43a0-44ad-918d-e323f2fde0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:25.365279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de310f6-43a0-44ad-918d-e323f2fde0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:25.365565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de310f6-43a0-44ad-918d-e323f2fde0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:25.366099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de310f6-43a0-44ad-918d-e323f2fde0b1 admin admin] PATH_INFO: `/v3/projects/f37bb8e723de493eb4f8039340fd77ac` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:25.367366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de310f6-43a0-44ad-918d-e323f2fde0b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37bb8e723de493eb4f8039340fd77ac)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:25.369293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de310f6-43a0-44ad-918d-e323f2fde0b1 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:25.512441 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6de310f6-43a0-44ad-918d-e323f2fde0b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37bb8e723de493eb4f8039340fd77ac', 'request_id': 'req-6de310f6-43a0-44ad-918d-e323f2fde0b1'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:25.639001 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6de310f6-43a0-44ad-918d-e323f2fde0b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37bb8e723de493eb4f8039340fd77ac', 'request_id': 'req-6de310f6-43a0-44ad-918d-e323f2fde0b1'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:25.647683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6de310f6-43a0-44ad-918d-e323f2fde0b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37bb8e723de493eb4f8039340fd77ac', 'request_id': 'req-6de310f6-43a0-44ad-918d-e323f2fde0b1'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:25.661302 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6de310f6-43a0-44ad-918d-e323f2fde0b1 admin admin] The token cache is being invalidate because project f37bb8e723de493eb4f8039340fd77ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:29:25.661575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6de310f6-43a0-44ad-918d-e323f2fde0b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:25.662337 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-6de310f6-43a0-44ad-918d-e323f2fde0b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:25.664142 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1339/2647] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:29:25 2022] DELETE /identity/v3/projects/f37bb8e723de493eb4f8039340fd77ac => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:29:25.670500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6cf7a-d062-4b47-ace2-7244f559f8fe None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:25.670809 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6cf7a-d062-4b47-ace2-7244f559f8fe None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:25.671093 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6cf7a-d062-4b47-ace2-7244f559f8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:25.696990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-99e6cf7a-d062-4b47-ace2-7244f559f8fe None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:25.698427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-99e6cf7a-d062-4b47-ace2-7244f559f8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:25.777632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1309/2648] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:25.785286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed68a3-561a-42dc-a9e7-9e38a4492d0d None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:25.785575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed68a3-561a-42dc-a9e7-9e38a4492d0d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:25.785851 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed68a3-561a-42dc-a9e7-9e38a4492d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:25.808012 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-4aed68a3-561a-42dc-a9e7-9e38a4492d0d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:25.809680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4aed68a3-561a-42dc-a9e7-9e38a4492d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:25.818399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1340/2649] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:25.822647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6cf7a-d062-4b47-ace2-7244f559f8fe None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:25.833764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6cf7a-d062-4b47-ace2-7244f559f8fe None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:25.838739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f8f6c-5aaf-40d8-94ef-768eea54a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:25.839363 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f8f6c-5aaf-40d8-94ef-768eea54a71a admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:25.839638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f8f6c-5aaf-40d8-94ef-768eea54a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:25.839909 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f8f6c-5aaf-40d8-94ef-768eea54a71a admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:25.840613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f8f6c-5aaf-40d8-94ef-768eea54a71a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:29:25.840917 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f8f6c-5aaf-40d8-94ef-768eea54a71a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:25.843550 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f8f6c-5aaf-40d8-94ef-768eea54a71a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:25.855956 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1310/2650] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:29:25.860531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed68a3-561a-42dc-a9e7-9e38a4492d0d None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:25.874707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed68a3-561a-42dc-a9e7-9e38a4492d0d None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:25.879901 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979d0cf-4cf9-451e-a078-f2ac3f5a4989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:25.880539 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979d0cf-4cf9-451e-a078-f2ac3f5a4989 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:25.880820 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979d0cf-4cf9-451e-a078-f2ac3f5a4989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:25.881095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979d0cf-4cf9-451e-a078-f2ac3f5a4989 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:25.881773 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979d0cf-4cf9-451e-a078-f2ac3f5a4989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:25.883835 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979d0cf-4cf9-451e-a078-f2ac3f5a4989 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:25.901025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:25.975648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1341/2651] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:29:25 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:29:25.980221 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f8f6c-5aaf-40d8-94ef-768eea54a71a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:25.992541 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f8f6c-5aaf-40d8-94ef-768eea54a71a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:26.044146 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:26.057885 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ef6fd-ee13-4e5d-b3bd-9d8b4bd0735b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:26.058591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ef6fd-ee13-4e5d-b3bd-9d8b4bd0735b admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:26.058932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ef6fd-ee13-4e5d-b3bd-9d8b4bd0735b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:26.059212 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ef6fd-ee13-4e5d-b3bd-9d8b4bd0735b admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:26.060444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ef6fd-ee13-4e5d-b3bd-9d8b4bd0735b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:26.062474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ef6fd-ee13-4e5d-b3bd-9d8b4bd0735b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:26.178143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1311/2652] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:29:25 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:29:26.183051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979d0cf-4cf9-451e-a078-f2ac3f5a4989 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:26.196250 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979d0cf-4cf9-451e-a078-f2ac3f5a4989 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:26.202664 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4138a9-3b0f-47b8-aa60-06f717cd8513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:26.203687 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4138a9-3b0f-47b8-aa60-06f717cd8513 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:26.204172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4138a9-3b0f-47b8-aa60-06f717cd8513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:26.204637 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4138a9-3b0f-47b8-aa60-06f717cd8513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:26.205793 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4138a9-3b0f-47b8-aa60-06f717cd8513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:26.207761 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4138a9-3b0f-47b8-aa60-06f717cd8513 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:26.226598 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ef6fd-ee13-4e5d-b3bd-9d8b4bd0735b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:26.227496 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1342/2653] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:29:26.243355 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ef6fd-ee13-4e5d-b3bd-9d8b4bd0735b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:26.250823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ed150-4f30-4c05-acdf-76f746007b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:26.251619 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ed150-4f30-4c05-acdf-76f746007b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:26.252070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ed150-4f30-4c05-acdf-76f746007b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:26.252437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ed150-4f30-4c05-acdf-76f746007b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:26.253140 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ed150-4f30-4c05-acdf-76f746007b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:26.255361 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ed150-4f30-4c05-acdf-76f746007b96 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:26.270093 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1312/2654] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:29:26.275343 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4138a9-3b0f-47b8-aa60-06f717cd8513 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:26.291684 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4138a9-3b0f-47b8-aa60-06f717cd8513 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:26.298146 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731ee6b-2ff0-4caf-a0db-38a6678f5216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:26.298814 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731ee6b-2ff0-4caf-a0db-38a6678f5216 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:26.299105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731ee6b-2ff0-4caf-a0db-38a6678f5216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:26.299362 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731ee6b-2ff0-4caf-a0db-38a6678f5216 admin admin] PATH_INFO: `/v3/projects/9c313335953a4e5ca28f1922117e7a86/users/21789b7e96ca4b0ba71b674c4f806020/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:26.318095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731ee6b-2ff0-4caf-a0db-38a6678f5216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c313335953a4e5ca28f1922117e7a86, user_id=21789b7e96ca4b0ba71b674c4f806020, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:26.320874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731ee6b-2ff0-4caf-a0db-38a6678f5216 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:26.453181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1343/2655] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:29:26 2022] PUT /identity/v3/projects/9c313335953a4e5ca28f1922117e7a86/users/21789b7e96ca4b0ba71b674c4f806020/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:29:26.466701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15a52b-17eb-4885-bbcf-9183004a4502 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:26.466701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15a52b-17eb-4885-bbcf-9183004a4502 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:26.466701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15a52b-17eb-4885-bbcf-9183004a4502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:26.508686 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7d15a52b-17eb-4885-bbcf-9183004a4502 None None] MFA Rules not processed for user `21789b7e96ca4b0ba71b674c4f806020`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:26.510193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7d15a52b-17eb-4885-bbcf-9183004a4502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:26.600353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1313/2656] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:29:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:26.613275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731ee6b-2ff0-4caf-a0db-38a6678f5216 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:26.615975 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8731ee6b-2ff0-4caf-a0db-38a6678f5216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:26.688577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731ee6b-2ff0-4caf-a0db-38a6678f5216 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:26.693413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b78ff-071e-4ff8-b2f5-104790ecb083 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d85dc9f9f15480db927e617c992e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:26.694319 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b78ff-071e-4ff8-b2f5-104790ecb083 service glance] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:26.694676 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b78ff-071e-4ff8-b2f5-104790ecb083 service glance] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:26.694879 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b78ff-071e-4ff8-b2f5-104790ecb083 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:26.709319 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b78ff-071e-4ff8-b2f5-104790ecb083 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:26.710863 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b78ff-071e-4ff8-b2f5-104790ecb083 service glance] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:26.722303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1344/2657] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:29:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:29:32.618381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02162d-2624-43df-8f3c-da56e59b0a0c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:32.618928 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02162d-2624-43df-8f3c-da56e59b0a0c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:32.618928 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02162d-2624-43df-8f3c-da56e59b0a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:32.641187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-4e02162d-2624-43df-8f3c-da56e59b0a0c None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:32.642587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4e02162d-2624-43df-8f3c-da56e59b0a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:32.725872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1314/2658] 10.222.0.98 () {58 vars in 1009 bytes} [Tue Jul 26 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:33.037765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b78ff-071e-4ff8-b2f5-104790ecb083 service glance] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:33.039994 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b01b78ff-071e-4ff8-b2f5-104790ecb083 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:33.161583 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b78ff-071e-4ff8-b2f5-104790ecb083 service glance] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:33.168874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76646ae3-607d-4d80-b555-f03bd1eeeec7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:33.170152 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76646ae3-607d-4d80-b555-f03bd1eeeec7 service swift] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:33.170465 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76646ae3-607d-4d80-b555-f03bd1eeeec7 service swift] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:33.170749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76646ae3-607d-4d80-b555-f03bd1eeeec7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:33.179855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76646ae3-607d-4d80-b555-f03bd1eeeec7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:33.181466 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76646ae3-607d-4d80-b555-f03bd1eeeec7 service swift] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:33.191774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1345/2659] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:29:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:29:35.546818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dc05e-4758-4d83-b8b7-0bdf95383180 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:35.546818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dc05e-4758-4d83-b8b7-0bdf95383180 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:35.546818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dc05e-4758-4d83-b8b7-0bdf95383180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:35.571494 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-660dc05e-4758-4d83-b8b7-0bdf95383180 None None] MFA Rules not processed for user `66a1a31e3bfb4b929965a6e52bd6ec72`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:35.573110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-660dc05e-4758-4d83-b8b7-0bdf95383180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:35.667211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1315/2660] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:43.188015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:INSERT=2,keystone:SELECT=75 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:45.665192 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:54.838193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4a759-a28d-4074-a017-6eac6f1c9102 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:54.839330 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4a759-a28d-4074-a017-6eac6f1c9102 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:54.840390 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4a759-a28d-4074-a017-6eac6f1c9102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:54.883766 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-4fa4a759-a28d-4074-a017-6eac6f1c9102 None None] MFA Rules not processed for user `3497ed5c5d204d088a178a9560ee83cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:54.885195 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4fa4a759-a28d-4074-a017-6eac6f1c9102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:54.897014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1346/2661] 10.222.0.98 () {58 vars in 967 bytes} [Tue Jul 26 15:29:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:54.919974 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dc05e-4758-4d83-b8b7-0bdf95383180 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:54.948341 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dc05e-4758-4d83-b8b7-0bdf95383180 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:54.963564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4817939-4015-40a9-98d9-5f5f647065cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '013ae8b88160433db6876f84947f0d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:54.964681 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4817939-4015-40a9-98d9-5f5f647065cc service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:54.965195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4817939-4015-40a9-98d9-5f5f647065cc service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:54.966634 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4817939-4015-40a9-98d9-5f5f647065cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:54.991661 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4817939-4015-40a9-98d9-5f5f647065cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:54.996642 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4817939-4015-40a9-98d9-5f5f647065cc service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:55.013619 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1316/2662] 10.222.0.98 () {60 vars in 1384 bytes} [Tue Jul 26 15:29:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:29:58.569440 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4a759-a28d-4074-a017-6eac6f1c9102 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:58.572429 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4fa4a759-a28d-4074-a017-6eac6f1c9102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:58.724534 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4817939-4015-40a9-98d9-5f5f647065cc service swift] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:58.726352 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4a759-a28d-4074-a017-6eac6f1c9102 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:58.736668 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ee4d6-f2ae-41a2-9190-14ccff8166e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:58.737482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ee4d6-f2ae-41a2-9190-14ccff8166e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:58.737779 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ee4d6-f2ae-41a2-9190-14ccff8166e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:58.738065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ee4d6-f2ae-41a2-9190-14ccff8166e9 admin admin] PATH_INFO: `/v3/users/4a76e3126b83448691e5d3c56c6c3f44` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:58.739368 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ee4d6-f2ae-41a2-9190-14ccff8166e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a76e3126b83448691e5d3c56c6c3f44)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:58.741745 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ee4d6-f2ae-41a2-9190-14ccff8166e9 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:58.748447 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4817939-4015-40a9-98d9-5f5f647065cc service swift] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:58.757102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15597a26-1c95-44c9-b27b-ab38c1952944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:58.758330 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15597a26-1c95-44c9-b27b-ab38c1952944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:58.759303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15597a26-1c95-44c9-b27b-ab38c1952944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:58.760047 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15597a26-1c95-44c9-b27b-ab38c1952944 admin admin] PATH_INFO: `/v3/users/21789b7e96ca4b0ba71b674c4f806020` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:58.764261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15597a26-1c95-44c9-b27b-ab38c1952944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21789b7e96ca4b0ba71b674c4f806020)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:58.768307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15597a26-1c95-44c9-b27b-ab38c1952944 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:58.971892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9f0ee4d6-f2ae-41a2-9190-14ccff8166e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a76e3126b83448691e5d3c56c6c3f44'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:58.974648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9f0ee4d6-f2ae-41a2-9190-14ccff8166e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a76e3126b83448691e5d3c56c6c3f44'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:58.995028 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-15597a26-1c95-44c9-b27b-ab38c1952944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21789b7e96ca4b0ba71b674c4f806020'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:58.995874 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-15597a26-1c95-44c9-b27b-ab38c1952944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21789b7e96ca4b0ba71b674c4f806020'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:58.999590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9f0ee4d6-f2ae-41a2-9190-14ccff8166e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a76e3126b83448691e5d3c56c6c3f44'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:59.013044 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-15597a26-1c95-44c9-b27b-ab38c1952944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21789b7e96ca4b0ba71b674c4f806020'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:59.015778 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-15597a26-1c95-44c9-b27b-ab38c1952944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21789b7e96ca4b0ba71b674c4f806020'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:59.051527 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9f0ee4d6-f2ae-41a2-9190-14ccff8166e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a76e3126b83448691e5d3c56c6c3f44'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:59.051527 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-9f0ee4d6-f2ae-41a2-9190-14ccff8166e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a76e3126b83448691e5d3c56c6c3f44'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:59.067738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1347/2663] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:29:58 2022] DELETE /identity/v3/users/4a76e3126b83448691e5d3c56c6c3f44 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:29:59.113656 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-15597a26-1c95-44c9-b27b-ab38c1952944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21789b7e96ca4b0ba71b674c4f806020'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:59.145131 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1317/2664] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:29:58 2022] DELETE /identity/v3/users/21789b7e96ca4b0ba71b674c4f806020 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:29:59.150822 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb77c9-ae42-43c0-9ab4-ac70f6e3f073 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:59.151124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb77c9-ae42-43c0-9ab4-ac70f6e3f073 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:59.151536 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb77c9-ae42-43c0-9ab4-ac70f6e3f073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:59.185841 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-7adb77c9-ae42-43c0-9ab4-ac70f6e3f073 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:59.187017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7adb77c9-ae42-43c0-9ab4-ac70f6e3f073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:59.276399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1348/2665] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:59.292984 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15597a26-1c95-44c9-b27b-ab38c1952944 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:59.296664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-15597a26-1c95-44c9-b27b-ab38c1952944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:59.400080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15597a26-1c95-44c9-b27b-ab38c1952944 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:59.405140 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b574f7-e962-4779-a5f8-883cf6a7f51e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:59.405905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b574f7-e962-4779-a5f8-883cf6a7f51e service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:59.406289 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b574f7-e962-4779-a5f8-883cf6a7f51e service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:59.406699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b574f7-e962-4779-a5f8-883cf6a7f51e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:59.423385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b574f7-e962-4779-a5f8-883cf6a7f51e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:59.425033 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b574f7-e962-4779-a5f8-883cf6a7f51e service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:59.434012 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb77c9-ae42-43c0-9ab4-ac70f6e3f073 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:59.439970 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7adb77c9-ae42-43c0-9ab4-ac70f6e3f073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:59.449437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1318/2666] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:29:59.462986 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb77c9-ae42-43c0-9ab4-ac70f6e3f073 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:59.476014 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46027b5-7aee-431e-abd6-3802083cf309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:59.477672 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46027b5-7aee-431e-abd6-3802083cf309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:59.478397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46027b5-7aee-431e-abd6-3802083cf309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:59.479181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46027b5-7aee-431e-abd6-3802083cf309 admin admin] PATH_INFO: `/v3/projects/4db618b8340743dbb3a5da5a6c2a8153` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:59.483607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46027b5-7aee-431e-abd6-3802083cf309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4db618b8340743dbb3a5da5a6c2a8153)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:59.486196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46027b5-7aee-431e-abd6-3802083cf309 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:59.502185 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:59.687498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f46027b5-7aee-431e-abd6-3802083cf309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4db618b8340743dbb3a5da5a6c2a8153', 'request_id': 'req-f46027b5-7aee-431e-abd6-3802083cf309'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:59.793384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f46027b5-7aee-431e-abd6-3802083cf309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4db618b8340743dbb3a5da5a6c2a8153', 'request_id': 'req-f46027b5-7aee-431e-abd6-3802083cf309'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:59.805622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f46027b5-7aee-431e-abd6-3802083cf309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4db618b8340743dbb3a5da5a6c2a8153', 'request_id': 'req-f46027b5-7aee-431e-abd6-3802083cf309'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:59.826656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f46027b5-7aee-431e-abd6-3802083cf309 admin admin] The token cache is being invalidate because project 4db618b8340743dbb3a5da5a6c2a8153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:29:59.827097 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f46027b5-7aee-431e-abd6-3802083cf309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:59.827924 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-f46027b5-7aee-431e-abd6-3802083cf309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:29:59.830220 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1349/2667] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:29:59 2022] DELETE /identity/v3/projects/4db618b8340743dbb3a5da5a6c2a8153 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:29:59.836929 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792faf16-25fe-48ef-948f-d44c9cda8d83 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:59.842064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792faf16-25fe-48ef-948f-d44c9cda8d83 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:59.842064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792faf16-25fe-48ef-948f-d44c9cda8d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:59.878036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-792faf16-25fe-48ef-948f-d44c9cda8d83 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:59.882182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-792faf16-25fe-48ef-948f-d44c9cda8d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:00.010498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1319/2668] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:30:00.104353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428646d-53a9-4801-b77e-b472fb869839 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:00.105236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428646d-53a9-4801-b77e-b472fb869839 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:00.106078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428646d-53a9-4801-b77e-b472fb869839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:00.139743 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a428646d-53a9-4801-b77e-b472fb869839 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:00.141234 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a428646d-53a9-4801-b77e-b472fb869839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:00.156485 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792faf16-25fe-48ef-948f-d44c9cda8d83 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:00.158849 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-792faf16-25fe-48ef-948f-d44c9cda8d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:00.160301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1350/2669] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:30:00.166963 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428646d-53a9-4801-b77e-b472fb869839 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:00.180899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:00.183525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428646d-53a9-4801-b77e-b472fb869839 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:00.197199 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792faf16-25fe-48ef-948f-d44c9cda8d83 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:00.201912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bbc29-0e7a-4017-a9ab-8e3eed4f1e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:00.202723 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bbc29-0e7a-4017-a9ab-8e3eed4f1e28 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:00.203545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bbc29-0e7a-4017-a9ab-8e3eed4f1e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:00.204056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bbc29-0e7a-4017-a9ab-8e3eed4f1e28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:00.204987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb079c80-b792-4511-ba54-dc40f857420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:00.205779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb079c80-b792-4511-ba54-dc40f857420c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:00.206275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bbc29-0e7a-4017-a9ab-8e3eed4f1e28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:30:00.206516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb079c80-b792-4511-ba54-dc40f857420c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:00.206885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bbc29-0e7a-4017-a9ab-8e3eed4f1e28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:00.207088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb079c80-b792-4511-ba54-dc40f857420c admin admin] PATH_INFO: `/v3/projects/9c313335953a4e5ca28f1922117e7a86` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:00.208734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb079c80-b792-4511-ba54-dc40f857420c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c313335953a4e5ca28f1922117e7a86)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:00.211120 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb079c80-b792-4511-ba54-dc40f857420c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:00.211345 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bbc29-0e7a-4017-a9ab-8e3eed4f1e28 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:00.247972 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1351/2670] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:30:00.249277 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bbc29-0e7a-4017-a9ab-8e3eed4f1e28 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:00.261349 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bbc29-0e7a-4017-a9ab-8e3eed4f1e28 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:00.268857 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837933c-2813-4125-b3a6-f9426d463a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:00.269562 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837933c-2813-4125-b3a6-f9426d463a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:00.270874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837933c-2813-4125-b3a6-f9426d463a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:00.270874 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837933c-2813-4125-b3a6-f9426d463a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:00.271202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837933c-2813-4125-b3a6-f9426d463a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:00.272944 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837933c-2813-4125-b3a6-f9426d463a8a admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:00.389312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bb079c80-b792-4511-ba54-dc40f857420c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c313335953a4e5ca28f1922117e7a86', 'request_id': 'req-bb079c80-b792-4511-ba54-dc40f857420c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:00.413512 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bb079c80-b792-4511-ba54-dc40f857420c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c313335953a4e5ca28f1922117e7a86', 'request_id': 'req-bb079c80-b792-4511-ba54-dc40f857420c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:00.428010 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bb079c80-b792-4511-ba54-dc40f857420c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c313335953a4e5ca28f1922117e7a86', 'request_id': 'req-bb079c80-b792-4511-ba54-dc40f857420c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:00.432589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1352/2671] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:30:00 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:30:00.438631 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837933c-2813-4125-b3a6-f9426d463a8a admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:00.534033 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bb079c80-b792-4511-ba54-dc40f857420c admin admin] The token cache is being invalidate because project 9c313335953a4e5ca28f1922117e7a86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:30:00.537071 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bb079c80-b792-4511-ba54-dc40f857420c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:00.538812 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bb079c80-b792-4511-ba54-dc40f857420c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:00.541962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1320/2672] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:30:00 2022] DELETE /identity/v3/projects/9c313335953a4e5ca28f1922117e7a86 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:30:00.548844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d6b0e-1f2b-4d0b-9c70-74e0c76817af None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:00.549550 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d6b0e-1f2b-4d0b-9c70-74e0c76817af None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:00.552752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d6b0e-1f2b-4d0b-9c70-74e0c76817af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:00.555712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837933c-2813-4125-b3a6-f9426d463a8a admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:00.564197 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe0a75-0a76-4c53-8caf-4b73cac9e46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:00.564860 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe0a75-0a76-4c53-8caf-4b73cac9e46f admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:00.565145 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe0a75-0a76-4c53-8caf-4b73cac9e46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:00.565419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe0a75-0a76-4c53-8caf-4b73cac9e46f admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:00.566159 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe0a75-0a76-4c53-8caf-4b73cac9e46f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:00.569978 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe0a75-0a76-4c53-8caf-4b73cac9e46f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:00.591409 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c29d6b0e-1f2b-4d0b-9c70-74e0c76817af None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:00.594468 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c29d6b0e-1f2b-4d0b-9c70-74e0c76817af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:00.610585 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1321/2673] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:30:00.622258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ec21c-d50d-460c-b915-d4019443f2a8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:00.622842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ec21c-d50d-460c-b915-d4019443f2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:00.627448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ec21c-d50d-460c-b915-d4019443f2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:00.654045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9c7ec21c-d50d-460c-b915-d4019443f2a8 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:00.657522 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9c7ec21c-d50d-460c-b915-d4019443f2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:00.665095 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1322/2674] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:30:00.671898 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ec21c-d50d-460c-b915-d4019443f2a8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:00.687795 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ec21c-d50d-460c-b915-d4019443f2a8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:00.691087 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1353/2675] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:30:00 2022] POST /identity/v3/users => generated 283 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:30:00.696771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe0a75-0a76-4c53-8caf-4b73cac9e46f admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:00.700709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ccbe0a75-0a76-4c53-8caf-4b73cac9e46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:00.703608 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce658430-e933-44c8-a574-ae0e7aa29be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:00.704671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce658430-e933-44c8-a574-ae0e7aa29be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:00.704671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce658430-e933-44c8-a574-ae0e7aa29be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:00.704915 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce658430-e933-44c8-a574-ae0e7aa29be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:00.706039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce658430-e933-44c8-a574-ae0e7aa29be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:30:00.707865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce658430-e933-44c8-a574-ae0e7aa29be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:00.709983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce658430-e933-44c8-a574-ae0e7aa29be9 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:00.723884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe0a75-0a76-4c53-8caf-4b73cac9e46f admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:00.729872 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1323/2676] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:30:00.738021 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce658430-e933-44c8-a574-ae0e7aa29be9 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:00.740443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242216b-3ad4-4d6c-b2f8-b53d70600eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:00.741334 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242216b-3ad4-4d6c-b2f8-b53d70600eab admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:00.741929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242216b-3ad4-4d6c-b2f8-b53d70600eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:00.742271 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242216b-3ad4-4d6c-b2f8-b53d70600eab admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:00.743106 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242216b-3ad4-4d6c-b2f8-b53d70600eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:00.744894 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242216b-3ad4-4d6c-b2f8-b53d70600eab admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:00.763331 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce658430-e933-44c8-a574-ae0e7aa29be9 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:00.769344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1354/2677] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:30:00.770695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242216b-3ad4-4d6c-b2f8-b53d70600eab admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:00.777313 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57855fa-c78b-45b8-a7a0-b5852eef6c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:00.781006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57855fa-c78b-45b8-a7a0-b5852eef6c03 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:00.781611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57855fa-c78b-45b8-a7a0-b5852eef6c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:00.786929 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57855fa-c78b-45b8-a7a0-b5852eef6c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:00.786929 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57855fa-c78b-45b8-a7a0-b5852eef6c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:00.787218 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242216b-3ad4-4d6c-b2f8-b53d70600eab admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:00.787337 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57855fa-c78b-45b8-a7a0-b5852eef6c03 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:00.792211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57edb2-42d6-40f2-ad26-e2b3a433f923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:00.792910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57edb2-42d6-40f2-ad26-e2b3a433f923 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:00.793400 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57edb2-42d6-40f2-ad26-e2b3a433f923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:00.794600 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57edb2-42d6-40f2-ad26-e2b3a433f923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:00.795351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57edb2-42d6-40f2-ad26-e2b3a433f923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:00.797281 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57edb2-42d6-40f2-ad26-e2b3a433f923 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:00.818077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1355/2678] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:30:00.819714 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57edb2-42d6-40f2-ad26-e2b3a433f923 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:00.834924 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57edb2-42d6-40f2-ad26-e2b3a433f923 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:00.843905 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87bc4c-9f50-4626-8254-3c2edce253fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:00.844618 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87bc4c-9f50-4626-8254-3c2edce253fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:00.845052 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87bc4c-9f50-4626-8254-3c2edce253fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:00.845513 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87bc4c-9f50-4626-8254-3c2edce253fa admin admin] PATH_INFO: `/v3/projects/64067ae124f64d61869d31e4092ce8ae/users/fdc79ae76a0e4d99a6ad831ec7c252f7/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:00.882764 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87bc4c-9f50-4626-8254-3c2edce253fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=64067ae124f64d61869d31e4092ce8ae, user_id=fdc79ae76a0e4d99a6ad831ec7c252f7, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:00.888710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87bc4c-9f50-4626-8254-3c2edce253fa admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:01.031772 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1324/2679] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:30:00 2022] POST /identity/v3/projects => generated 371 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:30:01.039797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57855fa-c78b-45b8-a7a0-b5852eef6c03 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:01.057929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:01.073007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1356/2680] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:30:00 2022] PUT /identity/v3/projects/64067ae124f64d61869d31e4092ce8ae/users/fdc79ae76a0e4d99a6ad831ec7c252f7/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:30:01.093023 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff057f4f-60ee-4fe0-82c9-cc3d1ab4a89d None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:01.093458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff057f4f-60ee-4fe0-82c9-cc3d1ab4a89d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:01.094076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff057f4f-60ee-4fe0-82c9-cc3d1ab4a89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:01.153629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-ff057f4f-60ee-4fe0-82c9-cc3d1ab4a89d None None] MFA Rules not processed for user `fdc79ae76a0e4d99a6ad831ec7c252f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:01.155013 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ff057f4f-60ee-4fe0-82c9-cc3d1ab4a89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:01.192824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57855fa-c78b-45b8-a7a0-b5852eef6c03 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:01.284980 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:01.305736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1357/2681] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:30:01.317553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c82c99-f329-4855-b17b-62001c9f8e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:01.320183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c82c99-f329-4855-b17b-62001c9f8e03 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:01.320183 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c82c99-f329-4855-b17b-62001c9f8e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:01.320455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c82c99-f329-4855-b17b-62001c9f8e03 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:01.321862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c82c99-f329-4855-b17b-62001c9f8e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:01.330969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff057f4f-60ee-4fe0-82c9-cc3d1ab4a89d None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:01.334025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ff057f4f-60ee-4fe0-82c9-cc3d1ab4a89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:01.339671 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c82c99-f329-4855-b17b-62001c9f8e03 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:01.426651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff057f4f-60ee-4fe0-82c9-cc3d1ab4a89d None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:01.431791 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18722ef8-6732-4d98-96ac-5253ddf860ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:01.432444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18722ef8-6732-4d98-96ac-5253ddf860ca service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:01.432730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18722ef8-6732-4d98-96ac-5253ddf860ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:01.433011 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18722ef8-6732-4d98-96ac-5253ddf860ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:01.444847 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18722ef8-6732-4d98-96ac-5253ddf860ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:01.447413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18722ef8-6732-4d98-96ac-5253ddf860ca service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:01.468163 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1325/2682] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:30:01 2022] POST /identity/v3/users => generated 286 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:30:01.469840 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1358/2683] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:30:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:30:01.477117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c82c99-f329-4855-b17b-62001c9f8e03 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:01.506105 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c82c99-f329-4855-b17b-62001c9f8e03 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:01.518060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b56773-0710-420e-b9fe-0437931e5be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:01.519027 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b56773-0710-420e-b9fe-0437931e5be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:01.520344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b56773-0710-420e-b9fe-0437931e5be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:01.520630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b56773-0710-420e-b9fe-0437931e5be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:01.521393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b56773-0710-420e-b9fe-0437931e5be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:01.524046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b56773-0710-420e-b9fe-0437931e5be2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:01.550941 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1326/2684] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:30:01.554596 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18722ef8-6732-4d98-96ac-5253ddf860ca service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:01.575266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18722ef8-6732-4d98-96ac-5253ddf860ca service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:01.584005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988ff13-cc42-4575-96fc-cb1c8753a695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:01.584950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988ff13-cc42-4575-96fc-cb1c8753a695 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:01.586303 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988ff13-cc42-4575-96fc-cb1c8753a695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:01.586801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988ff13-cc42-4575-96fc-cb1c8753a695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:01.587757 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988ff13-cc42-4575-96fc-cb1c8753a695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:01.589946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988ff13-cc42-4575-96fc-cb1c8753a695 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:01.617334 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1359/2685] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:30:01.620421 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b56773-0710-420e-b9fe-0437931e5be2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:01.633343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b56773-0710-420e-b9fe-0437931e5be2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:01.640513 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0baf85-69b1-45d6-9b48-3dfdd33bf92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:01.641323 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0baf85-69b1-45d6-9b48-3dfdd33bf92c admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:01.641673 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0baf85-69b1-45d6-9b48-3dfdd33bf92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:01.642038 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0baf85-69b1-45d6-9b48-3dfdd33bf92c admin admin] PATH_INFO: `/v3/projects/628dc57a82d44f8ebbbeb7f1afac5dde/users/a4b59fcf56f7446799135566cb42fe9b/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:01.663586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0baf85-69b1-45d6-9b48-3dfdd33bf92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=628dc57a82d44f8ebbbeb7f1afac5dde, user_id=a4b59fcf56f7446799135566cb42fe9b, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:01.668245 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0baf85-69b1-45d6-9b48-3dfdd33bf92c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:01.821433 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1327/2686] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:30:01 2022] PUT /identity/v3/projects/628dc57a82d44f8ebbbeb7f1afac5dde/users/a4b59fcf56f7446799135566cb42fe9b/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:30:01.836680 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e6b0d-f23f-41db-9de1-dcd1ef4dbc55 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:01.837454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e6b0d-f23f-41db-9de1-dcd1ef4dbc55 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:01.837454 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e6b0d-f23f-41db-9de1-dcd1ef4dbc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:01.885314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-732e6b0d-f23f-41db-9de1-dcd1ef4dbc55 None None] MFA Rules not processed for user `a4b59fcf56f7446799135566cb42fe9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:01.915421 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-732e6b0d-f23f-41db-9de1-dcd1ef4dbc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:01.999721 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1360/2687] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:30:02.019788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0baf85-69b1-45d6-9b48-3dfdd33bf92c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:02.022841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4a0baf85-69b1-45d6-9b48-3dfdd33bf92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:02.149283 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0baf85-69b1-45d6-9b48-3dfdd33bf92c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:02.156879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11dfe9-a454-45dc-9e0b-9a8f8a3c2de1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:02.158023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11dfe9-a454-45dc-9e0b-9a8f8a3c2de1 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:02.158571 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11dfe9-a454-45dc-9e0b-9a8f8a3c2de1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:02.159129 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11dfe9-a454-45dc-9e0b-9a8f8a3c2de1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:02.176887 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11dfe9-a454-45dc-9e0b-9a8f8a3c2de1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:02.179873 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11dfe9-a454-45dc-9e0b-9a8f8a3c2de1 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:02.195824 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1328/2688] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:30:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:30:02.236302 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e6b0d-f23f-41db-9de1-dcd1ef4dbc55 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:02.254843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:02.338814 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e6b0d-f23f-41db-9de1-dcd1ef4dbc55 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:02.345586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f41ed-007b-491b-b1b1-d511cd2ecaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:02.346271 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f41ed-007b-491b-b1b1-d511cd2ecaac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:02.346593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f41ed-007b-491b-b1b1-d511cd2ecaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:02.346880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f41ed-007b-491b-b1b1-d511cd2ecaac admin admin] PATH_INFO: `/v3/users/a4b59fcf56f7446799135566cb42fe9b` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:02.348192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f41ed-007b-491b-b1b1-d511cd2ecaac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b59fcf56f7446799135566cb42fe9b)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:02.350922 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f41ed-007b-491b-b1b1-d511cd2ecaac admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:02.669198 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bf0f41ed-007b-491b-b1b1-d511cd2ecaac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b59fcf56f7446799135566cb42fe9b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:02.670219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bf0f41ed-007b-491b-b1b1-d511cd2ecaac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b59fcf56f7446799135566cb42fe9b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:02.689739 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bf0f41ed-007b-491b-b1b1-d511cd2ecaac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b59fcf56f7446799135566cb42fe9b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:02.770939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bf0f41ed-007b-491b-b1b1-d511cd2ecaac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b59fcf56f7446799135566cb42fe9b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:02.771926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bf0f41ed-007b-491b-b1b1-d511cd2ecaac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b59fcf56f7446799135566cb42fe9b'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:02.790160 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1361/2689] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:30:02 2022] DELETE /identity/v3/users/a4b59fcf56f7446799135566cb42fe9b => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:30:02.796300 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a100944-a96c-43a3-a552-b2556d7bd3bd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:02.796719 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a100944-a96c-43a3-a552-b2556d7bd3bd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:02.797087 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a100944-a96c-43a3-a552-b2556d7bd3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:02.820302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2a100944-a96c-43a3-a552-b2556d7bd3bd None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:02.821734 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2a100944-a96c-43a3-a552-b2556d7bd3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:02.910610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1329/2690] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:30:02.922249 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f41ed-007b-491b-b1b1-d511cd2ecaac admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:02.923890 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-bf0f41ed-007b-491b-b1b1-d511cd2ecaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:03.027634 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f41ed-007b-491b-b1b1-d511cd2ecaac admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:03.033446 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10581e0-39fc-4770-9016-c1ecdc942e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:03.034178 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10581e0-39fc-4770-9016-c1ecdc942e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:03.034719 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10581e0-39fc-4770-9016-c1ecdc942e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:03.035076 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10581e0-39fc-4770-9016-c1ecdc942e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:03.046947 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10581e0-39fc-4770-9016-c1ecdc942e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:03.048415 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10581e0-39fc-4770-9016-c1ecdc942e15 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:03.061017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1362/2691] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:30:03.791005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a100944-a96c-43a3-a552-b2556d7bd3bd None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:03.794220 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2a100944-a96c-43a3-a552-b2556d7bd3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:03.819111 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a100944-a96c-43a3-a552-b2556d7bd3bd None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:03.832797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0d608-3621-4b1d-8f70-b73ae3568150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:03.834726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0d608-3621-4b1d-8f70-b73ae3568150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:03.834726 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0d608-3621-4b1d-8f70-b73ae3568150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:03.835057 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0d608-3621-4b1d-8f70-b73ae3568150 admin admin] PATH_INFO: `/v3/projects/628dc57a82d44f8ebbbeb7f1afac5dde` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:03.837582 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0d608-3621-4b1d-8f70-b73ae3568150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=628dc57a82d44f8ebbbeb7f1afac5dde)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:03.841131 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0d608-3621-4b1d-8f70-b73ae3568150 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:03.977498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:03.990936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-83e0d608-3621-4b1d-8f70-b73ae3568150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '628dc57a82d44f8ebbbeb7f1afac5dde', 'request_id': 'req-83e0d608-3621-4b1d-8f70-b73ae3568150'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:03.999358 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-83e0d608-3621-4b1d-8f70-b73ae3568150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '628dc57a82d44f8ebbbeb7f1afac5dde', 'request_id': 'req-83e0d608-3621-4b1d-8f70-b73ae3568150'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:04.016137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-83e0d608-3621-4b1d-8f70-b73ae3568150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '628dc57a82d44f8ebbbeb7f1afac5dde', 'request_id': 'req-83e0d608-3621-4b1d-8f70-b73ae3568150'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:04.154142 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-83e0d608-3621-4b1d-8f70-b73ae3568150 admin admin] The token cache is being invalidate because project 628dc57a82d44f8ebbbeb7f1afac5dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:30:04.157769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-83e0d608-3621-4b1d-8f70-b73ae3568150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:04.157769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-83e0d608-3621-4b1d-8f70-b73ae3568150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:04.157769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1330/2692] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:30:03 2022] DELETE /identity/v3/projects/628dc57a82d44f8ebbbeb7f1afac5dde => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:30:13.054771 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=75,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:14.222333 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=11,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:40.346911 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10581e0-39fc-4770-9016-c1ecdc942e15 service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:40.348472 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c10581e0-39fc-4770-9016-c1ecdc942e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:40.424627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10581e0-39fc-4770-9016-c1ecdc942e15 service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:40.486820 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc07b2-b7cd-4c0b-a881-c845a55e9e30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:40.487378 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc07b2-b7cd-4c0b-a881-c845a55e9e30 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:40.487662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc07b2-b7cd-4c0b-a881-c845a55e9e30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:40.487939 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc07b2-b7cd-4c0b-a881-c845a55e9e30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:40.490181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-19dc07b2-b7cd-4c0b-a881-c845a55e9e30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:40.584147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc07b2-b7cd-4c0b-a881-c845a55e9e30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:40.585608 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc07b2-b7cd-4c0b-a881-c845a55e9e30 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:40.600175 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1363/2693] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:30:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:30:42.404508 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0d608-3621-4b1d-8f70-b73ae3568150 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:42.406610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-83e0d608-3621-4b1d-8f70-b73ae3568150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:42.484850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0d608-3621-4b1d-8f70-b73ae3568150 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:42.489750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd73f5-dbed-4935-9426-9c366eefe5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:42.490447 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd73f5-dbed-4935-9426-9c366eefe5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:42.490733 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd73f5-dbed-4935-9426-9c366eefe5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:42.491005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd73f5-dbed-4935-9426-9c366eefe5cf admin admin] PATH_INFO: `/v3/users/fdc79ae76a0e4d99a6ad831ec7c252f7` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:42.499827 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd73f5-dbed-4935-9426-9c366eefe5cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc79ae76a0e4d99a6ad831ec7c252f7)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:42.502856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd73f5-dbed-4935-9426-9c366eefe5cf admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:42.781831 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-01dd73f5-dbed-4935-9426-9c366eefe5cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc79ae76a0e4d99a6ad831ec7c252f7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:42.782673 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-01dd73f5-dbed-4935-9426-9c366eefe5cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc79ae76a0e4d99a6ad831ec7c252f7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:42.798854 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-01dd73f5-dbed-4935-9426-9c366eefe5cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc79ae76a0e4d99a6ad831ec7c252f7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:42.799661 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-01dd73f5-dbed-4935-9426-9c366eefe5cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc79ae76a0e4d99a6ad831ec7c252f7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:42.981954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-01dd73f5-dbed-4935-9426-9c366eefe5cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc79ae76a0e4d99a6ad831ec7c252f7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:42.998024 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1331/2694] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:30:42 2022] DELETE /identity/v3/users/fdc79ae76a0e4d99a6ad831ec7c252f7 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:30:43.002873 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adad6a-d51d-4a3d-9db7-4b0588336f9f None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:43.003406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adad6a-d51d-4a3d-9db7-4b0588336f9f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:43.003525 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adad6a-d51d-4a3d-9db7-4b0588336f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:43.026139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-72adad6a-d51d-4a3d-9db7-4b0588336f9f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:43.028215 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-72adad6a-d51d-4a3d-9db7-4b0588336f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:43.085649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=100 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:43.096391 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1364/2695] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:30:43.108484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd73f5-dbed-4935-9426-9c366eefe5cf admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:43.111983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-01dd73f5-dbed-4935-9426-9c366eefe5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:43.180518 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd73f5-dbed-4935-9426-9c366eefe5cf admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:43.185303 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0734b8-d955-4f69-a359-5a4807a73eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:43.185950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0734b8-d955-4f69-a359-5a4807a73eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:43.186238 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0734b8-d955-4f69-a359-5a4807a73eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:43.186551 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0734b8-d955-4f69-a359-5a4807a73eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:43.196993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0734b8-d955-4f69-a359-5a4807a73eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:43.199085 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0734b8-d955-4f69-a359-5a4807a73eb7 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:43.213592 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1332/2696] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:30:43.914106 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adad6a-d51d-4a3d-9db7-4b0588336f9f None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:43.916043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-72adad6a-d51d-4a3d-9db7-4b0588336f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:43.947728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adad6a-d51d-4a3d-9db7-4b0588336f9f None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:43.948208 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7dbee-8ac9-4f82-bbd2-3a35a057d8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:43.949162 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7dbee-8ac9-4f82-bbd2-3a35a057d8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:43.949619 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7dbee-8ac9-4f82-bbd2-3a35a057d8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:43.950091 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7dbee-8ac9-4f82-bbd2-3a35a057d8ac admin admin] PATH_INFO: `/v3/projects/64067ae124f64d61869d31e4092ce8ae` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:43.953623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7dbee-8ac9-4f82-bbd2-3a35a057d8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=64067ae124f64d61869d31e4092ce8ae)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:43.956016 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7dbee-8ac9-4f82-bbd2-3a35a057d8ac admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:44.130564 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-cfa7dbee-8ac9-4f82-bbd2-3a35a057d8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64067ae124f64d61869d31e4092ce8ae', 'request_id': 'req-cfa7dbee-8ac9-4f82-bbd2-3a35a057d8ac'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:44.283283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-cfa7dbee-8ac9-4f82-bbd2-3a35a057d8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64067ae124f64d61869d31e4092ce8ae', 'request_id': 'req-cfa7dbee-8ac9-4f82-bbd2-3a35a057d8ac'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:44.295221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-cfa7dbee-8ac9-4f82-bbd2-3a35a057d8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64067ae124f64d61869d31e4092ce8ae', 'request_id': 'req-cfa7dbee-8ac9-4f82-bbd2-3a35a057d8ac'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:44.318218 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-cfa7dbee-8ac9-4f82-bbd2-3a35a057d8ac admin admin] The token cache is being invalidate because project 64067ae124f64d61869d31e4092ce8ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:30:44.318565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-cfa7dbee-8ac9-4f82-bbd2-3a35a057d8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:44.319595 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-cfa7dbee-8ac9-4f82-bbd2-3a35a057d8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:30:44.327197 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1365/2697] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:30:43 2022] DELETE /identity/v3/projects/64067ae124f64d61869d31e4092ce8ae => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:30:44.329188 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed655c0a-9577-4327-87ad-bddd79b49579 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:44.329694 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed655c0a-9577-4327-87ad-bddd79b49579 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:44.329790 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed655c0a-9577-4327-87ad-bddd79b49579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:44.366217 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ed655c0a-9577-4327-87ad-bddd79b49579 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:44.366950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ed655c0a-9577-4327-87ad-bddd79b49579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:44.406025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:44.472988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1333/2698] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:30:44.486647 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378dfde-9144-4924-bbb8-57f41e3bf3a5 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:44.486962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378dfde-9144-4924-bbb8-57f41e3bf3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:44.487537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378dfde-9144-4924-bbb8-57f41e3bf3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:44.517828 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d378dfde-9144-4924-bbb8-57f41e3bf3a5 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:44.519978 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d378dfde-9144-4924-bbb8-57f41e3bf3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:44.537288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1366/2699] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:30:44.547745 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed655c0a-9577-4327-87ad-bddd79b49579 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:44.566218 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed655c0a-9577-4327-87ad-bddd79b49579 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:44.574705 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d3b91-69f0-4fff-a054-eb0ee17c8f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:44.575358 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d3b91-69f0-4fff-a054-eb0ee17c8f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:44.575696 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d3b91-69f0-4fff-a054-eb0ee17c8f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:44.575968 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d3b91-69f0-4fff-a054-eb0ee17c8f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:44.576625 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d3b91-69f0-4fff-a054-eb0ee17c8f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:30:44.576932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d3b91-69f0-4fff-a054-eb0ee17c8f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:44.578730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d3b91-69f0-4fff-a054-eb0ee17c8f08 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:44.604749 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1334/2700] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:30:44.606028 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378dfde-9144-4924-bbb8-57f41e3bf3a5 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:44.618709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378dfde-9144-4924-bbb8-57f41e3bf3a5 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:44.626480 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104ea5c-ecca-447a-a18d-514624280959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:44.628705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104ea5c-ecca-447a-a18d-514624280959 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:44.628705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104ea5c-ecca-447a-a18d-514624280959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:44.628705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104ea5c-ecca-447a-a18d-514624280959 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:44.628705 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104ea5c-ecca-447a-a18d-514624280959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:44.630394 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104ea5c-ecca-447a-a18d-514624280959 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:44.835961 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1367/2701] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:30:44 2022] POST /identity/v3/projects => generated 381 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:30:44.837923 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d3b91-69f0-4fff-a054-eb0ee17c8f08 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:44.859075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d3b91-69f0-4fff-a054-eb0ee17c8f08 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:44.950040 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7b8cd-6445-481d-b7d8-f94852d78b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:44.952514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7b8cd-6445-481d-b7d8-f94852d78b0c admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:44.952514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7b8cd-6445-481d-b7d8-f94852d78b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:44.952514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7b8cd-6445-481d-b7d8-f94852d78b0c admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:44.953416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7b8cd-6445-481d-b7d8-f94852d78b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:44.957294 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7b8cd-6445-481d-b7d8-f94852d78b0c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:45.122778 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1335/2702] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:30:44 2022] POST /identity/v3/users => generated 291 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:30:45.124769 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104ea5c-ecca-447a-a18d-514624280959 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:45.140565 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104ea5c-ecca-447a-a18d-514624280959 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:45.147318 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b5e84-86a6-4980-a74b-ff22a02c60cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:45.147957 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b5e84-86a6-4980-a74b-ff22a02c60cc admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:45.148239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b5e84-86a6-4980-a74b-ff22a02c60cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:45.148511 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b5e84-86a6-4980-a74b-ff22a02c60cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:45.149219 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b5e84-86a6-4980-a74b-ff22a02c60cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:45.152227 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b5e84-86a6-4980-a74b-ff22a02c60cc admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:45.165184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1368/2703] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:30:45.170790 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7b8cd-6445-481d-b7d8-f94852d78b0c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:45.183988 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7b8cd-6445-481d-b7d8-f94852d78b0c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:45.190782 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdd29c-bed7-45cb-9b43-43ab587408b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:45.191432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdd29c-bed7-45cb-9b43-43ab587408b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:45.191725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdd29c-bed7-45cb-9b43-43ab587408b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:45.192022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdd29c-bed7-45cb-9b43-43ab587408b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:45.192948 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdd29c-bed7-45cb-9b43-43ab587408b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:45.194840 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdd29c-bed7-45cb-9b43-43ab587408b0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:45.207695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1336/2704] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:30:45.212455 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b5e84-86a6-4980-a74b-ff22a02c60cc admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:45.224908 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b5e84-86a6-4980-a74b-ff22a02c60cc admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:45.231387 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34494f4-509e-4e63-bba9-4b3b1dfdb757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:45.232077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34494f4-509e-4e63-bba9-4b3b1dfdb757 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:45.232374 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34494f4-509e-4e63-bba9-4b3b1dfdb757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:45.232656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34494f4-509e-4e63-bba9-4b3b1dfdb757 admin admin] PATH_INFO: `/v3/projects/d068df362d7e41dabc45f7ec1631f00c/users/0a01e95be96f494e924faeca9e6e0679/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:45.250307 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34494f4-509e-4e63-bba9-4b3b1dfdb757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d068df362d7e41dabc45f7ec1631f00c, user_id=0a01e95be96f494e924faeca9e6e0679, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:45.253296 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34494f4-509e-4e63-bba9-4b3b1dfdb757 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:45.390531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1369/2705] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:30:45 2022] PUT /identity/v3/projects/d068df362d7e41dabc45f7ec1631f00c/users/0a01e95be96f494e924faeca9e6e0679/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:30:45.395880 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9937cc0-fca4-44ac-89b0-73b1ecb98023 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:45.396711 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9937cc0-fca4-44ac-89b0-73b1ecb98023 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:45.396711 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9937cc0-fca4-44ac-89b0-73b1ecb98023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:45.419160 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f9937cc0-fca4-44ac-89b0-73b1ecb98023 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:45.420391 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f9937cc0-fca4-44ac-89b0-73b1ecb98023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:45.519664 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1337/2706] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:30:45.536798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34494f4-509e-4e63-bba9-4b3b1dfdb757 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:45.541318 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-f34494f4-509e-4e63-bba9-4b3b1dfdb757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:45.646507 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34494f4-509e-4e63-bba9-4b3b1dfdb757 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:45.652864 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9937cc0-fca4-44ac-89b0-73b1ecb98023 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:45.655202 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f9937cc0-fca4-44ac-89b0-73b1ecb98023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:45.657651 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38b867-ba3b-44df-a012-33d91f38af23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:45.658780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38b867-ba3b-44df-a012-33d91f38af23 service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:45.658986 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38b867-ba3b-44df-a012-33d91f38af23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:45.659372 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38b867-ba3b-44df-a012-33d91f38af23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:45.673285 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38b867-ba3b-44df-a012-33d91f38af23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:45.674812 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38b867-ba3b-44df-a012-33d91f38af23 service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:45.689223 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1370/2707] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:30:45.713143 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:45.748005 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9937cc0-fca4-44ac-89b0-73b1ecb98023 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:45.751708 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2075ebc-667c-4a44-9a67-a5a9e11cb7a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:45.752338 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2075ebc-667c-4a44-9a67-a5a9e11cb7a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:45.752616 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2075ebc-667c-4a44-9a67-a5a9e11cb7a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:45.752946 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2075ebc-667c-4a44-9a67-a5a9e11cb7a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:45.754862 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a2075ebc-667c-4a44-9a67-a5a9e11cb7a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:45.851429 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2075ebc-667c-4a44-9a67-a5a9e11cb7a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:45.853760 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2075ebc-667c-4a44-9a67-a5a9e11cb7a6 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:45.866674 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1338/2708] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:30:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:30:47.876916 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52750177-224f-4288-8d9b-5e9813c23afb None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:47.884187 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52750177-224f-4288-8d9b-5e9813c23afb None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:47.884187 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52750177-224f-4288-8d9b-5e9813c23afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:47.923776 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-52750177-224f-4288-8d9b-5e9813c23afb None None] MFA Rules not processed for user `0a01e95be96f494e924faeca9e6e0679`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:47.925232 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-52750177-224f-4288-8d9b-5e9813c23afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:47.938275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:48.011849 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1371/2709] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:30:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:30:48.031707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2075ebc-667c-4a44-9a67-a5a9e11cb7a6 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:48.035398 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a2075ebc-667c-4a44-9a67-a5a9e11cb7a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:48.048116 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2075ebc-667c-4a44-9a67-a5a9e11cb7a6 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:48.054250 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b93e5-4f28-4f37-87d0-71b4f86a8bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:48.055342 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b93e5-4f28-4f37-87d0-71b4f86a8bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:48.055342 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b93e5-4f28-4f37-87d0-71b4f86a8bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:48.055571 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b93e5-4f28-4f37-87d0-71b4f86a8bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:48.067451 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b93e5-4f28-4f37-87d0-71b4f86a8bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:48.068951 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b93e5-4f28-4f37-87d0-71b4f86a8bd6 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:48.081491 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1339/2710] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:30:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:30:51.647845 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87b24a-e3bd-49a9-8e9c-b93418204009 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:51.648683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87b24a-e3bd-49a9-8e9c-b93418204009 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:51.648937 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87b24a-e3bd-49a9-8e9c-b93418204009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:51.675641 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-bf87b24a-e3bd-49a9-8e9c-b93418204009 None None] MFA Rules not processed for user `0a01e95be96f494e924faeca9e6e0679`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:51.676936 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-bf87b24a-e3bd-49a9-8e9c-b93418204009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:51.686901 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1372/2711] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:30:58.076483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=47 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:00.762597 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece5c3f-cb8e-4d7b-b854-a7b8594a3272 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:00.763496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece5c3f-cb8e-4d7b-b854-a7b8594a3272 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:00.763496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece5c3f-cb8e-4d7b-b854-a7b8594a3272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:00.784038 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3ece5c3f-cb8e-4d7b-b854-a7b8594a3272 None None] MFA Rules not processed for user `66a1a31e3bfb4b929965a6e52bd6ec72`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:00.785289 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3ece5c3f-cb8e-4d7b-b854-a7b8594a3272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:00.848676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1340/2712] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:31:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:01.669293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=26 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:10.841251 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=25 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:14.361119 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87b24a-e3bd-49a9-8e9c-b93418204009 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:14.379926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87b24a-e3bd-49a9-8e9c-b93418204009 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:14.387218 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f345a1-98c8-43e7-aa6c-1b9fa4b6b24d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:14.388749 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f345a1-98c8-43e7-aa6c-1b9fa4b6b24d service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:14.389246 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f345a1-98c8-43e7-aa6c-1b9fa4b6b24d service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:14.389741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f345a1-98c8-43e7-aa6c-1b9fa4b6b24d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:14.392978 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b2f345a1-98c8-43e7-aa6c-1b9fa4b6b24d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:14.409366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f345a1-98c8-43e7-aa6c-1b9fa4b6b24d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:14.409366 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f345a1-98c8-43e7-aa6c-1b9fa4b6b24d service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:14.419891 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1373/2713] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:31:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:31:20.112578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece5c3f-cb8e-4d7b-b854-a7b8594a3272 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:20.114155 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3ece5c3f-cb8e-4d7b-b854-a7b8594a3272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:20.136349 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece5c3f-cb8e-4d7b-b854-a7b8594a3272 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:20.142247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a4fb0-0683-48cd-8c24-04067afe9166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:20.143003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a4fb0-0683-48cd-8c24-04067afe9166 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:20.143205 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a4fb0-0683-48cd-8c24-04067afe9166 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:20.143492 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a4fb0-0683-48cd-8c24-04067afe9166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:20.145683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-170a4fb0-0683-48cd-8c24-04067afe9166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:20.162938 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a4fb0-0683-48cd-8c24-04067afe9166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:20.164567 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a4fb0-0683-48cd-8c24-04067afe9166 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:20.177199 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1341/2714] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:31:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:31:24.414459 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=6 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:30.172169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=6 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:33.290065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b50bc5-2327-46fb-bfb5-6830c6d7c87c None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:33.290768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b50bc5-2327-46fb-bfb5-6830c6d7c87c None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:33.290768 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b50bc5-2327-46fb-bfb5-6830c6d7c87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:33.312437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-36b50bc5-2327-46fb-bfb5-6830c6d7c87c None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:33.313696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-36b50bc5-2327-46fb-bfb5-6830c6d7c87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:33.321973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1374/2715] 10.222.0.122 () {58 vars in 1017 bytes} [Tue Jul 26 15:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:33.347589 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a4fb0-0683-48cd-8c24-04067afe9166 service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:33.360996 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a4fb0-0683-48cd-8c24-04067afe9166 service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:33.367530 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d3d85-a34a-4b7a-8634-8c88421a567c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:33.368171 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d3d85-a34a-4b7a-8634-8c88421a567c service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:33.368710 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d3d85-a34a-4b7a-8634-8c88421a567c service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:33.368987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d3d85-a34a-4b7a-8634-8c88421a567c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:33.379629 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d3d85-a34a-4b7a-8634-8c88421a567c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:33.381232 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d3d85-a34a-4b7a-8634-8c88421a567c service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:33.392529 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1342/2716] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:31:38.896190 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae05138-e786-4b8e-bee2-2836e1a4ca6e None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:38.901872 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae05138-e786-4b8e-bee2-2836e1a4ca6e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:38.901872 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae05138-e786-4b8e-bee2-2836e1a4ca6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:38.917992 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-3ae05138-e786-4b8e-bee2-2836e1a4ca6e None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:38.919244 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3ae05138-e786-4b8e-bee2-2836e1a4ca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:38.928780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1375/2717] 10.222.0.122 () {58 vars in 1017 bytes} [Tue Jul 26 15:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:38.954372 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d3d85-a34a-4b7a-8634-8c88421a567c service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:38.959015 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5a5d3d85-a34a-4b7a-8634-8c88421a567c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:38.970730 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d3d85-a34a-4b7a-8634-8c88421a567c service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:38.976516 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01bb1f-47e7-4c37-9e9f-18fe4d7774fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:38.977125 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01bb1f-47e7-4c37-9e9f-18fe4d7774fe service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:38.977406 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01bb1f-47e7-4c37-9e9f-18fe4d7774fe service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:38.977681 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01bb1f-47e7-4c37-9e9f-18fe4d7774fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:38.986489 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01bb1f-47e7-4c37-9e9f-18fe4d7774fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:38.988075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01bb1f-47e7-4c37-9e9f-18fe4d7774fe service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:38.998893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1343/2718] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:31:43.755926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3ff03-a3d5-4f84-aa1f-c314086bd817 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:43.756496 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3ff03-a3d5-4f84-aa1f-c314086bd817 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:43.756496 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3ff03-a3d5-4f84-aa1f-c314086bd817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:43.777809 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a4e3ff03-a3d5-4f84-aa1f-c314086bd817 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:43.780524 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a4e3ff03-a3d5-4f84-aa1f-c314086bd817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:43.788673 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1376/2719] 10.222.0.122 () {58 vars in 1017 bytes} [Tue Jul 26 15:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:43.814032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01bb1f-47e7-4c37-9e9f-18fe4d7774fe service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:43.826655 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01bb1f-47e7-4c37-9e9f-18fe4d7774fe service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:43.832335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fd7dc-f750-4766-b37b-83db383c011b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:43.832950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fd7dc-f750-4766-b37b-83db383c011b service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:43.833233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fd7dc-f750-4766-b37b-83db383c011b service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:43.833508 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fd7dc-f750-4766-b37b-83db383c011b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:43.843219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fd7dc-f750-4766-b37b-83db383c011b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:43.844844 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fd7dc-f750-4766-b37b-83db383c011b service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:43.856220 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1344/2720] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:31:47.423956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89822fe-51b6-487f-a2c6-91af9545cb1f None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:47.424537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89822fe-51b6-487f-a2c6-91af9545cb1f None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:47.424537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89822fe-51b6-487f-a2c6-91af9545cb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:47.446055 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-b89822fe-51b6-487f-a2c6-91af9545cb1f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:47.447438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-b89822fe-51b6-487f-a2c6-91af9545cb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:47.456613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1377/2721] 10.222.0.122 () {58 vars in 1017 bytes} [Tue Jul 26 15:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:47.484550 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fd7dc-f750-4766-b37b-83db383c011b service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:47.498876 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fd7dc-f750-4766-b37b-83db383c011b service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:47.504905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9dbe0-a1c7-4d8b-8482-e7d839704876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:47.505535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9dbe0-a1c7-4d8b-8482-e7d839704876 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:47.505821 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9dbe0-a1c7-4d8b-8482-e7d839704876 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:47.506201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9dbe0-a1c7-4d8b-8482-e7d839704876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:47.515704 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9dbe0-a1c7-4d8b-8482-e7d839704876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:47.517380 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9dbe0-a1c7-4d8b-8482-e7d839704876 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:47.528459 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1345/2722] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:31:50.684128 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911315-d764-4914-bdcd-61e53bd4a3dc None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:50.684671 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911315-d764-4914-bdcd-61e53bd4a3dc None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:50.684671 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911315-d764-4914-bdcd-61e53bd4a3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:50.705272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d1911315-d764-4914-bdcd-61e53bd4a3dc None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:50.706622 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d1911315-d764-4914-bdcd-61e53bd4a3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:50.715384 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1378/2723] 10.222.0.122 () {58 vars in 1017 bytes} [Tue Jul 26 15:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:50.748972 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9dbe0-a1c7-4d8b-8482-e7d839704876 service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:50.761248 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9dbe0-a1c7-4d8b-8482-e7d839704876 service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:50.769055 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe760e4e-5dd4-4bdd-bfb7-31684a7dbb35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:50.769752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe760e4e-5dd4-4bdd-bfb7-31684a7dbb35 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:50.770036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe760e4e-5dd4-4bdd-bfb7-31684a7dbb35 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:50.770308 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe760e4e-5dd4-4bdd-bfb7-31684a7dbb35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:50.781673 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe760e4e-5dd4-4bdd-bfb7-31684a7dbb35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:50.794148 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe760e4e-5dd4-4bdd-bfb7-31684a7dbb35 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:50.795805 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1346/2724] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:31:54.012442 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4783744-a6ba-4966-b08f-630507c24289 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:54.013025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4783744-a6ba-4966-b08f-630507c24289 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:54.013025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4783744-a6ba-4966-b08f-630507c24289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:54.034962 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-c4783744-a6ba-4966-b08f-630507c24289 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:54.036355 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c4783744-a6ba-4966-b08f-630507c24289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:54.045549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1379/2725] 10.222.0.122 () {58 vars in 1017 bytes} [Tue Jul 26 15:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:54.077136 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe760e4e-5dd4-4bdd-bfb7-31684a7dbb35 service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:54.093389 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe760e4e-5dd4-4bdd-bfb7-31684a7dbb35 service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:54.099707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314af11-3073-46a7-b5f7-20515a4e4ea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:54.100357 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314af11-3073-46a7-b5f7-20515a4e4ea9 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:54.100636 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314af11-3073-46a7-b5f7-20515a4e4ea9 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:54.100910 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314af11-3073-46a7-b5f7-20515a4e4ea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:54.111436 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314af11-3073-46a7-b5f7-20515a4e4ea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:54.113079 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314af11-3073-46a7-b5f7-20515a4e4ea9 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:54.125003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1347/2726] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:31:56.624700 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4783744-a6ba-4966-b08f-630507c24289 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:56.631684 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=19 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:56.639340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4783744-a6ba-4966-b08f-630507c24289 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:56.646710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f958d0-899d-4b64-bfb3-fb34fa5e578b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:56.647392 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f958d0-899d-4b64-bfb3-fb34fa5e578b service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:56.647686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f958d0-899d-4b64-bfb3-fb34fa5e578b service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:56.648031 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f958d0-899d-4b64-bfb3-fb34fa5e578b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:56.651206 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e8f958d0-899d-4b64-bfb3-fb34fa5e578b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:56.663839 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f958d0-899d-4b64-bfb3-fb34fa5e578b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:56.665443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f958d0-899d-4b64-bfb3-fb34fa5e578b service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:56.675818 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1380/2727] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:31:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:32:04.119709 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=36 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:05.705951 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314af11-3073-46a7-b5f7-20515a4e4ea9 service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:05.719633 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314af11-3073-46a7-b5f7-20515a4e4ea9 service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:05.726177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cda61-065f-44c0-8204-7776287583ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:05.726889 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cda61-065f-44c0-8204-7776287583ab service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:05.727184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cda61-065f-44c0-8204-7776287583ab service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:05.727492 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cda61-065f-44c0-8204-7776287583ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:05.729721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b66cda61-065f-44c0-8204-7776287583ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:05.744527 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cda61-065f-44c0-8204-7776287583ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:05.746230 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cda61-065f-44c0-8204-7776287583ab service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:05.758506 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1348/2728] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:32:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:32:06.735153 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=5 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:12.143801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf6357-973d-4dd1-925b-1a73828bad52 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:12.145200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf6357-973d-4dd1-925b-1a73828bad52 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:12.145200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf6357-973d-4dd1-925b-1a73828bad52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:12.167404 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-eadf6357-973d-4dd1-925b-1a73828bad52 None None] MFA Rules not processed for user `0a01e95be96f494e924faeca9e6e0679`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:12.169033 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-eadf6357-973d-4dd1-925b-1a73828bad52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:12.177806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1381/2729] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:32:12.462342 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cda61-065f-44c0-8204-7776287583ab service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:12.464011 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b66cda61-065f-44c0-8204-7776287583ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:12.477827 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cda61-065f-44c0-8204-7776287583ab service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:12.482130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ed341-40af-4174-a578-7e40ab33f680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:12.482820 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ed341-40af-4174-a578-7e40ab33f680 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:12.483101 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ed341-40af-4174-a578-7e40ab33f680 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:12.483379 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ed341-40af-4174-a578-7e40ab33f680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:12.485236 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7b9ed341-40af-4174-a578-7e40ab33f680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:12.497953 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ed341-40af-4174-a578-7e40ab33f680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:12.499779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ed341-40af-4174-a578-7e40ab33f680 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:12.510982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1349/2730] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:32:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:32:13.050688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf6357-973d-4dd1-925b-1a73828bad52 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:13.053798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-eadf6357-973d-4dd1-925b-1a73828bad52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:13.168551 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf6357-973d-4dd1-925b-1a73828bad52 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:13.174311 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ca62d-4753-48c6-ae36-9c41a700eaf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:13.175202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ca62d-4753-48c6-ae36-9c41a700eaf6 service placement] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:13.175491 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ca62d-4753-48c6-ae36-9c41a700eaf6 service placement] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:13.175764 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ca62d-4753-48c6-ae36-9c41a700eaf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:13.177965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c13ca62d-4753-48c6-ae36-9c41a700eaf6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:13.191124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ca62d-4753-48c6-ae36-9c41a700eaf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:13.192519 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ca62d-4753-48c6-ae36-9c41a700eaf6 service placement] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:13.205685 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1382/2731] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:32:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:32:22.504625 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=12 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:23.199281 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=35 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:23.688950 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ed341-40af-4174-a578-7e40ab33f680 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:23.701095 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ed341-40af-4174-a578-7e40ab33f680 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:23.712223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051960b-809c-487f-b6da-4916adb2d80a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:23.713041 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051960b-809c-487f-b6da-4916adb2d80a service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:23.713897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051960b-809c-487f-b6da-4916adb2d80a service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:23.713897 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051960b-809c-487f-b6da-4916adb2d80a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:23.716846 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5051960b-809c-487f-b6da-4916adb2d80a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:23.733375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051960b-809c-487f-b6da-4916adb2d80a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:23.735280 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051960b-809c-487f-b6da-4916adb2d80a service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:23.750961 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1350/2732] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:32:25.803204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ca62d-4753-48c6-ae36-9c41a700eaf6 service placement] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:25.820591 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ca62d-4753-48c6-ae36-9c41a700eaf6 service placement] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:25.827915 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69ef99-4565-459f-882c-b57581b5bee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:25.828799 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69ef99-4565-459f-882c-b57581b5bee5 service nova] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:25.829309 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69ef99-4565-459f-882c-b57581b5bee5 service nova] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:25.830080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69ef99-4565-459f-882c-b57581b5bee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:25.837964 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2e69ef99-4565-459f-882c-b57581b5bee5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:25.860910 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69ef99-4565-459f-882c-b57581b5bee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:25.863078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69ef99-4565-459f-882c-b57581b5bee5 service nova] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:25.878884 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1383/2733] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:32:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:32:28.751091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051960b-809c-487f-b6da-4916adb2d80a service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:28.768139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051960b-809c-487f-b6da-4916adb2d80a service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:28.774825 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793023e2-ce39-4b48-9047-0a8da7b6ede3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:28.775480 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793023e2-ce39-4b48-9047-0a8da7b6ede3 service placement] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:28.775760 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793023e2-ce39-4b48-9047-0a8da7b6ede3 service placement] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:28.776030 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793023e2-ce39-4b48-9047-0a8da7b6ede3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:28.779006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-793023e2-ce39-4b48-9047-0a8da7b6ede3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:28.804404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793023e2-ce39-4b48-9047-0a8da7b6ede3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:28.804865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793023e2-ce39-4b48-9047-0a8da7b6ede3 service placement] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:28.819854 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1351/2734] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:32:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:32:29.215625 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69ef99-4565-459f-882c-b57581b5bee5 service nova] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:29.219289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-2e69ef99-4565-459f-882c-b57581b5bee5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:29.241216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69ef99-4565-459f-882c-b57581b5bee5 service nova] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:29.248273 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c4a1b-caec-44be-86d5-a0452d876301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:29.249091 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c4a1b-caec-44be-86d5-a0452d876301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:29.249461 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c4a1b-caec-44be-86d5-a0452d876301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:29.249843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c4a1b-caec-44be-86d5-a0452d876301 admin admin] PATH_INFO: `/v3/users/66a1a31e3bfb4b929965a6e52bd6ec72` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:29.251475 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c4a1b-caec-44be-86d5-a0452d876301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a1a31e3bfb4b929965a6e52bd6ec72)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:29.253994 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c4a1b-caec-44be-86d5-a0452d876301 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:29.519468 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-a15c4a1b-caec-44be-86d5-a0452d876301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a1a31e3bfb4b929965a6e52bd6ec72'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:29.520316 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-a15c4a1b-caec-44be-86d5-a0452d876301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a1a31e3bfb4b929965a6e52bd6ec72'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:29.538161 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-a15c4a1b-caec-44be-86d5-a0452d876301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a1a31e3bfb4b929965a6e52bd6ec72'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:29.637579 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-a15c4a1b-caec-44be-86d5-a0452d876301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a1a31e3bfb4b929965a6e52bd6ec72'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:29.638383 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-a15c4a1b-caec-44be-86d5-a0452d876301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a1a31e3bfb4b929965a6e52bd6ec72'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:29.654880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1384/2735] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:32:29 2022] DELETE /identity/v3/users/66a1a31e3bfb4b929965a6e52bd6ec72 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:32:30.036076 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793023e2-ce39-4b48-9047-0a8da7b6ede3 service placement] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:30.051030 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793023e2-ce39-4b48-9047-0a8da7b6ede3 service placement] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:30.129275 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a54527-1121-48fd-9e18-bf64d1e10a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:30.133748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a54527-1121-48fd-9e18-bf64d1e10a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:30.133748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a54527-1121-48fd-9e18-bf64d1e10a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:30.133748 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a54527-1121-48fd-9e18-bf64d1e10a3c admin admin] PATH_INFO: `/v3/projects/ce6794e25ead4ab395563c91f9b2a7e1` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:30.134300 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a54527-1121-48fd-9e18-bf64d1e10a3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce6794e25ead4ab395563c91f9b2a7e1)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:30.137742 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a54527-1121-48fd-9e18-bf64d1e10a3c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:30.297291 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-89a54527-1121-48fd-9e18-bf64d1e10a3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce6794e25ead4ab395563c91f9b2a7e1', 'request_id': 'req-89a54527-1121-48fd-9e18-bf64d1e10a3c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:30.304523 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-89a54527-1121-48fd-9e18-bf64d1e10a3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce6794e25ead4ab395563c91f9b2a7e1', 'request_id': 'req-89a54527-1121-48fd-9e18-bf64d1e10a3c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:30.313839 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-89a54527-1121-48fd-9e18-bf64d1e10a3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce6794e25ead4ab395563c91f9b2a7e1', 'request_id': 'req-89a54527-1121-48fd-9e18-bf64d1e10a3c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:30.506735 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-89a54527-1121-48fd-9e18-bf64d1e10a3c admin admin] The token cache is being invalidate because project ce6794e25ead4ab395563c91f9b2a7e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:32:30.507192 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-89a54527-1121-48fd-9e18-bf64d1e10a3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:30.508088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-89a54527-1121-48fd-9e18-bf64d1e10a3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:30.510207 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1352/2736] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:32:30 2022] DELETE /identity/v3/projects/ce6794e25ead4ab395563c91f9b2a7e1 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:32:30.516051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46d4b3-712f-4245-9744-1e69ce65c3d9 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:30.516921 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46d4b3-712f-4245-9744-1e69ce65c3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:30.517147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46d4b3-712f-4245-9744-1e69ce65c3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:30.546095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-fd46d4b3-712f-4245-9744-1e69ce65c3d9 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:30.548626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-fd46d4b3-712f-4245-9744-1e69ce65c3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:30.650645 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1385/2737] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:32:30.660334 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51771a6-cadf-4c7e-b7bc-44780771c953 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:30.660715 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51771a6-cadf-4c7e-b7bc-44780771c953 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:30.661131 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51771a6-cadf-4c7e-b7bc-44780771c953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:30.686891 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a51771a6-cadf-4c7e-b7bc-44780771c953 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:30.688587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a51771a6-cadf-4c7e-b7bc-44780771c953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:30.700219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1353/2738] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:32:30.706217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46d4b3-712f-4245-9744-1e69ce65c3d9 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:30.718007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46d4b3-712f-4245-9744-1e69ce65c3d9 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:30.723784 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543ad96-243b-4974-b661-13cc491017b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:30.724531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543ad96-243b-4974-b661-13cc491017b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:30.724865 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543ad96-243b-4974-b661-13cc491017b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:30.725180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543ad96-243b-4974-b661-13cc491017b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:30.726078 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543ad96-243b-4974-b661-13cc491017b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:32:30.726544 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543ad96-243b-4974-b661-13cc491017b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:30.728929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543ad96-243b-4974-b661-13cc491017b8 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:30.746265 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1386/2739] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:32:30.752686 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51771a6-cadf-4c7e-b7bc-44780771c953 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:30.767178 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51771a6-cadf-4c7e-b7bc-44780771c953 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:30.772647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ef5b2-e625-4bcd-8fd9-907b6adb3e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:30.773463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ef5b2-e625-4bcd-8fd9-907b6adb3e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:30.773992 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ef5b2-e625-4bcd-8fd9-907b6adb3e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:30.774893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ef5b2-e625-4bcd-8fd9-907b6adb3e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:30.775867 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ef5b2-e625-4bcd-8fd9-907b6adb3e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:30.777953 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ef5b2-e625-4bcd-8fd9-907b6adb3e18 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:30.947811 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1354/2740] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:32:30 2022] POST /identity/v3/projects => generated 405 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:32:30.952364 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543ad96-243b-4974-b661-13cc491017b8 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:30.964403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543ad96-243b-4974-b661-13cc491017b8 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:31.019712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:31.037486 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a93a8-fe89-4034-95ef-6b9b621b2a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:31.038276 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a93a8-fe89-4034-95ef-6b9b621b2a9a admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:31.038670 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a93a8-fe89-4034-95ef-6b9b621b2a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:31.039041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a93a8-fe89-4034-95ef-6b9b621b2a9a admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:31.040196 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a93a8-fe89-4034-95ef-6b9b621b2a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:31.042616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a93a8-fe89-4034-95ef-6b9b621b2a9a admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:31.307545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1387/2741] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:32:30 2022] POST /identity/v3/users => generated 303 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:32:31.312365 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ef5b2-e625-4bcd-8fd9-907b6adb3e18 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:31.325806 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ef5b2-e625-4bcd-8fd9-907b6adb3e18 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:31.332918 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525c428-6deb-4e1f-89e7-ab971c3488c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:31.333912 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525c428-6deb-4e1f-89e7-ab971c3488c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:31.334310 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525c428-6deb-4e1f-89e7-ab971c3488c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:31.334729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525c428-6deb-4e1f-89e7-ab971c3488c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:31.335817 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525c428-6deb-4e1f-89e7-ab971c3488c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:31.339440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525c428-6deb-4e1f-89e7-ab971c3488c6 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:31.357832 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1355/2742] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:32:31.363261 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a93a8-fe89-4034-95ef-6b9b621b2a9a admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:31.382048 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a93a8-fe89-4034-95ef-6b9b621b2a9a admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:31.391109 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17deccf-68b8-46b0-ae38-c6737e5dc297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:31.392301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17deccf-68b8-46b0-ae38-c6737e5dc297 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:31.392707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17deccf-68b8-46b0-ae38-c6737e5dc297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:31.393173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17deccf-68b8-46b0-ae38-c6737e5dc297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:31.394251 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17deccf-68b8-46b0-ae38-c6737e5dc297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:31.399880 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17deccf-68b8-46b0-ae38-c6737e5dc297 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:31.411491 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1388/2743] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:32:31.416152 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525c428-6deb-4e1f-89e7-ab971c3488c6 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:31.428983 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525c428-6deb-4e1f-89e7-ab971c3488c6 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:31.435528 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15adf9-ee83-4023-ae5b-632a2ced08e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:31.436186 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15adf9-ee83-4023-ae5b-632a2ced08e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:31.436496 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15adf9-ee83-4023-ae5b-632a2ced08e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:31.436776 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15adf9-ee83-4023-ae5b-632a2ced08e8 admin admin] PATH_INFO: `/v3/projects/a9c15ef8f0ba4e229d01861d0fd4ff68/users/b47d1e0193ff4c51a275510629717507/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:31.458213 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15adf9-ee83-4023-ae5b-632a2ced08e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9c15ef8f0ba4e229d01861d0fd4ff68, user_id=b47d1e0193ff4c51a275510629717507, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:31.461068 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15adf9-ee83-4023-ae5b-632a2ced08e8 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:31.537474 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:31.544538 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1356/2744] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:32:31 2022] PUT /identity/v3/projects/a9c15ef8f0ba4e229d01861d0fd4ff68/users/b47d1e0193ff4c51a275510629717507/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:32:31.560104 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8664aa-8772-404f-bc70-14eea323ea5d None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:31.560961 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8664aa-8772-404f-bc70-14eea323ea5d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:31.560961 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8664aa-8772-404f-bc70-14eea323ea5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:31.599625 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-be8664aa-8772-404f-bc70-14eea323ea5d None None] MFA Rules not processed for user `b47d1e0193ff4c51a275510629717507`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:31.606254 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-be8664aa-8772-404f-bc70-14eea323ea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:31.689926 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1389/2745] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:32:31 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:32:31.695687 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15adf9-ee83-4023-ae5b-632a2ced08e8 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:31.782989 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15adf9-ee83-4023-ae5b-632a2ced08e8 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:31.789286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7ab87-ef22-44fb-b868-d20a84015048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:31.790705 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7ab87-ef22-44fb-b868-d20a84015048 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:31.790993 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7ab87-ef22-44fb-b868-d20a84015048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:31.791382 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7ab87-ef22-44fb-b868-d20a84015048 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:31.792350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7ab87-ef22-44fb-b868-d20a84015048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:31.795513 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7ab87-ef22-44fb-b868-d20a84015048 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:31.948520 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1357/2746] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:32:31 2022] POST /identity/v3/projects => generated 405 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:32:31.953116 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8664aa-8772-404f-bc70-14eea323ea5d None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:31.968596 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8664aa-8772-404f-bc70-14eea323ea5d None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:32.051103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971296f3-d5f4-4380-993a-372291bc80ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:32.051758 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971296f3-d5f4-4380-993a-372291bc80ce admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:32.052041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971296f3-d5f4-4380-993a-372291bc80ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:32.052322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971296f3-d5f4-4380-993a-372291bc80ce admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:32.053156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971296f3-d5f4-4380-993a-372291bc80ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:32.055750 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971296f3-d5f4-4380-993a-372291bc80ce admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:32.205015 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1390/2747] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:32:31 2022] POST /identity/v3/users => generated 309 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:32:32.209266 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7ab87-ef22-44fb-b868-d20a84015048 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:32.221102 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7ab87-ef22-44fb-b868-d20a84015048 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:32.228715 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e87a7-2c05-4a3a-ae6a-ae30bf50c874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:32.229467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e87a7-2c05-4a3a-ae6a-ae30bf50c874 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:32.229777 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e87a7-2c05-4a3a-ae6a-ae30bf50c874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:32.230050 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e87a7-2c05-4a3a-ae6a-ae30bf50c874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:32.230881 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e87a7-2c05-4a3a-ae6a-ae30bf50c874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:32.232532 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e87a7-2c05-4a3a-ae6a-ae30bf50c874 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:32.248084 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1358/2748] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:32:32.257646 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971296f3-d5f4-4380-993a-372291bc80ce admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:32.269716 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971296f3-d5f4-4380-993a-372291bc80ce admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:32.279126 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96666d4b-cd3e-4cf9-8c57-ea6ee8f12042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:32.279834 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96666d4b-cd3e-4cf9-8c57-ea6ee8f12042 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:32.280134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96666d4b-cd3e-4cf9-8c57-ea6ee8f12042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:32.280414 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96666d4b-cd3e-4cf9-8c57-ea6ee8f12042 admin admin] PATH_INFO: `/v3/projects/366dcb34c65042d0b347bea7915676ad/users/28293c2842b842f3886ac4c501dd44c9/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:32.299787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96666d4b-cd3e-4cf9-8c57-ea6ee8f12042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=366dcb34c65042d0b347bea7915676ad, user_id=28293c2842b842f3886ac4c501dd44c9, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:32.302519 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96666d4b-cd3e-4cf9-8c57-ea6ee8f12042 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:32.473134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1391/2749] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:32:32 2022] PUT /identity/v3/projects/366dcb34c65042d0b347bea7915676ad/users/28293c2842b842f3886ac4c501dd44c9/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:32:32.478077 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e87a7-2c05-4a3a-ae6a-ae30bf50c874 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:32.496995 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e87a7-2c05-4a3a-ae6a-ae30bf50c874 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:32.597187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d5d87-fb0c-43c4-ac96-0e5775c6275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:32.597998 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d5d87-fb0c-43c4-ac96-0e5775c6275b admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:32.598439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d5d87-fb0c-43c4-ac96-0e5775c6275b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:32.598877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d5d87-fb0c-43c4-ac96-0e5775c6275b admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:32.611201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d5d87-fb0c-43c4-ac96-0e5775c6275b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:32.611201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d5d87-fb0c-43c4-ac96-0e5775c6275b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:32.621003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1359/2750] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:32:32.626310 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96666d4b-cd3e-4cf9-8c57-ea6ee8f12042 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:32.639096 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96666d4b-cd3e-4cf9-8c57-ea6ee8f12042 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:32.645088 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e3074-6b0d-42e7-b616-9488af78dd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:32.645257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e3074-6b0d-42e7-b616-9488af78dd8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:32.645547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e3074-6b0d-42e7-b616-9488af78dd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:32.645826 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e3074-6b0d-42e7-b616-9488af78dd8a admin admin] PATH_INFO: `/v3/projects/366dcb34c65042d0b347bea7915676ad/users/28293c2842b842f3886ac4c501dd44c9/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:32.648147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e3074-6b0d-42e7-b616-9488af78dd8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=366dcb34c65042d0b347bea7915676ad, user_id=28293c2842b842f3886ac4c501dd44c9, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:32.651638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e3074-6b0d-42e7-b616-9488af78dd8a admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:32.664927 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1392/2751] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:32:32 2022] PUT /identity/v3/projects/366dcb34c65042d0b347bea7915676ad/users/28293c2842b842f3886ac4c501dd44c9/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:32:32.677062 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf59db-fc05-40cd-88e8-94ede61c829e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:32.677350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf59db-fc05-40cd-88e8-94ede61c829e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:32.677627 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf59db-fc05-40cd-88e8-94ede61c829e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:32.721372 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9edf59db-fc05-40cd-88e8-94ede61c829e None None] MFA Rules not processed for user `28293c2842b842f3886ac4c501dd44c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:32.723805 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9edf59db-fc05-40cd-88e8-94ede61c829e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:32.852932 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:32.871023 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1360/2752] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:32:32 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:32:32.886017 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e3074-6b0d-42e7-b616-9488af78dd8a admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:32.888143 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7b0e3074-6b0d-42e7-b616-9488af78dd8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:32.901085 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:32.963988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e3074-6b0d-42e7-b616-9488af78dd8a admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:32.967980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d5b73-59a6-49f7-8d65-73297bb44b93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:32.968628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d5b73-59a6-49f7-8d65-73297bb44b93 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:32.968906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d5b73-59a6-49f7-8d65-73297bb44b93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:32.969181 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d5b73-59a6-49f7-8d65-73297bb44b93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:32.980223 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d5b73-59a6-49f7-8d65-73297bb44b93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:32.981594 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d5b73-59a6-49f7-8d65-73297bb44b93 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:32.993254 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1393/2753] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:32:32 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:32:33.186381 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf59db-fc05-40cd-88e8-94ede61c829e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:33.265234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf59db-fc05-40cd-88e8-94ede61c829e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:33.271132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966bda5-3d3e-4b52-9c15-490abed27284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:33.271801 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966bda5-3d3e-4b52-9c15-490abed27284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:33.272086 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966bda5-3d3e-4b52-9c15-490abed27284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:33.272366 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966bda5-3d3e-4b52-9c15-490abed27284 admin admin] PATH_INFO: `/v3/users/b47d1e0193ff4c51a275510629717507` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:33.273606 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966bda5-3d3e-4b52-9c15-490abed27284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b47d1e0193ff4c51a275510629717507)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:33.275866 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966bda5-3d3e-4b52-9c15-490abed27284 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:33.602206 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8966bda5-3d3e-4b52-9c15-490abed27284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b47d1e0193ff4c51a275510629717507'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:33.603900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8966bda5-3d3e-4b52-9c15-490abed27284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b47d1e0193ff4c51a275510629717507'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:33.624191 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8966bda5-3d3e-4b52-9c15-490abed27284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b47d1e0193ff4c51a275510629717507'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:33.625039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8966bda5-3d3e-4b52-9c15-490abed27284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b47d1e0193ff4c51a275510629717507'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:33.769786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8966bda5-3d3e-4b52-9c15-490abed27284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b47d1e0193ff4c51a275510629717507'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:33.792305 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1361/2754] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:32:33 2022] DELETE /identity/v3/users/b47d1e0193ff4c51a275510629717507 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:32:33.797688 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8e4be-735a-48e5-86fd-cdbc03946f07 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:33.798507 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8e4be-735a-48e5-86fd-cdbc03946f07 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:33.798507 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8e4be-735a-48e5-86fd-cdbc03946f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:33.820118 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-bfc8e4be-735a-48e5-86fd-cdbc03946f07 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:33.821980 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-bfc8e4be-735a-48e5-86fd-cdbc03946f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:33.908747 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1394/2755] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:32:33.921443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966bda5-3d3e-4b52-9c15-490abed27284 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:33.922896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8966bda5-3d3e-4b52-9c15-490abed27284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:33.997132 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966bda5-3d3e-4b52-9c15-490abed27284 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:34.001268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2df4b7-d4a3-4b3d-b7d6-05b1d311113d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:34.002135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2df4b7-d4a3-4b3d-b7d6-05b1d311113d service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:34.002444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2df4b7-d4a3-4b3d-b7d6-05b1d311113d service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:34.002587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2df4b7-d4a3-4b3d-b7d6-05b1d311113d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:34.014170 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2df4b7-d4a3-4b3d-b7d6-05b1d311113d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:34.016308 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2df4b7-d4a3-4b3d-b7d6-05b1d311113d service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:34.026918 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1362/2756] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:32:34.557535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8e4be-735a-48e5-86fd-cdbc03946f07 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:34.559636 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-bfc8e4be-735a-48e5-86fd-cdbc03946f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:34.575386 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8e4be-735a-48e5-86fd-cdbc03946f07 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:34.583913 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827a179-120e-4d50-b10b-52a6f7a3198e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:34.584842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827a179-120e-4d50-b10b-52a6f7a3198e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:34.585230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827a179-120e-4d50-b10b-52a6f7a3198e admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:34.585696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827a179-120e-4d50-b10b-52a6f7a3198e admin admin] PATH_INFO: `/v3/projects/a9c15ef8f0ba4e229d01861d0fd4ff68` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:34.587961 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827a179-120e-4d50-b10b-52a6f7a3198e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9c15ef8f0ba4e229d01861d0fd4ff68)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:34.590265 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827a179-120e-4d50-b10b-52a6f7a3198e admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:34.748958 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7827a179-120e-4d50-b10b-52a6f7a3198e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9c15ef8f0ba4e229d01861d0fd4ff68', 'request_id': 'req-7827a179-120e-4d50-b10b-52a6f7a3198e'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:34.843382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7827a179-120e-4d50-b10b-52a6f7a3198e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9c15ef8f0ba4e229d01861d0fd4ff68', 'request_id': 'req-7827a179-120e-4d50-b10b-52a6f7a3198e'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:34.851544 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7827a179-120e-4d50-b10b-52a6f7a3198e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9c15ef8f0ba4e229d01861d0fd4ff68', 'request_id': 'req-7827a179-120e-4d50-b10b-52a6f7a3198e'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:34.861233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e770d-475f-4c24-8af7-986cec6f7b40 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:34.862266 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e770d-475f-4c24-8af7-986cec6f7b40 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:34.862589 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e770d-475f-4c24-8af7-986cec6f7b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:34.864104 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7827a179-120e-4d50-b10b-52a6f7a3198e admin admin] The token cache is being invalidate because project a9c15ef8f0ba4e229d01861d0fd4ff68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:32:34.864403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7827a179-120e-4d50-b10b-52a6f7a3198e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:34.865288 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-7827a179-120e-4d50-b10b-52a6f7a3198e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:34.868289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1395/2757] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:32:34 2022] DELETE /identity/v3/projects/a9c15ef8f0ba4e229d01861d0fd4ff68 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:32:34.874458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827a179-120e-4d50-b10b-52a6f7a3198e admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:34.876806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-7827a179-120e-4d50-b10b-52a6f7a3198e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:34.886157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-974e770d-475f-4c24-8af7-986cec6f7b40 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:34.887486 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-974e770d-475f-4c24-8af7-986cec6f7b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:34.905755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:34.926824 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:34.965514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827a179-120e-4d50-b10b-52a6f7a3198e admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:34.973585 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a4b59-5650-431b-939f-98b3c02c92f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:34.974707 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a4b59-5650-431b-939f-98b3c02c92f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:34.975180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a4b59-5650-431b-939f-98b3c02c92f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:34.975661 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a4b59-5650-431b-939f-98b3c02c92f7 admin admin] PATH_INFO: `/v3/users/28293c2842b842f3886ac4c501dd44c9` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:34.977759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a4b59-5650-431b-939f-98b3c02c92f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28293c2842b842f3886ac4c501dd44c9)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:34.978603 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1363/2758] 10.222.0.122 () {58 vars in 1017 bytes} [Tue Jul 26 15:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:32:34.980572 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a4b59-5650-431b-939f-98b3c02c92f7 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:35.010737 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e770d-475f-4c24-8af7-986cec6f7b40 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:35.012318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-974e770d-475f-4c24-8af7-986cec6f7b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:35.108626 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e770d-475f-4c24-8af7-986cec6f7b40 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:35.115801 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e43df0-a9e1-461b-a8ad-79e885afd7df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:35.116447 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e43df0-a9e1-461b-a8ad-79e885afd7df service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:35.116736 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e43df0-a9e1-461b-a8ad-79e885afd7df service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:35.117011 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e43df0-a9e1-461b-a8ad-79e885afd7df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:35.127182 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e43df0-a9e1-461b-a8ad-79e885afd7df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:35.129010 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e43df0-a9e1-461b-a8ad-79e885afd7df service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:35.140511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1364/2759] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:32:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:32:35.262437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-fb4a4b59-5650-431b-939f-98b3c02c92f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28293c2842b842f3886ac4c501dd44c9'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:35.263065 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-fb4a4b59-5650-431b-939f-98b3c02c92f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28293c2842b842f3886ac4c501dd44c9'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:35.280333 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-fb4a4b59-5650-431b-939f-98b3c02c92f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28293c2842b842f3886ac4c501dd44c9'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:35.409072 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-fb4a4b59-5650-431b-939f-98b3c02c92f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28293c2842b842f3886ac4c501dd44c9'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:35.409976 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-fb4a4b59-5650-431b-939f-98b3c02c92f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28293c2842b842f3886ac4c501dd44c9'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:35.425138 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1396/2760] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:32:34 2022] DELETE /identity/v3/users/28293c2842b842f3886ac4c501dd44c9 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:32:35.945443 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e43df0-a9e1-461b-a8ad-79e885afd7df service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:35.958435 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e43df0-a9e1-461b-a8ad-79e885afd7df service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:36.041553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c4ccc-add0-413a-b024-95c939e96aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:36.042311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c4ccc-add0-413a-b024-95c939e96aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:36.042707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c4ccc-add0-413a-b024-95c939e96aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:36.043089 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c4ccc-add0-413a-b024-95c939e96aaa admin admin] PATH_INFO: `/v3/projects/366dcb34c65042d0b347bea7915676ad` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:36.044442 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c4ccc-add0-413a-b024-95c939e96aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=366dcb34c65042d0b347bea7915676ad)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:36.046619 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c4ccc-add0-413a-b024-95c939e96aaa admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:36.182472 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:36.185715 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-dc7c4ccc-add0-413a-b024-95c939e96aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366dcb34c65042d0b347bea7915676ad', 'request_id': 'req-dc7c4ccc-add0-413a-b024-95c939e96aaa'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:36.192288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-dc7c4ccc-add0-413a-b024-95c939e96aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366dcb34c65042d0b347bea7915676ad', 'request_id': 'req-dc7c4ccc-add0-413a-b024-95c939e96aaa'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:36.199725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-dc7c4ccc-add0-413a-b024-95c939e96aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366dcb34c65042d0b347bea7915676ad', 'request_id': 'req-dc7c4ccc-add0-413a-b024-95c939e96aaa'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:36.363128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-dc7c4ccc-add0-413a-b024-95c939e96aaa admin admin] The token cache is being invalidate because project 366dcb34c65042d0b347bea7915676ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:32:36.363454 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-dc7c4ccc-add0-413a-b024-95c939e96aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:36.364173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-dc7c4ccc-add0-413a-b024-95c939e96aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:32:36.365715 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1365/2761] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:32:35 2022] DELETE /identity/v3/projects/366dcb34c65042d0b347bea7915676ad => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:32:36.372819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef273d-b349-4b73-81b1-360e4577de75 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:36.373699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef273d-b349-4b73-81b1-360e4577de75 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:36.373699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef273d-b349-4b73-81b1-360e4577de75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:36.397174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-5fef273d-b349-4b73-81b1-360e4577de75 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:36.398968 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5fef273d-b349-4b73-81b1-360e4577de75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:36.480051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1397/2762] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:32:36.496326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26897a25-2159-459a-a3de-12282cb11261 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:36.496816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26897a25-2159-459a-a3de-12282cb11261 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:36.497311 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26897a25-2159-459a-a3de-12282cb11261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:36.532857 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-26897a25-2159-459a-a3de-12282cb11261 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:36.535009 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-26897a25-2159-459a-a3de-12282cb11261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:36.547242 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1366/2763] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:32:36.553193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef273d-b349-4b73-81b1-360e4577de75 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:36.565484 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef273d-b349-4b73-81b1-360e4577de75 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:36.570438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79ba93-f95d-4fa4-b3e3-de0082b6dd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:36.572490 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79ba93-f95d-4fa4-b3e3-de0082b6dd97 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:36.572766 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79ba93-f95d-4fa4-b3e3-de0082b6dd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:36.573054 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79ba93-f95d-4fa4-b3e3-de0082b6dd97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:36.573786 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79ba93-f95d-4fa4-b3e3-de0082b6dd97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:32:36.574098 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79ba93-f95d-4fa4-b3e3-de0082b6dd97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:36.575787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79ba93-f95d-4fa4-b3e3-de0082b6dd97 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:36.591406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1398/2764] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:32:36.596113 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26897a25-2159-459a-a3de-12282cb11261 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:36.606884 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26897a25-2159-459a-a3de-12282cb11261 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:36.612256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582aa39-5025-4c75-95e8-8842ea33c285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:36.613342 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582aa39-5025-4c75-95e8-8842ea33c285 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:36.613679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582aa39-5025-4c75-95e8-8842ea33c285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:36.614022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582aa39-5025-4c75-95e8-8842ea33c285 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:36.614838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582aa39-5025-4c75-95e8-8842ea33c285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:36.617220 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582aa39-5025-4c75-95e8-8842ea33c285 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:36.743075 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1367/2765] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:32:36 2022] POST /identity/v3/projects => generated 357 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:32:36.749988 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79ba93-f95d-4fa4-b3e3-de0082b6dd97 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:36.763675 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79ba93-f95d-4fa4-b3e3-de0082b6dd97 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:36.832522 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:36.866875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedb99d-7d5b-4848-8114-485b52cceab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:36.868011 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedb99d-7d5b-4848-8114-485b52cceab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:36.868499 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedb99d-7d5b-4848-8114-485b52cceab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:36.868963 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedb99d-7d5b-4848-8114-485b52cceab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:36.870899 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedb99d-7d5b-4848-8114-485b52cceab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:36.875029 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedb99d-7d5b-4848-8114-485b52cceab4 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:37.028780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1399/2766] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:32:36 2022] POST /identity/v3/users => generated 279 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:32:37.030101 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582aa39-5025-4c75-95e8-8842ea33c285 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:37.042679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582aa39-5025-4c75-95e8-8842ea33c285 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:37.047875 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d3414-1a4e-4828-be5d-f8ecf5a6934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:37.048519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d3414-1a4e-4828-be5d-f8ecf5a6934c admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:37.048805 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d3414-1a4e-4828-be5d-f8ecf5a6934c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:37.049082 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d3414-1a4e-4828-be5d-f8ecf5a6934c admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:37.049802 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d3414-1a4e-4828-be5d-f8ecf5a6934c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:37.051478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d3414-1a4e-4828-be5d-f8ecf5a6934c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:37.064118 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1368/2767] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:32:37.069239 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedb99d-7d5b-4848-8114-485b52cceab4 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:37.083434 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedb99d-7d5b-4848-8114-485b52cceab4 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:37.088767 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812d016-07a1-49f0-8b58-195fcc4f5c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:37.089466 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812d016-07a1-49f0-8b58-195fcc4f5c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:37.089794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812d016-07a1-49f0-8b58-195fcc4f5c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:37.090115 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812d016-07a1-49f0-8b58-195fcc4f5c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:37.090917 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812d016-07a1-49f0-8b58-195fcc4f5c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:37.093318 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812d016-07a1-49f0-8b58-195fcc4f5c45 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:37.109245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1400/2768] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:32:37.113921 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d3414-1a4e-4828-be5d-f8ecf5a6934c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:37.127137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d3414-1a4e-4828-be5d-f8ecf5a6934c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:37.137137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3af50b-08bb-4220-bf73-abc4fd133cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:37.138196 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3af50b-08bb-4220-bf73-abc4fd133cda admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:37.138720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3af50b-08bb-4220-bf73-abc4fd133cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:37.139258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3af50b-08bb-4220-bf73-abc4fd133cda admin admin] PATH_INFO: `/v3/projects/186103fa0d88474f8a3f14484eb15c83/users/7fc200db9aef4d4aa5aabb1a6ec7635f/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:37.158220 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3af50b-08bb-4220-bf73-abc4fd133cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=186103fa0d88474f8a3f14484eb15c83, user_id=7fc200db9aef4d4aa5aabb1a6ec7635f, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:37.161324 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3af50b-08bb-4220-bf73-abc4fd133cda admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:37.598555 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1369/2769] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:32:37 2022] PUT /identity/v3/projects/186103fa0d88474f8a3f14484eb15c83/users/7fc200db9aef4d4aa5aabb1a6ec7635f/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:32:37.668268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae11b7-558d-42d2-a52e-f5ee549b1522 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:37.668913 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae11b7-558d-42d2-a52e-f5ee549b1522 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:37.668913 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae11b7-558d-42d2-a52e-f5ee549b1522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:37.833492 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-4aae11b7-558d-42d2-a52e-f5ee549b1522 None None] MFA Rules not processed for user `7fc200db9aef4d4aa5aabb1a6ec7635f`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:37.835101 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4aae11b7-558d-42d2-a52e-f5ee549b1522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:37.925686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1401/2770] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:32:37 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:32:37.931806 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3af50b-08bb-4220-bf73-abc4fd133cda admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:38.032452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3af50b-08bb-4220-bf73-abc4fd133cda admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:38.038982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442bc07-34fe-41c6-8941-c85641346c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:38.040229 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442bc07-34fe-41c6-8941-c85641346c2f admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:38.040553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442bc07-34fe-41c6-8941-c85641346c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:38.041109 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442bc07-34fe-41c6-8941-c85641346c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:38.041902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442bc07-34fe-41c6-8941-c85641346c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:38.044071 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442bc07-34fe-41c6-8941-c85641346c2f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:38.178091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1370/2771] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:32:37 2022] POST /identity/v3/projects => generated 355 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:32:38.183533 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae11b7-558d-42d2-a52e-f5ee549b1522 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:38.202999 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae11b7-558d-42d2-a52e-f5ee549b1522 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:38.275208 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099e9ba-d8cf-484f-b20a-95d6b022ea2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:38.276010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099e9ba-d8cf-484f-b20a-95d6b022ea2b admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:38.276494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099e9ba-d8cf-484f-b20a-95d6b022ea2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:38.276977 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099e9ba-d8cf-484f-b20a-95d6b022ea2b admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:38.278062 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099e9ba-d8cf-484f-b20a-95d6b022ea2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:38.280557 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099e9ba-d8cf-484f-b20a-95d6b022ea2b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:38.485260 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1402/2772] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:32:38 2022] POST /identity/v3/users => generated 284 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:32:38.491896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442bc07-34fe-41c6-8941-c85641346c2f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:38.516880 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442bc07-34fe-41c6-8941-c85641346c2f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:38.530264 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964413d-827a-466b-a1df-a8129bd820e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:38.531272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964413d-827a-466b-a1df-a8129bd820e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:38.531701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964413d-827a-466b-a1df-a8129bd820e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:38.532142 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964413d-827a-466b-a1df-a8129bd820e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:38.533520 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964413d-827a-466b-a1df-a8129bd820e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:38.536307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964413d-827a-466b-a1df-a8129bd820e6 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:38.560187 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1371/2773] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:32:38.566350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099e9ba-d8cf-484f-b20a-95d6b022ea2b admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:38.581986 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099e9ba-d8cf-484f-b20a-95d6b022ea2b admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:38.590194 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f94d0-ded4-4766-84c1-0ff2a2c17622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:38.591255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f94d0-ded4-4766-84c1-0ff2a2c17622 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:38.591670 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f94d0-ded4-4766-84c1-0ff2a2c17622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:38.592071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f94d0-ded4-4766-84c1-0ff2a2c17622 admin admin] PATH_INFO: `/v3/projects/5512ef082ca94c8080b1a3962164dc71/users/2f944ba9344b47ada9a56ad1dc869ebe/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:38.613191 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f94d0-ded4-4766-84c1-0ff2a2c17622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5512ef082ca94c8080b1a3962164dc71, user_id=2f944ba9344b47ada9a56ad1dc869ebe, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:38.616710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f94d0-ded4-4766-84c1-0ff2a2c17622 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:38.756433 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1403/2774] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:32:38 2022] PUT /identity/v3/projects/5512ef082ca94c8080b1a3962164dc71/users/2f944ba9344b47ada9a56ad1dc869ebe/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:32:38.762318 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964413d-827a-466b-a1df-a8129bd820e6 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:38.773352 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964413d-827a-466b-a1df-a8129bd820e6 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:38.834750 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:38.851757 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f239d19-813b-43d8-b4c0-dd62094de98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:38.852570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f239d19-813b-43d8-b4c0-dd62094de98a admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:38.852886 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f239d19-813b-43d8-b4c0-dd62094de98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:38.853222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f239d19-813b-43d8-b4c0-dd62094de98a admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:38.853919 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f239d19-813b-43d8-b4c0-dd62094de98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:38.855556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f239d19-813b-43d8-b4c0-dd62094de98a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:38.865662 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1372/2775] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:32:38.870290 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f94d0-ded4-4766-84c1-0ff2a2c17622 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:38.881906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f94d0-ded4-4766-84c1-0ff2a2c17622 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:38.888020 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97063a0a-6b3a-4157-8db6-5ed0dac5ad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:38.888699 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97063a0a-6b3a-4157-8db6-5ed0dac5ad0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:38.888978 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97063a0a-6b3a-4157-8db6-5ed0dac5ad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:38.889258 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97063a0a-6b3a-4157-8db6-5ed0dac5ad0a admin admin] PATH_INFO: `/v3/projects/5512ef082ca94c8080b1a3962164dc71/users/2f944ba9344b47ada9a56ad1dc869ebe/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:38.891507 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97063a0a-6b3a-4157-8db6-5ed0dac5ad0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5512ef082ca94c8080b1a3962164dc71, user_id=2f944ba9344b47ada9a56ad1dc869ebe, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:38.894124 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97063a0a-6b3a-4157-8db6-5ed0dac5ad0a admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:38.902765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:38.908103 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1404/2776] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:32:38 2022] PUT /identity/v3/projects/5512ef082ca94c8080b1a3962164dc71/users/2f944ba9344b47ada9a56ad1dc869ebe/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:32:38.918795 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa129a-6d9e-47ea-8746-216913185cd3 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:38.923422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa129a-6d9e-47ea-8746-216913185cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:38.923422 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa129a-6d9e-47ea-8746-216913185cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:38.949435 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-dafa129a-6d9e-47ea-8746-216913185cd3 None None] MFA Rules not processed for user `2f944ba9344b47ada9a56ad1dc869ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:38.950940 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-dafa129a-6d9e-47ea-8746-216913185cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:39.023247 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1373/2777] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:32:38 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:32:39.036098 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97063a0a-6b3a-4157-8db6-5ed0dac5ad0a admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:39.037906 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-97063a0a-6b3a-4157-8db6-5ed0dac5ad0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:39.097629 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97063a0a-6b3a-4157-8db6-5ed0dac5ad0a admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:39.101349 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be438-7ff2-4fcc-9210-f69a94ff0d82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:39.102570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be438-7ff2-4fcc-9210-f69a94ff0d82 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:39.102859 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be438-7ff2-4fcc-9210-f69a94ff0d82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:39.103137 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be438-7ff2-4fcc-9210-f69a94ff0d82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:39.112955 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be438-7ff2-4fcc-9210-f69a94ff0d82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:39.114386 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be438-7ff2-4fcc-9210-f69a94ff0d82 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:39.124482 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1405/2778] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:32:39 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:32:39.560228 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa129a-6d9e-47ea-8746-216913185cd3 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:39.571534 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa129a-6d9e-47ea-8746-216913185cd3 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:39.575639 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad02d80-f419-4f53-af8a-999e2f9c0fa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:39.579797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad02d80-f419-4f53-af8a-999e2f9c0fa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:39.579797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad02d80-f419-4f53-af8a-999e2f9c0fa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:39.579797 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad02d80-f419-4f53-af8a-999e2f9c0fa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:39.641483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad02d80-f419-4f53-af8a-999e2f9c0fa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:39.642982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad02d80-f419-4f53-af8a-999e2f9c0fa4 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:39.654162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1374/2779] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:32:39 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:32:39.987185 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02e89-2303-4d8e-b23e-7542ce80b5f8 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:39.987777 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02e89-2303-4d8e-b23e-7542ce80b5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:39.987895 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02e89-2303-4d8e-b23e-7542ce80b5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:40.010344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-51d02e89-2303-4d8e-b23e-7542ce80b5f8 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:40.011646 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-51d02e89-2303-4d8e-b23e-7542ce80b5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:40.087561 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1406/2780] 10.222.0.122 () {58 vars in 1017 bytes} [Tue Jul 26 15:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:32:40.118858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad02d80-f419-4f53-af8a-999e2f9c0fa4 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:40.120901 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-aad02d80-f419-4f53-af8a-999e2f9c0fa4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:40.214393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:40.229466 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad02d80-f419-4f53-af8a-999e2f9c0fa4 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:40.239658 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd87c22-49be-4e99-9b93-8de60c08a547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:40.240709 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd87c22-49be-4e99-9b93-8de60c08a547 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:40.241200 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd87c22-49be-4e99-9b93-8de60c08a547 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:40.241699 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd87c22-49be-4e99-9b93-8de60c08a547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:40.258644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd87c22-49be-4e99-9b93-8de60c08a547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:40.261777 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd87c22-49be-4e99-9b93-8de60c08a547 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:40.281553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1375/2781] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:32:43.680575 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9817255-d6c0-4f22-a6cb-065ac7b7269d None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:43.681193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9817255-d6c0-4f22-a6cb-065ac7b7269d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:43.681193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9817255-d6c0-4f22-a6cb-065ac7b7269d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:43.705725 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d9817255-d6c0-4f22-a6cb-065ac7b7269d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:43.707221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d9817255-d6c0-4f22-a6cb-065ac7b7269d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:43.720002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1407/2782] 10.222.0.122 () {58 vars in 1017 bytes} [Tue Jul 26 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:32:43.743380 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd87c22-49be-4e99-9b93-8de60c08a547 service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:43.745222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2dd87c22-49be-4e99-9b93-8de60c08a547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:43.761234 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd87c22-49be-4e99-9b93-8de60c08a547 service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:43.770761 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb973f-420c-4fcf-886d-664a7284c490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:43.770761 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb973f-420c-4fcf-886d-664a7284c490 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:43.770761 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb973f-420c-4fcf-886d-664a7284c490 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:43.770761 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb973f-420c-4fcf-886d-664a7284c490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:43.779165 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb973f-420c-4fcf-886d-664a7284c490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:43.780794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb973f-420c-4fcf-886d-664a7284c490 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:43.793088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1376/2783] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:32:46.969833 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539fc08-66bd-4fe3-aadd-a7e36ee4976d None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:46.970617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539fc08-66bd-4fe3-aadd-a7e36ee4976d None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:46.970617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539fc08-66bd-4fe3-aadd-a7e36ee4976d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:47.001712 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-0539fc08-66bd-4fe3-aadd-a7e36ee4976d None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:47.004056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0539fc08-66bd-4fe3-aadd-a7e36ee4976d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:47.018604 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1408/2784] 10.222.0.122 () {58 vars in 1017 bytes} [Tue Jul 26 15:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:32:47.048727 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb973f-420c-4fcf-886d-664a7284c490 service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:47.070556 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb973f-420c-4fcf-886d-664a7284c490 service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:47.078833 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc99d2-ea0b-430f-bc98-1aaa662836f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:47.079483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc99d2-ea0b-430f-bc98-1aaa662836f4 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:47.079767 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc99d2-ea0b-430f-bc98-1aaa662836f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:47.080046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc99d2-ea0b-430f-bc98-1aaa662836f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:47.091159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc99d2-ea0b-430f-bc98-1aaa662836f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:47.095169 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc99d2-ea0b-430f-bc98-1aaa662836f4 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:47.114373 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1377/2785] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:32:50.411900 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9368d-1684-4bde-aa35-15b53b56fb3a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:50.412510 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9368d-1684-4bde-aa35-15b53b56fb3a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:50.412881 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9368d-1684-4bde-aa35-15b53b56fb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:50.448464 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-fcb9368d-1684-4bde-aa35-15b53b56fb3a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:50.450144 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-fcb9368d-1684-4bde-aa35-15b53b56fb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:50.472666 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1409/2786] 10.222.0.122 () {58 vars in 1017 bytes} [Tue Jul 26 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:32:50.497885 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc99d2-ea0b-430f-bc98-1aaa662836f4 service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:50.511721 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc99d2-ea0b-430f-bc98-1aaa662836f4 service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:50.518346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3e7d-af24-4396-89ab-da678a9a96d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4a6c0e7ca434010980d7cac1800dbe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:50.519589 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3e7d-af24-4396-89ab-da678a9a96d7 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:50.519936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3e7d-af24-4396-89ab-da678a9a96d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:50.520325 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3e7d-af24-4396-89ab-da678a9a96d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:50.531375 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e3e7d-af24-4396-89ab-da678a9a96d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:50.533517 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e3e7d-af24-4396-89ab-da678a9a96d7 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:50.551500 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1378/2787] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:33:00.439498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=62 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:00.541380 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=23 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:02.713311 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9368d-1684-4bde-aa35-15b53b56fb3a None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:02.727308 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9368d-1684-4bde-aa35-15b53b56fb3a None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:02.732486 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b26e05-7ed7-4b1c-9b6e-6003aad90248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:02.732617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b26e05-7ed7-4b1c-9b6e-6003aad90248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:02.732819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b26e05-7ed7-4b1c-9b6e-6003aad90248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:02.733092 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b26e05-7ed7-4b1c-9b6e-6003aad90248 admin admin] PATH_INFO: `/v3/users/7fc200db9aef4d4aa5aabb1a6ec7635f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:02.734275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b26e05-7ed7-4b1c-9b6e-6003aad90248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc200db9aef4d4aa5aabb1a6ec7635f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:02.736350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b26e05-7ed7-4b1c-9b6e-6003aad90248 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:02.995481 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05b26e05-7ed7-4b1c-9b6e-6003aad90248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc200db9aef4d4aa5aabb1a6ec7635f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:02.996202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05b26e05-7ed7-4b1c-9b6e-6003aad90248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc200db9aef4d4aa5aabb1a6ec7635f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:03.017064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05b26e05-7ed7-4b1c-9b6e-6003aad90248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc200db9aef4d4aa5aabb1a6ec7635f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:03.099902 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05b26e05-7ed7-4b1c-9b6e-6003aad90248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc200db9aef4d4aa5aabb1a6ec7635f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:03.100522 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-05b26e05-7ed7-4b1c-9b6e-6003aad90248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc200db9aef4d4aa5aabb1a6ec7635f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:03.114882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1410/2788] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:33:02 2022] DELETE /identity/v3/users/7fc200db9aef4d4aa5aabb1a6ec7635f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:03.119406 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf259e-f079-4218-8b7c-47a7d13b0af0 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:03.120219 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf259e-f079-4218-8b7c-47a7d13b0af0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:03.120322 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf259e-f079-4218-8b7c-47a7d13b0af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:03.142981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cebf259e-f079-4218-8b7c-47a7d13b0af0 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:03.144256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cebf259e-f079-4218-8b7c-47a7d13b0af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:03.209759 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1379/2789] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:33:03.220950 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b26e05-7ed7-4b1c-9b6e-6003aad90248 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:03.222406 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-05b26e05-7ed7-4b1c-9b6e-6003aad90248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:03.283606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b26e05-7ed7-4b1c-9b6e-6003aad90248 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:03.287257 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b6cb9-cc33-4f15-a33b-c17fb0412e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:03.287876 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b6cb9-cc33-4f15-a33b-c17fb0412e3e service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:03.288183 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b6cb9-cc33-4f15-a33b-c17fb0412e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:03.288455 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b6cb9-cc33-4f15-a33b-c17fb0412e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:03.298535 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b6cb9-cc33-4f15-a33b-c17fb0412e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:03.300057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b6cb9-cc33-4f15-a33b-c17fb0412e3e service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:03.311321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1411/2790] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:33:03.907784 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf259e-f079-4218-8b7c-47a7d13b0af0 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:03.909464 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cebf259e-f079-4218-8b7c-47a7d13b0af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:03.926909 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf259e-f079-4218-8b7c-47a7d13b0af0 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:03.932006 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc8593-8ee1-4864-b4a8-903e7f217060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:03.932850 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc8593-8ee1-4864-b4a8-903e7f217060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:03.933131 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc8593-8ee1-4864-b4a8-903e7f217060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:03.939861 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc8593-8ee1-4864-b4a8-903e7f217060 admin admin] PATH_INFO: `/v3/projects/186103fa0d88474f8a3f14484eb15c83` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:03.939861 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc8593-8ee1-4864-b4a8-903e7f217060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=186103fa0d88474f8a3f14484eb15c83)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:03.939861 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc8593-8ee1-4864-b4a8-903e7f217060 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:04.118159 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-addc8593-8ee1-4864-b4a8-903e7f217060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '186103fa0d88474f8a3f14484eb15c83', 'request_id': 'req-addc8593-8ee1-4864-b4a8-903e7f217060'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:04.124756 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-addc8593-8ee1-4864-b4a8-903e7f217060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '186103fa0d88474f8a3f14484eb15c83', 'request_id': 'req-addc8593-8ee1-4864-b4a8-903e7f217060'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:04.133046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-addc8593-8ee1-4864-b4a8-903e7f217060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '186103fa0d88474f8a3f14484eb15c83', 'request_id': 'req-addc8593-8ee1-4864-b4a8-903e7f217060'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:04.316972 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-addc8593-8ee1-4864-b4a8-903e7f217060 admin admin] The token cache is being invalidate because project 186103fa0d88474f8a3f14484eb15c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:33:04.317201 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-addc8593-8ee1-4864-b4a8-903e7f217060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:04.317826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-addc8593-8ee1-4864-b4a8-903e7f217060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:04.320037 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1380/2791] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:33:03 2022] DELETE /identity/v3/projects/186103fa0d88474f8a3f14484eb15c83 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:04.324370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b6cb9-cc33-4f15-a33b-c17fb0412e3e service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:04.336804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b6cb9-cc33-4f15-a33b-c17fb0412e3e service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:04.407451 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba9c93-7201-410a-a717-09d12c5b6ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:04.408095 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba9c93-7201-410a-a717-09d12c5b6ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:04.408382 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba9c93-7201-410a-a717-09d12c5b6ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:04.408662 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba9c93-7201-410a-a717-09d12c5b6ded admin admin] PATH_INFO: `/v3/users/2f944ba9344b47ada9a56ad1dc869ebe` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:04.409853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba9c93-7201-410a-a717-09d12c5b6ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f944ba9344b47ada9a56ad1dc869ebe)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:04.411801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba9c93-7201-410a-a717-09d12c5b6ded admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:04.428005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:04.770449 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3dba9c93-7201-410a-a717-09d12c5b6ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f944ba9344b47ada9a56ad1dc869ebe'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:04.771132 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3dba9c93-7201-410a-a717-09d12c5b6ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f944ba9344b47ada9a56ad1dc869ebe'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:04.783946 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3dba9c93-7201-410a-a717-09d12c5b6ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f944ba9344b47ada9a56ad1dc869ebe'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:04.963151 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3dba9c93-7201-410a-a717-09d12c5b6ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f944ba9344b47ada9a56ad1dc869ebe'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:04.963796 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3dba9c93-7201-410a-a717-09d12c5b6ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f944ba9344b47ada9a56ad1dc869ebe'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:04.978141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1412/2792] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:33:04 2022] DELETE /identity/v3/users/2f944ba9344b47ada9a56ad1dc869ebe => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:33:05.539617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc8593-8ee1-4864-b4a8-903e7f217060 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:05.541957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-addc8593-8ee1-4864-b4a8-903e7f217060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:05.557471 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc8593-8ee1-4864-b4a8-903e7f217060 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:05.624452 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67788a69-b3cc-4232-a562-8af1247601e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:05.624857 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67788a69-b3cc-4232-a562-8af1247601e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:05.625147 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67788a69-b3cc-4232-a562-8af1247601e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:05.625537 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67788a69-b3cc-4232-a562-8af1247601e9 admin admin] PATH_INFO: `/v3/projects/5512ef082ca94c8080b1a3962164dc71` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:05.627898 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67788a69-b3cc-4232-a562-8af1247601e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5512ef082ca94c8080b1a3962164dc71)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:05.628965 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67788a69-b3cc-4232-a562-8af1247601e9 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:05.764101 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:05.781363 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-67788a69-b3cc-4232-a562-8af1247601e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5512ef082ca94c8080b1a3962164dc71', 'request_id': 'req-67788a69-b3cc-4232-a562-8af1247601e9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:05.787710 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-67788a69-b3cc-4232-a562-8af1247601e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5512ef082ca94c8080b1a3962164dc71', 'request_id': 'req-67788a69-b3cc-4232-a562-8af1247601e9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:05.795034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-67788a69-b3cc-4232-a562-8af1247601e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5512ef082ca94c8080b1a3962164dc71', 'request_id': 'req-67788a69-b3cc-4232-a562-8af1247601e9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:05.935679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-67788a69-b3cc-4232-a562-8af1247601e9 admin admin] The token cache is being invalidate because project 5512ef082ca94c8080b1a3962164dc71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:33:05.935975 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-67788a69-b3cc-4232-a562-8af1247601e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:05.936695 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-67788a69-b3cc-4232-a562-8af1247601e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:05.938519 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1381/2793] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:33:05 2022] DELETE /identity/v3/projects/5512ef082ca94c8080b1a3962164dc71 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:05.949437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab62e05-e957-4e64-8076-35ae990d3db3 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:05.950013 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab62e05-e957-4e64-8076-35ae990d3db3 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:05.950013 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab62e05-e957-4e64-8076-35ae990d3db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:05.969986 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-9ab62e05-e957-4e64-8076-35ae990d3db3 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:05.971211 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-9ab62e05-e957-4e64-8076-35ae990d3db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:06.040374 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1413/2794] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:33:06.048328 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4810e-10e5-47ab-93ee-9b0746629b3f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:06.048621 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4810e-10e5-47ab-93ee-9b0746629b3f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:06.048926 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4810e-10e5-47ab-93ee-9b0746629b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:06.070816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-91e4810e-10e5-47ab-93ee-9b0746629b3f None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:06.072483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-91e4810e-10e5-47ab-93ee-9b0746629b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:06.081524 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1382/2795] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:33:06.086301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab62e05-e957-4e64-8076-35ae990d3db3 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:06.099763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab62e05-e957-4e64-8076-35ae990d3db3 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:06.106106 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297502d6-0904-4c9c-96c4-0a0025502902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:06.106467 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297502d6-0904-4c9c-96c4-0a0025502902 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:06.106754 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297502d6-0904-4c9c-96c4-0a0025502902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:06.107034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297502d6-0904-4c9c-96c4-0a0025502902 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:06.107750 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297502d6-0904-4c9c-96c4-0a0025502902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:33:06.108096 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297502d6-0904-4c9c-96c4-0a0025502902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:06.109763 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297502d6-0904-4c9c-96c4-0a0025502902 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:06.128860 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1414/2796] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:33:06.139394 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4810e-10e5-47ab-93ee-9b0746629b3f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:06.149790 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4810e-10e5-47ab-93ee-9b0746629b3f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:06.155123 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d202f8-b247-452f-85ad-243a673f3235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:06.155755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d202f8-b247-452f-85ad-243a673f3235 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:06.156036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d202f8-b247-452f-85ad-243a673f3235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:06.156309 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d202f8-b247-452f-85ad-243a673f3235 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:06.156979 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d202f8-b247-452f-85ad-243a673f3235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:06.159087 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d202f8-b247-452f-85ad-243a673f3235 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:06.297281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1383/2797] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:33:06 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:33:06.301464 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297502d6-0904-4c9c-96c4-0a0025502902 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:06.311844 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297502d6-0904-4c9c-96c4-0a0025502902 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:06.375701 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b88aeb-af21-446b-8ca2-6f456d27a10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:06.376328 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b88aeb-af21-446b-8ca2-6f456d27a10f admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:06.376613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b88aeb-af21-446b-8ca2-6f456d27a10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:06.376891 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b88aeb-af21-446b-8ca2-6f456d27a10f admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:06.377570 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b88aeb-af21-446b-8ca2-6f456d27a10f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:06.379523 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b88aeb-af21-446b-8ca2-6f456d27a10f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:06.524623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1415/2798] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:33:06 2022] POST /identity/v3/users => generated 288 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:33:06.530032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d202f8-b247-452f-85ad-243a673f3235 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:06.541302 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d202f8-b247-452f-85ad-243a673f3235 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:06.549631 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feb1fa-19f7-48ed-82ac-fb25122df2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:06.550490 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feb1fa-19f7-48ed-82ac-fb25122df2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:06.550909 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feb1fa-19f7-48ed-82ac-fb25122df2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:06.551436 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feb1fa-19f7-48ed-82ac-fb25122df2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:06.552494 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15feb1fa-19f7-48ed-82ac-fb25122df2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:06.554883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15feb1fa-19f7-48ed-82ac-fb25122df2f3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:06.566739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1384/2799] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:33:06.571738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b88aeb-af21-446b-8ca2-6f456d27a10f admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:06.582477 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b88aeb-af21-446b-8ca2-6f456d27a10f admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:06.588418 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e45176-9d09-4933-a22a-e4c95552fcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:06.589060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e45176-9d09-4933-a22a-e4c95552fcc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:06.589344 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e45176-9d09-4933-a22a-e4c95552fcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:06.589623 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e45176-9d09-4933-a22a-e4c95552fcc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:06.590338 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e45176-9d09-4933-a22a-e4c95552fcc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:06.591979 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e45176-9d09-4933-a22a-e4c95552fcc5 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:06.598200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:06.604498 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1416/2800] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:33:06.608870 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feb1fa-19f7-48ed-82ac-fb25122df2f3 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:06.620475 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feb1fa-19f7-48ed-82ac-fb25122df2f3 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:06.625330 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57940a6-e645-4036-9b63-09dcf1b153b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:06.626073 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57940a6-e645-4036-9b63-09dcf1b153b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:06.626407 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57940a6-e645-4036-9b63-09dcf1b153b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:06.626722 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57940a6-e645-4036-9b63-09dcf1b153b3 admin admin] PATH_INFO: `/v3/projects/529803bd144547eb8fda2714918f7b49/users/61555ca5e75647bbb52765b3f9e8f025/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:06.644828 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57940a6-e645-4036-9b63-09dcf1b153b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=529803bd144547eb8fda2714918f7b49, user_id=61555ca5e75647bbb52765b3f9e8f025, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:06.648551 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57940a6-e645-4036-9b63-09dcf1b153b3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:06.740769 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1385/2801] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:33:06 2022] PUT /identity/v3/projects/529803bd144547eb8fda2714918f7b49/users/61555ca5e75647bbb52765b3f9e8f025/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:06.752275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba5fb4-da04-40d0-86bb-e0f1ea53fac5 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:06.752552 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba5fb4-da04-40d0-86bb-e0f1ea53fac5 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:06.752823 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba5fb4-da04-40d0-86bb-e0f1ea53fac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:06.784182 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-e5ba5fb4-da04-40d0-86bb-e0f1ea53fac5 None None] MFA Rules not processed for user `61555ca5e75647bbb52765b3f9e8f025`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:06.785404 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e5ba5fb4-da04-40d0-86bb-e0f1ea53fac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:06.856388 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1417/2802] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:33:06.861000 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57940a6-e645-4036-9b63-09dcf1b153b3 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:06.927564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57940a6-e645-4036-9b63-09dcf1b153b3 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:06.933798 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d5750-209c-4efd-af53-a59cc8bbbd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:06.934492 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d5750-209c-4efd-af53-a59cc8bbbd07 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:06.934777 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d5750-209c-4efd-af53-a59cc8bbbd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:06.935052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d5750-209c-4efd-af53-a59cc8bbbd07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:06.935739 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d5750-209c-4efd-af53-a59cc8bbbd07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:06.937650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d5750-209c-4efd-af53-a59cc8bbbd07 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:07.048214 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1386/2803] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:33:06 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:33:07.049659 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba5fb4-da04-40d0-86bb-e0f1ea53fac5 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:07.063252 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba5fb4-da04-40d0-86bb-e0f1ea53fac5 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:07.126213 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056c9fd-3cb8-4240-a9fd-2ac5964fe000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:07.126755 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056c9fd-3cb8-4240-a9fd-2ac5964fe000 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:07.127043 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056c9fd-3cb8-4240-a9fd-2ac5964fe000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:07.127323 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056c9fd-3cb8-4240-a9fd-2ac5964fe000 admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:07.128036 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056c9fd-3cb8-4240-a9fd-2ac5964fe000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:07.130083 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056c9fd-3cb8-4240-a9fd-2ac5964fe000 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:07.352470 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1418/2804] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:33:07 2022] POST /identity/v3/users => generated 294 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:33:07.357043 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d5750-209c-4efd-af53-a59cc8bbbd07 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:07.369172 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d5750-209c-4efd-af53-a59cc8bbbd07 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:07.374189 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd79ea-2e97-4709-b844-8a4e8f2f2fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:07.374847 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd79ea-2e97-4709-b844-8a4e8f2f2fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:07.375130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd79ea-2e97-4709-b844-8a4e8f2f2fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:07.375403 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd79ea-2e97-4709-b844-8a4e8f2f2fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:07.376103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd79ea-2e97-4709-b844-8a4e8f2f2fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:07.377847 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd79ea-2e97-4709-b844-8a4e8f2f2fcc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:07.389939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1387/2805] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:33:07.394216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056c9fd-3cb8-4240-a9fd-2ac5964fe000 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:07.404765 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056c9fd-3cb8-4240-a9fd-2ac5964fe000 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:07.409875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc182c6-2544-4aab-b421-280b313ae518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:07.410616 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc182c6-2544-4aab-b421-280b313ae518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:07.410904 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc182c6-2544-4aab-b421-280b313ae518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:07.411189 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc182c6-2544-4aab-b421-280b313ae518 admin admin] PATH_INFO: `/v3/projects/1a604d27e02a483aa70fd6562ceb7b0e/users/151d2c592a55436c92395e60ee76bebd/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:07.427887 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc182c6-2544-4aab-b421-280b313ae518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a604d27e02a483aa70fd6562ceb7b0e, user_id=151d2c592a55436c92395e60ee76bebd, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:07.431489 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc182c6-2544-4aab-b421-280b313ae518 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:07.592243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1419/2806] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:33:07 2022] PUT /identity/v3/projects/1a604d27e02a483aa70fd6562ceb7b0e/users/151d2c592a55436c92395e60ee76bebd/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:07.596631 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd79ea-2e97-4709-b844-8a4e8f2f2fcc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:07.609225 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd79ea-2e97-4709-b844-8a4e8f2f2fcc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:07.638392 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:07.675173 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f765e-d8e6-4f1c-9878-78fa67d87e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:07.675830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f765e-d8e6-4f1c-9878-78fa67d87e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:07.676151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f765e-d8e6-4f1c-9878-78fa67d87e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:07.676450 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f765e-d8e6-4f1c-9878-78fa67d87e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:07.677928 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f765e-d8e6-4f1c-9878-78fa67d87e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:07.679688 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f765e-d8e6-4f1c-9878-78fa67d87e45 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:07.690830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1388/2807] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:33:07.695217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc182c6-2544-4aab-b421-280b313ae518 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:07.705630 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc182c6-2544-4aab-b421-280b313ae518 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:07.712172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd270449-7db8-4dd5-9ca9-b587f93d07f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:07.712172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd270449-7db8-4dd5-9ca9-b587f93d07f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:07.712172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd270449-7db8-4dd5-9ca9-b587f93d07f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:07.712172 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd270449-7db8-4dd5-9ca9-b587f93d07f0 admin admin] PATH_INFO: `/v3/projects/1a604d27e02a483aa70fd6562ceb7b0e/users/151d2c592a55436c92395e60ee76bebd/roles/17054492864541709fda49dbf677a7a2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:07.713968 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd270449-7db8-4dd5-9ca9-b587f93d07f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a604d27e02a483aa70fd6562ceb7b0e, user_id=151d2c592a55436c92395e60ee76bebd, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:07.716597 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd270449-7db8-4dd5-9ca9-b587f93d07f0 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:07.727885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1420/2808] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:33:07 2022] PUT /identity/v3/projects/1a604d27e02a483aa70fd6562ceb7b0e/users/151d2c592a55436c92395e60ee76bebd/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:07.739647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34123-edde-4daa-b61c-b80e48e1dfd2 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:07.739939 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34123-edde-4daa-b61c-b80e48e1dfd2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:07.740221 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34123-edde-4daa-b61c-b80e48e1dfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:07.773503 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2ee34123-edde-4daa-b61c-b80e48e1dfd2 None None] MFA Rules not processed for user `151d2c592a55436c92395e60ee76bebd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:07.776046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2ee34123-edde-4daa-b61c-b80e48e1dfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:07.854091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1389/2809] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:33:07.865684 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd270449-7db8-4dd5-9ca9-b587f93d07f0 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:07.867545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-cd270449-7db8-4dd5-9ca9-b587f93d07f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:07.919339 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:07.932397 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd270449-7db8-4dd5-9ca9-b587f93d07f0 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:07.936194 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca23c0a-b46e-44cf-b4ff-dfac02d310fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:07.936816 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca23c0a-b46e-44cf-b4ff-dfac02d310fe service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:07.937094 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca23c0a-b46e-44cf-b4ff-dfac02d310fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:07.937367 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca23c0a-b46e-44cf-b4ff-dfac02d310fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:07.996308 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca23c0a-b46e-44cf-b4ff-dfac02d310fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:07.997927 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca23c0a-b46e-44cf-b4ff-dfac02d310fe service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:08.010729 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1421/2810] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:33:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:33:11.919895 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee34123-edde-4daa-b61c-b80e48e1dfd2 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:11.921329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2ee34123-edde-4daa-b61c-b80e48e1dfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:11.934177 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee34123-edde-4daa-b61c-b80e48e1dfd2 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:11.937920 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344a975-2b6d-433b-ab85-0b4dca0f017e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:11.938583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344a975-2b6d-433b-ab85-0b4dca0f017e service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:11.939055 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344a975-2b6d-433b-ab85-0b4dca0f017e service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:11.939340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344a975-2b6d-433b-ab85-0b4dca0f017e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:11.949992 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344a975-2b6d-433b-ab85-0b4dca0f017e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:11.951788 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344a975-2b6d-433b-ab85-0b4dca0f017e service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:11.962384 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1390/2811] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:33:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:33:18.482832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=29 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:19.633929 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca23c0a-b46e-44cf-b4ff-dfac02d310fe service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:19.643355 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-4ca23c0a-b46e-44cf-b4ff-dfac02d310fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:19.711423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca23c0a-b46e-44cf-b4ff-dfac02d310fe service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:19.717018 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee1114-1b2e-4172-9eea-88b310d5c124 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:19.717644 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee1114-1b2e-4172-9eea-88b310d5c124 service placement] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:19.717930 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee1114-1b2e-4172-9eea-88b310d5c124 service placement] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:19.718203 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee1114-1b2e-4172-9eea-88b310d5c124 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:19.720113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-78ee1114-1b2e-4172-9eea-88b310d5c124 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:19.733140 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee1114-1b2e-4172-9eea-88b310d5c124 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:19.734772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee1114-1b2e-4172-9eea-88b310d5c124 service placement] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:19.745801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1422/2812] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:33:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:33:21.957222 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=58 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:28.056531 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344a975-2b6d-433b-ab85-0b4dca0f017e service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:28.140779 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344a975-2b6d-433b-ab85-0b4dca0f017e service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:28.149511 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8360b48-d714-4d15-a2ad-2b88f774baca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:28.150270 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8360b48-d714-4d15-a2ad-2b88f774baca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:28.150715 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8360b48-d714-4d15-a2ad-2b88f774baca admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:28.151204 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8360b48-d714-4d15-a2ad-2b88f774baca admin admin] PATH_INFO: `/v3/users/61555ca5e75647bbb52765b3f9e8f025` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:28.152675 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8360b48-d714-4d15-a2ad-2b88f774baca admin admin] RBAC: Authorizing `identity:delete_user(user_id=61555ca5e75647bbb52765b3f9e8f025)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:28.155858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8360b48-d714-4d15-a2ad-2b88f774baca admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:28.393455 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-f8360b48-d714-4d15-a2ad-2b88f774baca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61555ca5e75647bbb52765b3f9e8f025'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:28.394602 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-f8360b48-d714-4d15-a2ad-2b88f774baca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61555ca5e75647bbb52765b3f9e8f025'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:28.409752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-f8360b48-d714-4d15-a2ad-2b88f774baca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61555ca5e75647bbb52765b3f9e8f025'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:28.410550 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-f8360b48-d714-4d15-a2ad-2b88f774baca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61555ca5e75647bbb52765b3f9e8f025'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:28.499606 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-f8360b48-d714-4d15-a2ad-2b88f774baca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61555ca5e75647bbb52765b3f9e8f025'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:28.516723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1391/2813] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:33:28 2022] DELETE /identity/v3/users/61555ca5e75647bbb52765b3f9e8f025 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:28.523734 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8ae4b-388b-4275-86cd-9ffca8c001c3 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:28.524426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8ae4b-388b-4275-86cd-9ffca8c001c3 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:28.524426 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8ae4b-388b-4275-86cd-9ffca8c001c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:28.549315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-5bb8ae4b-388b-4275-86cd-9ffca8c001c3 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:28.553804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5bb8ae4b-388b-4275-86cd-9ffca8c001c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:28.630217 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1423/2814] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:33:28.643156 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8360b48-d714-4d15-a2ad-2b88f774baca admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:28.644903 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f8360b48-d714-4d15-a2ad-2b88f774baca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:28.729659 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8360b48-d714-4d15-a2ad-2b88f774baca admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:28.738927 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a2e4-35bf-480e-8e76-f71f68e67843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:28.739577 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a2e4-35bf-480e-8e76-f71f68e67843 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:28.739859 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a2e4-35bf-480e-8e76-f71f68e67843 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:28.740856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a2e4-35bf-480e-8e76-f71f68e67843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:28.753108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a2e4-35bf-480e-8e76-f71f68e67843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:28.754653 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a2e4-35bf-480e-8e76-f71f68e67843 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:28.768609 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1392/2815] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:33:29.550269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8ae4b-388b-4275-86cd-9ffca8c001c3 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:29.563649 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-5bb8ae4b-388b-4275-86cd-9ffca8c001c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:29.642312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a2e4-35bf-480e-8e76-f71f68e67843 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:29.646060 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9c08a2e4-35bf-480e-8e76-f71f68e67843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:29.655221 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8ae4b-388b-4275-86cd-9ffca8c001c3 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:29.667443 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87332af-2429-475f-b71b-a35a4b4a9c89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:29.667650 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a2e4-35bf-480e-8e76-f71f68e67843 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:29.668362 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87332af-2429-475f-b71b-a35a4b4a9c89 service placement] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:29.668547 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87332af-2429-475f-b71b-a35a4b4a9c89 service placement] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:29.668956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87332af-2429-475f-b71b-a35a4b4a9c89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:29.672671 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c87332af-2429-475f-b71b-a35a4b4a9c89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:29.677175 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:29.678070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:29.678573 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:29.678936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5 admin admin] PATH_INFO: `/v3/projects/529803bd144547eb8fda2714918f7b49` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:29.681009 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=529803bd144547eb8fda2714918f7b49)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:29.683826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:29.697420 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87332af-2429-475f-b71b-a35a4b4a9c89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:29.700582 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87332af-2429-475f-b71b-a35a4b4a9c89 service placement] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:29.716014 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:29.721959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1424/2816] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:33:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:33:29.753266 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87332af-2429-475f-b71b-a35a4b4a9c89 service placement] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:29.755459 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-c87332af-2429-475f-b71b-a35a4b4a9c89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:29.778993 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87332af-2429-475f-b71b-a35a4b4a9c89 service placement] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:29.784369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8e780-ac79-4f9e-98d6-d1d2d718c96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:29.785202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8e780-ac79-4f9e-98d6-d1d2d718c96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:29.785533 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8e780-ac79-4f9e-98d6-d1d2d718c96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:29.785892 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8e780-ac79-4f9e-98d6-d1d2d718c96c admin admin] PATH_INFO: `/v3/users/0a01e95be96f494e924faeca9e6e0679` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:29.788002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8e780-ac79-4f9e-98d6-d1d2d718c96c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a01e95be96f494e924faeca9e6e0679)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:29.790589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8e780-ac79-4f9e-98d6-d1d2d718c96c admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:29.807173 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:29.847432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '529803bd144547eb8fda2714918f7b49', 'request_id': 'req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:29.858508 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '529803bd144547eb8fda2714918f7b49', 'request_id': 'req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:29.870963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '529803bd144547eb8fda2714918f7b49', 'request_id': 'req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:30.027268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5 admin admin] The token cache is being invalidate because project 529803bd144547eb8fda2714918f7b49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:33:30.027683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:30.028811 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:30.030531 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1393/2817] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:33:29 2022] DELETE /identity/v3/projects/529803bd144547eb8fda2714918f7b49 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:33:30.035216 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:30.037211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:30.082970 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-97e8e780-ac79-4f9e-98d6-d1d2d718c96c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a01e95be96f494e924faeca9e6e0679'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:30.084111 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-97e8e780-ac79-4f9e-98d6-d1d2d718c96c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a01e95be96f494e924faeca9e6e0679'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:30.111757 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-97e8e780-ac79-4f9e-98d6-d1d2d718c96c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a01e95be96f494e924faeca9e6e0679'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:30.148416 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6fae3-9d3e-492d-b78b-5a53d8a219e5 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:30.154135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93884a9b-2a97-48d5-a8fb-9f0f4c763542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:30.154973 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93884a9b-2a97-48d5-a8fb-9f0f4c763542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:30.155258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93884a9b-2a97-48d5-a8fb-9f0f4c763542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:30.155738 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93884a9b-2a97-48d5-a8fb-9f0f4c763542 admin admin] PATH_INFO: `/v3/users/151d2c592a55436c92395e60ee76bebd` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:30.157288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93884a9b-2a97-48d5-a8fb-9f0f4c763542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=151d2c592a55436c92395e60ee76bebd)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:30.159578 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93884a9b-2a97-48d5-a8fb-9f0f4c763542 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:30.259638 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-97e8e780-ac79-4f9e-98d6-d1d2d718c96c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a01e95be96f494e924faeca9e6e0679'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:30.260464 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-97e8e780-ac79-4f9e-98d6-d1d2d718c96c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a01e95be96f494e924faeca9e6e0679'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:30.276269 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1425/2818] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:33:29 2022] DELETE /identity/v3/users/0a01e95be96f494e924faeca9e6e0679 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:30.485103 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-93884a9b-2a97-48d5-a8fb-9f0f4c763542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '151d2c592a55436c92395e60ee76bebd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:30.485937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-93884a9b-2a97-48d5-a8fb-9f0f4c763542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '151d2c592a55436c92395e60ee76bebd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:30.509557 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-93884a9b-2a97-48d5-a8fb-9f0f4c763542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '151d2c592a55436c92395e60ee76bebd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:30.510619 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-93884a9b-2a97-48d5-a8fb-9f0f4c763542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '151d2c592a55436c92395e60ee76bebd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:30.595336 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-93884a9b-2a97-48d5-a8fb-9f0f4c763542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '151d2c592a55436c92395e60ee76bebd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:30.624545 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1394/2819] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:33:30 2022] DELETE /identity/v3/users/151d2c592a55436c92395e60ee76bebd => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:33:30.877327 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8e780-ac79-4f9e-98d6-d1d2d718c96c admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:30.878925 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-97e8e780-ac79-4f9e-98d6-d1d2d718c96c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:30.969586 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8e780-ac79-4f9e-98d6-d1d2d718c96c admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:31.041543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e25b7-5dc1-49a4-acfb-a1c0f51234d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:31.042590 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e25b7-5dc1-49a4-acfb-a1c0f51234d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:31.043139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e25b7-5dc1-49a4-acfb-a1c0f51234d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:31.043599 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e25b7-5dc1-49a4-acfb-a1c0f51234d2 admin admin] PATH_INFO: `/v3/projects/d068df362d7e41dabc45f7ec1631f00c` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:31.045034 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e25b7-5dc1-49a4-acfb-a1c0f51234d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d068df362d7e41dabc45f7ec1631f00c)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:31.047285 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e25b7-5dc1-49a4-acfb-a1c0f51234d2 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:31.157184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93884a9b-2a97-48d5-a8fb-9f0f4c763542 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:31.159610 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-93884a9b-2a97-48d5-a8fb-9f0f4c763542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:31.171875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:31.182419 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bc6e25b7-5dc1-49a4-acfb-a1c0f51234d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd068df362d7e41dabc45f7ec1631f00c', 'request_id': 'req-bc6e25b7-5dc1-49a4-acfb-a1c0f51234d2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:31.184742 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93884a9b-2a97-48d5-a8fb-9f0f4c763542 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:31.226834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:31.274211 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cf98e-2db6-4412-9dc3-528cf3846995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:31.274947 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cf98e-2db6-4412-9dc3-528cf3846995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:31.275223 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cf98e-2db6-4412-9dc3-528cf3846995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:31.275586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cf98e-2db6-4412-9dc3-528cf3846995 admin admin] PATH_INFO: `/v3/projects/1a604d27e02a483aa70fd6562ceb7b0e` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:31.276716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cf98e-2db6-4412-9dc3-528cf3846995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a604d27e02a483aa70fd6562ceb7b0e)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:31.278692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cf98e-2db6-4412-9dc3-528cf3846995 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:31.289503 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bc6e25b7-5dc1-49a4-acfb-a1c0f51234d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd068df362d7e41dabc45f7ec1631f00c', 'request_id': 'req-bc6e25b7-5dc1-49a4-acfb-a1c0f51234d2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:31.297875 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bc6e25b7-5dc1-49a4-acfb-a1c0f51234d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd068df362d7e41dabc45f7ec1631f00c', 'request_id': 'req-bc6e25b7-5dc1-49a4-acfb-a1c0f51234d2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:31.312353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bc6e25b7-5dc1-49a4-acfb-a1c0f51234d2 admin admin] The token cache is being invalidate because project d068df362d7e41dabc45f7ec1631f00c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:33:31.312659 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bc6e25b7-5dc1-49a4-acfb-a1c0f51234d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:31.313346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bc6e25b7-5dc1-49a4-acfb-a1c0f51234d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:31.315263 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1426/2820] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:33:30 2022] DELETE /identity/v3/projects/d068df362d7e41dabc45f7ec1631f00c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:33:31.321037 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a49fd-ddea-4dd1-b217-b528f260de54 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:31.321370 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a49fd-ddea-4dd1-b217-b528f260de54 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:31.321652 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a49fd-ddea-4dd1-b217-b528f260de54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:31.343444 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-a32a49fd-ddea-4dd1-b217-b528f260de54 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:31.344754 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-a32a49fd-ddea-4dd1-b217-b528f260de54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:31.356024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1427/2821] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:33:31.368600 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fa954-7c8e-40e6-a95a-9bff10e260b2 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:31.368600 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fa954-7c8e-40e6-a95a-9bff10e260b2 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:31.368600 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fa954-7c8e-40e6-a95a-9bff10e260b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:31.388620 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-ea4fa954-7c8e-40e6-a95a-9bff10e260b2 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:31.397346 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ea4fa954-7c8e-40e6-a95a-9bff10e260b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:31.399060 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1428/2822] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:33:31.403532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fa954-7c8e-40e6-a95a-9bff10e260b2 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:31.413720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fa954-7c8e-40e6-a95a-9bff10e260b2 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:31.419923 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66c292-a693-471c-a7c9-02c8203a6db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:31.420536 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66c292-a693-471c-a7c9-02c8203a6db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:31.425458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66c292-a693-471c-a7c9-02c8203a6db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:31.425458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66c292-a693-471c-a7c9-02c8203a6db2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:31.425458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66c292-a693-471c-a7c9-02c8203a6db2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:33:31.425458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66c292-a693-471c-a7c9-02c8203a6db2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:31.425458 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66c292-a693-471c-a7c9-02c8203a6db2 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:31.438297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1429/2823] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:33:31.444436 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66c292-a693-471c-a7c9-02c8203a6db2 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:31.445791 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-4c2cf98e-2db6-4412-9dc3-528cf3846995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a604d27e02a483aa70fd6562ceb7b0e', 'request_id': 'req-4c2cf98e-2db6-4412-9dc3-528cf3846995'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:31.455882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66c292-a693-471c-a7c9-02c8203a6db2 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:31.456842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-4c2cf98e-2db6-4412-9dc3-528cf3846995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a604d27e02a483aa70fd6562ceb7b0e', 'request_id': 'req-4c2cf98e-2db6-4412-9dc3-528cf3846995'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:31.471114 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-4c2cf98e-2db6-4412-9dc3-528cf3846995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a604d27e02a483aa70fd6562ceb7b0e', 'request_id': 'req-4c2cf98e-2db6-4412-9dc3-528cf3846995'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:31.550440 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-4c2cf98e-2db6-4412-9dc3-528cf3846995 admin admin] The token cache is being invalidate because project 1a604d27e02a483aa70fd6562ceb7b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:33:31.551057 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-4c2cf98e-2db6-4412-9dc3-528cf3846995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:31.552258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-4c2cf98e-2db6-4412-9dc3-528cf3846995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:31.553753 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0b471-35c9-47bd-af75-b10ddf75bfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:31.554905 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0b471-35c9-47bd-af75-b10ddf75bfd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:31.555399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0b471-35c9-47bd-af75-b10ddf75bfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:31.560224 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1395/2824] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:33:31 2022] DELETE /identity/v3/projects/1a604d27e02a483aa70fd6562ceb7b0e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:31.560526 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0b471-35c9-47bd-af75-b10ddf75bfd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:31.560526 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0b471-35c9-47bd-af75-b10ddf75bfd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:31.561077 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0b471-35c9-47bd-af75-b10ddf75bfd1 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:31.563332 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30261615-d4b5-4b6a-b24d-6b38f8758770 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:31.563947 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30261615-d4b5-4b6a-b24d-6b38f8758770 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:31.564547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30261615-d4b5-4b6a-b24d-6b38f8758770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:31.600934 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-30261615-d4b5-4b6a-b24d-6b38f8758770 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:31.603198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-30261615-d4b5-4b6a-b24d-6b38f8758770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:31.618854 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1396/2825] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:33:31.633549 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df38e18-ea73-4760-9e91-88c6a0c96661 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:31.634091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df38e18-ea73-4760-9e91-88c6a0c96661 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:31.634691 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df38e18-ea73-4760-9e91-88c6a0c96661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:31.669144 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2df38e18-ea73-4760-9e91-88c6a0c96661 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:31.671326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2df38e18-ea73-4760-9e91-88c6a0c96661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:31.685534 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1397/2826] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:33:31.691720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df38e18-ea73-4760-9e91-88c6a0c96661 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:31.696603 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1430/2827] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:33:31 2022] POST /identity/v3/projects => generated 389 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:33:31.703278 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0b471-35c9-47bd-af75-b10ddf75bfd1 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:31.705198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df38e18-ea73-4760-9e91-88c6a0c96661 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:31.706057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-40f0b471-35c9-47bd-af75-b10ddf75bfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:31.809778 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0a014-ecd1-4475-a7ff-64d131707997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:31.810649 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0a014-ecd1-4475-a7ff-64d131707997 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:31.810936 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0a014-ecd1-4475-a7ff-64d131707997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:31.811215 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0a014-ecd1-4475-a7ff-64d131707997 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:31.811946 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0a014-ecd1-4475-a7ff-64d131707997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:33:31.812257 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0a014-ecd1-4475-a7ff-64d131707997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:31.813916 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0a014-ecd1-4475-a7ff-64d131707997 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:31.828601 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1398/2828] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:33:31.833335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0a014-ecd1-4475-a7ff-64d131707997 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:31.835281 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0b471-35c9-47bd-af75-b10ddf75bfd1 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:31.842648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aafb76-2a24-4753-af6a-147df32526fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:31.843134 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aafb76-2a24-4753-af6a-147df32526fd admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:31.843410 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aafb76-2a24-4753-af6a-147df32526fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:31.843683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aafb76-2a24-4753-af6a-147df32526fd admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:31.844480 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aafb76-2a24-4753-af6a-147df32526fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:31.845316 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0a014-ecd1-4475-a7ff-64d131707997 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:31.846577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aafb76-2a24-4753-af6a-147df32526fd admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:31.851618 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58317c50-09d5-4897-bd47-8e55343ac2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:31.852402 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58317c50-09d5-4897-bd47-8e55343ac2db admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:31.852725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58317c50-09d5-4897-bd47-8e55343ac2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:31.853080 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58317c50-09d5-4897-bd47-8e55343ac2db admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:31.853898 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58317c50-09d5-4897-bd47-8e55343ac2db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:31.856469 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58317c50-09d5-4897-bd47-8e55343ac2db admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:31.961821 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1431/2829] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:33:31 2022] POST /identity/v3/users => generated 295 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:33:31.967502 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aafb76-2a24-4753-af6a-147df32526fd admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:31.983080 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aafb76-2a24-4753-af6a-147df32526fd admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:31.984934 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c48b64-6b77-4c1c-ab3b-ae525a0ca3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:31.985569 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c48b64-6b77-4c1c-ab3b-ae525a0ca3df admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:31.985853 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c48b64-6b77-4c1c-ab3b-ae525a0ca3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:31.986137 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c48b64-6b77-4c1c-ab3b-ae525a0ca3df admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:31.986907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c48b64-6b77-4c1c-ab3b-ae525a0ca3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:31.988568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c48b64-6b77-4c1c-ab3b-ae525a0ca3df admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:32.001067 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1432/2830] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:33:32.005350 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c48b64-6b77-4c1c-ab3b-ae525a0ca3df admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:32.014729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1399/2831] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:33:31 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:33:32.017417 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c48b64-6b77-4c1c-ab3b-ae525a0ca3df admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:32.019596 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58317c50-09d5-4897-bd47-8e55343ac2db admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:32.024281 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:32.039723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:32.089293 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d916ace-31a7-47ec-bbb6-7dcbb8bd6110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:32.092010 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d916ace-31a7-47ec-bbb6-7dcbb8bd6110 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:32.092318 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d916ace-31a7-47ec-bbb6-7dcbb8bd6110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:32.092656 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d916ace-31a7-47ec-bbb6-7dcbb8bd6110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:32.093409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d916ace-31a7-47ec-bbb6-7dcbb8bd6110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:32.095162 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d916ace-31a7-47ec-bbb6-7dcbb8bd6110 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:32.116851 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1433/2832] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:33:32.122560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d916ace-31a7-47ec-bbb6-7dcbb8bd6110 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:32.124158 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58317c50-09d5-4897-bd47-8e55343ac2db admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:32.134686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d916ace-31a7-47ec-bbb6-7dcbb8bd6110 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:32.135112 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7755c-eb2f-45e4-830a-c90dbcd24d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:32.135770 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7755c-eb2f-45e4-830a-c90dbcd24d9f admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:32.136052 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7755c-eb2f-45e4-830a-c90dbcd24d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:32.136328 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7755c-eb2f-45e4-830a-c90dbcd24d9f admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:32.137025 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7755c-eb2f-45e4-830a-c90dbcd24d9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:32.139117 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7755c-eb2f-45e4-830a-c90dbcd24d9f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:32.142005 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd220e-4695-4bef-a247-49e817433393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:32.147192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd220e-4695-4bef-a247-49e817433393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:32.147192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd220e-4695-4bef-a247-49e817433393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:32.147192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd220e-4695-4bef-a247-49e817433393 admin admin] PATH_INFO: `/v3/projects/d0999d9d70044ad8a89fa76f96537f89/users/25c26b8ca16a4a8aaf2cc55131fc6a59/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:32.164834 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd220e-4695-4bef-a247-49e817433393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0999d9d70044ad8a89fa76f96537f89, user_id=25c26b8ca16a4a8aaf2cc55131fc6a59, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:32.167936 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd220e-4695-4bef-a247-49e817433393 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:32.294425 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1400/2833] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:33:32 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:33:32.294981 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1434/2834] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:33:32 2022] PUT /identity/v3/projects/d0999d9d70044ad8a89fa76f96537f89/users/25c26b8ca16a4a8aaf2cc55131fc6a59/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:33:32.295114 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7755c-eb2f-45e4-830a-c90dbcd24d9f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:32.299348 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7755c-eb2f-45e4-830a-c90dbcd24d9f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:32.304485 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19338f8-6f08-4c8f-b5b0-819a17e976eb None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:32.307798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19338f8-6f08-4c8f-b5b0-819a17e976eb None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:32.307798 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19338f8-6f08-4c8f-b5b0-819a17e976eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:32.339055 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-d19338f8-6f08-4c8f-b5b0-819a17e976eb None None] MFA Rules not processed for user `25c26b8ca16a4a8aaf2cc55131fc6a59`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:32.340456 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d19338f8-6f08-4c8f-b5b0-819a17e976eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:32.383923 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc0d4a-55d8-4ba1-937e-54e6233a9c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:32.384568 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc0d4a-55d8-4ba1-937e-54e6233a9c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:32.384857 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc0d4a-55d8-4ba1-937e-54e6233a9c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:32.385138 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc0d4a-55d8-4ba1-937e-54e6233a9c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:32.385851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc0d4a-55d8-4ba1-937e-54e6233a9c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:32.387566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc0d4a-55d8-4ba1-937e-54e6233a9c8a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:32.405823 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1401/2835] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:33:32.407061 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc0d4a-55d8-4ba1-937e-54e6233a9c8a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:32.419672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc0d4a-55d8-4ba1-937e-54e6233a9c8a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:32.424594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5bc90-350c-4a63-9b8c-060ea11ba077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:32.425604 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5bc90-350c-4a63-9b8c-060ea11ba077 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:32.427255 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5bc90-350c-4a63-9b8c-060ea11ba077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:32.427255 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5bc90-350c-4a63-9b8c-060ea11ba077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:32.427479 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1435/2836] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:33:32.427669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5bc90-350c-4a63-9b8c-060ea11ba077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:32.434289 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5bc90-350c-4a63-9b8c-060ea11ba077 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:32.438695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19338f8-6f08-4c8f-b5b0-819a17e976eb None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:32.440578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-d19338f8-6f08-4c8f-b5b0-819a17e976eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:32.444630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1402/2837] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:33:32.449267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5bc90-350c-4a63-9b8c-060ea11ba077 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:32.460259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5bc90-350c-4a63-9b8c-060ea11ba077 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:32.467907 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a8f48-601c-4743-9fd8-f686c4fe99f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:32.468653 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a8f48-601c-4743-9fd8-f686c4fe99f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:32.468885 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a8f48-601c-4743-9fd8-f686c4fe99f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:32.469200 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a8f48-601c-4743-9fd8-f686c4fe99f2 admin admin] PATH_INFO: `/v3/projects/c275678d3f4f4a528ba45b715cdabb0e/users/e792780198b04732aaaa1e19d1633fcb/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:32.486342 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a8f48-601c-4743-9fd8-f686c4fe99f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c275678d3f4f4a528ba45b715cdabb0e, user_id=e792780198b04732aaaa1e19d1633fcb, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:32.489596 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a8f48-601c-4743-9fd8-f686c4fe99f2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:32.530064 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19338f8-6f08-4c8f-b5b0-819a17e976eb None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:32.536409 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555de85b-e7f4-441a-a76c-f4b137e92a82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:32.540007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555de85b-e7f4-441a-a76c-f4b137e92a82 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:32.540007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555de85b-e7f4-441a-a76c-f4b137e92a82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:32.540007 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555de85b-e7f4-441a-a76c-f4b137e92a82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:32.554686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555de85b-e7f4-441a-a76c-f4b137e92a82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:32.556479 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555de85b-e7f4-441a-a76c-f4b137e92a82 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:32.566709 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1403/2838] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:33:32 2022] PUT /identity/v3/projects/c275678d3f4f4a528ba45b715cdabb0e/users/e792780198b04732aaaa1e19d1633fcb/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:33:32.567497 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1436/2839] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:33:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:33:32.580108 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea74c76-5f1e-4a61-bf68-75a691ee2527 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:32.580397 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea74c76-5f1e-4a61-bf68-75a691ee2527 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:32.580900 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea74c76-5f1e-4a61-bf68-75a691ee2527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:32.634011 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3ea74c76-5f1e-4a61-bf68-75a691ee2527 None None] MFA Rules not processed for user `e792780198b04732aaaa1e19d1633fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:32.635729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3ea74c76-5f1e-4a61-bf68-75a691ee2527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:32.731569 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:32.745231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1404/2840] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:33:32.750914 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555de85b-e7f4-441a-a76c-f4b137e92a82 service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:32.768284 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555de85b-e7f4-441a-a76c-f4b137e92a82 service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:32.779711 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:32.853584 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f692f-a228-4589-a3cc-1aa865512e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:32.855243 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f692f-a228-4589-a3cc-1aa865512e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:32.855532 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f692f-a228-4589-a3cc-1aa865512e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:32.855852 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f692f-a228-4589-a3cc-1aa865512e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:32.856546 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f692f-a228-4589-a3cc-1aa865512e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:32.858648 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f692f-a228-4589-a3cc-1aa865512e44 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:33.034954 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1437/2841] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:33:32 2022] POST /identity/v3/projects => generated 377 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:33:33.037022 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea74c76-5f1e-4a61-bf68-75a691ee2527 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:33.058154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea74c76-5f1e-4a61-bf68-75a691ee2527 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:33.159039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb890c-c6ed-49e4-81c3-c06962b159ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:33.159729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb890c-c6ed-49e4-81c3-c06962b159ef admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:33.160064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb890c-c6ed-49e4-81c3-c06962b159ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:33.160362 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb890c-c6ed-49e4-81c3-c06962b159ef admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:33.161195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb890c-c6ed-49e4-81c3-c06962b159ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:33.163903 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb890c-c6ed-49e4-81c3-c06962b159ef admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:33.289351 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1405/2842] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:33:33 2022] POST /identity/v3/users => generated 295 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:33:33.295104 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f692f-a228-4589-a3cc-1aa865512e44 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:33.307304 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f692f-a228-4589-a3cc-1aa865512e44 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:33.312233 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273adad-d6b1-4374-b84e-b15941b5f615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:33.312863 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273adad-d6b1-4374-b84e-b15941b5f615 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:33.313151 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273adad-d6b1-4374-b84e-b15941b5f615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:33.313606 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273adad-d6b1-4374-b84e-b15941b5f615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:33.314587 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273adad-d6b1-4374-b84e-b15941b5f615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:33.316215 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273adad-d6b1-4374-b84e-b15941b5f615 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:33.331122 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1438/2843] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:33:33.335971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb890c-c6ed-49e4-81c3-c06962b159ef admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:33.348062 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb890c-c6ed-49e4-81c3-c06962b159ef admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:33.354304 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028257f-3a6e-4fc3-a46c-cf1a2b303953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:33.355648 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028257f-3a6e-4fc3-a46c-cf1a2b303953 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:33.355648 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028257f-3a6e-4fc3-a46c-cf1a2b303953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:33.355648 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028257f-3a6e-4fc3-a46c-cf1a2b303953 admin admin] PATH_INFO: `/v3/projects/2e0faf14c3d847089a8daae8c8461852/users/1aa41abe6072498fab9daf9d2ff95288/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:33.374856 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028257f-3a6e-4fc3-a46c-cf1a2b303953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0faf14c3d847089a8daae8c8461852, user_id=1aa41abe6072498fab9daf9d2ff95288, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:33.378427 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028257f-3a6e-4fc3-a46c-cf1a2b303953 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:33.521826 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1406/2844] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:33:33 2022] PUT /identity/v3/projects/2e0faf14c3d847089a8daae8c8461852/users/1aa41abe6072498fab9daf9d2ff95288/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:33.523403 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273adad-d6b1-4374-b84e-b15941b5f615 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:33.535862 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273adad-d6b1-4374-b84e-b15941b5f615 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:33.616159 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b1f1f-c9b7-4711-82a5-b16f03bc87b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:33.616967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b1f1f-c9b7-4711-82a5-b16f03bc87b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:33.617353 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b1f1f-c9b7-4711-82a5-b16f03bc87b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:33.618742 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b1f1f-c9b7-4711-82a5-b16f03bc87b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:33.620513 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b1f1f-c9b7-4711-82a5-b16f03bc87b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:33.623686 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b1f1f-c9b7-4711-82a5-b16f03bc87b6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:33.639466 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1439/2845] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:33:33.646110 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028257f-3a6e-4fc3-a46c-cf1a2b303953 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:33.665871 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028257f-3a6e-4fc3-a46c-cf1a2b303953 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:33.672066 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64cc98-ad75-4d38-9d2f-4cbd29dd02a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:33.672899 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64cc98-ad75-4d38-9d2f-4cbd29dd02a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:33.673407 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64cc98-ad75-4d38-9d2f-4cbd29dd02a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:33.673658 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64cc98-ad75-4d38-9d2f-4cbd29dd02a8 admin admin] PATH_INFO: `/v3/projects/2e0faf14c3d847089a8daae8c8461852/users/1aa41abe6072498fab9daf9d2ff95288/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:33.676032 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64cc98-ad75-4d38-9d2f-4cbd29dd02a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0faf14c3d847089a8daae8c8461852, user_id=1aa41abe6072498fab9daf9d2ff95288, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:33.681848 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64cc98-ad75-4d38-9d2f-4cbd29dd02a8 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:33.712972 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1407/2846] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:33:33 2022] PUT /identity/v3/projects/2e0faf14c3d847089a8daae8c8461852/users/1aa41abe6072498fab9daf9d2ff95288/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:33.716744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450176dd-8a0a-4733-a5fe-43777f27b61e None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:33.717037 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450176dd-8a0a-4733-a5fe-43777f27b61e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:33.717326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450176dd-8a0a-4733-a5fe-43777f27b61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:33.760262 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-450176dd-8a0a-4733-a5fe-43777f27b61e None None] MFA Rules not processed for user `1aa41abe6072498fab9daf9d2ff95288`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:33.762626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-450176dd-8a0a-4733-a5fe-43777f27b61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:33.857197 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1440/2847] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:33:33.869566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64cc98-ad75-4d38-9d2f-4cbd29dd02a8 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:33.942716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64cc98-ad75-4d38-9d2f-4cbd29dd02a8 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:33.948952 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54c1b8-0732-412f-8785-fca592e5a48c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:33.950153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54c1b8-0732-412f-8785-fca592e5a48c service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:33.950153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54c1b8-0732-412f-8785-fca592e5a48c service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:33.951193 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54c1b8-0732-412f-8785-fca592e5a48c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:34.030281 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54c1b8-0732-412f-8785-fca592e5a48c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:34.031672 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54c1b8-0732-412f-8785-fca592e5a48c service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:34.036787 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:34.041778 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1408/2848] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:33:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:33:36.109821 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450176dd-8a0a-4733-a5fe-43777f27b61e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:36.124296 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450176dd-8a0a-4733-a5fe-43777f27b61e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:36.128245 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087426a2-c77a-4c05-8f0a-0e82de8c2c5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:36.128882 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087426a2-c77a-4c05-8f0a-0e82de8c2c5c service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:36.129164 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087426a2-c77a-4c05-8f0a-0e82de8c2c5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:36.129437 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087426a2-c77a-4c05-8f0a-0e82de8c2c5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:36.140438 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:36.144612 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087426a2-c77a-4c05-8f0a-0e82de8c2c5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:36.146063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087426a2-c77a-4c05-8f0a-0e82de8c2c5c service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:36.157987 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1441/2849] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:33:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:33:41.966645 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54c1b8-0732-412f-8785-fca592e5a48c service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:42.088708 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54c1b8-0732-412f-8785-fca592e5a48c service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:42.099049 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708ddaf-f40e-4edb-9620-3a3dd9b00ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:42.101707 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708ddaf-f40e-4edb-9620-3a3dd9b00ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:42.102190 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708ddaf-f40e-4edb-9620-3a3dd9b00ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:42.102723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708ddaf-f40e-4edb-9620-3a3dd9b00ce7 admin admin] PATH_INFO: `/v3/users/e792780198b04732aaaa1e19d1633fcb` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:42.104963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708ddaf-f40e-4edb-9620-3a3dd9b00ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e792780198b04732aaaa1e19d1633fcb)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:42.108079 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708ddaf-f40e-4edb-9620-3a3dd9b00ce7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:42.477644 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9708ddaf-f40e-4edb-9620-3a3dd9b00ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e792780198b04732aaaa1e19d1633fcb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:42.478393 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9708ddaf-f40e-4edb-9620-3a3dd9b00ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e792780198b04732aaaa1e19d1633fcb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:42.501766 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9708ddaf-f40e-4edb-9620-3a3dd9b00ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e792780198b04732aaaa1e19d1633fcb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:42.503369 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9708ddaf-f40e-4edb-9620-3a3dd9b00ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e792780198b04732aaaa1e19d1633fcb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:42.609154 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9708ddaf-f40e-4edb-9620-3a3dd9b00ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e792780198b04732aaaa1e19d1633fcb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:42.634987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1409/2850] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:33:41 2022] DELETE /identity/v3/users/e792780198b04732aaaa1e19d1633fcb => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:33:42.643041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45641976-3310-4cdf-bb40-f73f8f06b169 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:42.643647 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45641976-3310-4cdf-bb40-f73f8f06b169 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:42.644140 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45641976-3310-4cdf-bb40-f73f8f06b169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:42.691759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-45641976-3310-4cdf-bb40-f73f8f06b169 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:42.693997 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-45641976-3310-4cdf-bb40-f73f8f06b169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:42.818494 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1442/2851] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:33:42.832676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708ddaf-f40e-4edb-9620-3a3dd9b00ce7 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:42.848092 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9708ddaf-f40e-4edb-9620-3a3dd9b00ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:42.951453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708ddaf-f40e-4edb-9620-3a3dd9b00ce7 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:42.957902 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc732f-1977-469f-a02a-3895933a6800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:42.959424 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc732f-1977-469f-a02a-3895933a6800 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:42.959424 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc732f-1977-469f-a02a-3895933a6800 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:42.959424 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc732f-1977-469f-a02a-3895933a6800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:42.971335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc732f-1977-469f-a02a-3895933a6800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:42.974818 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc732f-1977-469f-a02a-3895933a6800 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:42.986346 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1410/2852] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:33:43.630327 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45641976-3310-4cdf-bb40-f73f8f06b169 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:43.633669 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-45641976-3310-4cdf-bb40-f73f8f06b169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:43.652877 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45641976-3310-4cdf-bb40-f73f8f06b169 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:43.663678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694fe55-de54-4aff-aa2a-a7387f82b934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:43.664473 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694fe55-de54-4aff-aa2a-a7387f82b934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:43.664860 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694fe55-de54-4aff-aa2a-a7387f82b934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:43.665241 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694fe55-de54-4aff-aa2a-a7387f82b934 admin admin] PATH_INFO: `/v3/projects/c275678d3f4f4a528ba45b715cdabb0e` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:43.668521 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694fe55-de54-4aff-aa2a-a7387f82b934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c275678d3f4f4a528ba45b715cdabb0e)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:43.671596 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694fe55-de54-4aff-aa2a-a7387f82b934 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:43.859057 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3694fe55-de54-4aff-aa2a-a7387f82b934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c275678d3f4f4a528ba45b715cdabb0e', 'request_id': 'req-3694fe55-de54-4aff-aa2a-a7387f82b934'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:43.961385 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3694fe55-de54-4aff-aa2a-a7387f82b934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c275678d3f4f4a528ba45b715cdabb0e', 'request_id': 'req-3694fe55-de54-4aff-aa2a-a7387f82b934'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:43.975193 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3694fe55-de54-4aff-aa2a-a7387f82b934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c275678d3f4f4a528ba45b715cdabb0e', 'request_id': 'req-3694fe55-de54-4aff-aa2a-a7387f82b934'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:43.998101 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3694fe55-de54-4aff-aa2a-a7387f82b934 admin admin] The token cache is being invalidate because project c275678d3f4f4a528ba45b715cdabb0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:33:43.998677 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3694fe55-de54-4aff-aa2a-a7387f82b934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:43.999896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-3694fe55-de54-4aff-aa2a-a7387f82b934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:44.002038 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1443/2853] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:33:43 2022] DELETE /identity/v3/projects/c275678d3f4f4a528ba45b715cdabb0e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:44.007976 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc732f-1977-469f-a02a-3895933a6800 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:44.026149 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc732f-1977-469f-a02a-3895933a6800 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:44.064627 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:44.137383 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0893ac-884a-409f-9c62-3eb641a60385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:44.137962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0893ac-884a-409f-9c62-3eb641a60385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:44.138268 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0893ac-884a-409f-9c62-3eb641a60385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:44.138573 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0893ac-884a-409f-9c62-3eb641a60385 admin admin] PATH_INFO: `/v3/users/1aa41abe6072498fab9daf9d2ff95288` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:44.140034 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0893ac-884a-409f-9c62-3eb641a60385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa41abe6072498fab9daf9d2ff95288)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:44.143195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0893ac-884a-409f-9c62-3eb641a60385 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:44.457453 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8c0893ac-884a-409f-9c62-3eb641a60385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa41abe6072498fab9daf9d2ff95288'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:44.459410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8c0893ac-884a-409f-9c62-3eb641a60385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa41abe6072498fab9daf9d2ff95288'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:44.484510 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8c0893ac-884a-409f-9c62-3eb641a60385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa41abe6072498fab9daf9d2ff95288'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:44.485340 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8c0893ac-884a-409f-9c62-3eb641a60385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa41abe6072498fab9daf9d2ff95288'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:44.583630 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8c0893ac-884a-409f-9c62-3eb641a60385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa41abe6072498fab9daf9d2ff95288'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:44.599543 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1411/2854] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:33:44 2022] DELETE /identity/v3/users/1aa41abe6072498fab9daf9d2ff95288 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:33:45.218978 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694fe55-de54-4aff-aa2a-a7387f82b934 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:45.226748 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-3694fe55-de54-4aff-aa2a-a7387f82b934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:45.246998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694fe55-de54-4aff-aa2a-a7387f82b934 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:45.347609 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7ab19-786f-4f61-963c-857458c5186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:45.348617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7ab19-786f-4f61-963c-857458c5186f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:45.349180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7ab19-786f-4f61-963c-857458c5186f admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:45.349693 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7ab19-786f-4f61-963c-857458c5186f admin admin] PATH_INFO: `/v3/projects/2e0faf14c3d847089a8daae8c8461852` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:45.351961 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7ab19-786f-4f61-963c-857458c5186f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e0faf14c3d847089a8daae8c8461852)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:45.355696 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7ab19-786f-4f61-963c-857458c5186f admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:45.394292 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:45.536111 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0893ac-884a-409f-9c62-3eb641a60385 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:45.538591 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8c0893ac-884a-409f-9c62-3eb641a60385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:45.560335 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0893ac-884a-409f-9c62-3eb641a60385 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:45.579441 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0fa7ab19-786f-4f61-963c-857458c5186f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e0faf14c3d847089a8daae8c8461852', 'request_id': 'req-0fa7ab19-786f-4f61-963c-857458c5186f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:45.662267 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f550fa-fe56-4d20-a125-47f67cc09a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:45.662990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f550fa-fe56-4d20-a125-47f67cc09a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:45.663289 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f550fa-fe56-4d20-a125-47f67cc09a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:45.663547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f550fa-fe56-4d20-a125-47f67cc09a19 admin admin] PATH_INFO: `/v3/users/25c26b8ca16a4a8aaf2cc55131fc6a59` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:45.664906 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f550fa-fe56-4d20-a125-47f67cc09a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c26b8ca16a4a8aaf2cc55131fc6a59)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:45.666924 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f550fa-fe56-4d20-a125-47f67cc09a19 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:45.682632 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0fa7ab19-786f-4f61-963c-857458c5186f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e0faf14c3d847089a8daae8c8461852', 'request_id': 'req-0fa7ab19-786f-4f61-963c-857458c5186f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:45.693912 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0fa7ab19-786f-4f61-963c-857458c5186f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e0faf14c3d847089a8daae8c8461852', 'request_id': 'req-0fa7ab19-786f-4f61-963c-857458c5186f'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:45.708147 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0fa7ab19-786f-4f61-963c-857458c5186f admin admin] The token cache is being invalidate because project 2e0faf14c3d847089a8daae8c8461852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:33:45.708709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0fa7ab19-786f-4f61-963c-857458c5186f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:45.709626 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0fa7ab19-786f-4f61-963c-857458c5186f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:45.711781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1444/2855] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:33:45 2022] DELETE /identity/v3/projects/2e0faf14c3d847089a8daae8c8461852 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:45.717944 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fff02a-2cd8-4dce-94e6-e2ba0bbd475a None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:45.718470 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fff02a-2cd8-4dce-94e6-e2ba0bbd475a None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:45.718942 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fff02a-2cd8-4dce-94e6-e2ba0bbd475a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:45.756315 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-88fff02a-2cd8-4dce-94e6-e2ba0bbd475a None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:45.759500 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-88fff02a-2cd8-4dce-94e6-e2ba0bbd475a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:45.775960 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1445/2856] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:33:45.793379 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3eaa-d3a6-4de3-9f0e-26a75a9f710b None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:45.793805 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3eaa-d3a6-4de3-9f0e-26a75a9f710b None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:45.794279 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3eaa-d3a6-4de3-9f0e-26a75a9f710b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:45.829355 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-190a3eaa-d3a6-4de3-9f0e-26a75a9f710b None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:45.831788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-190a3eaa-d3a6-4de3-9f0e-26a75a9f710b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:45.857320 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1446/2857] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:33:45.865724 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a3eaa-d3a6-4de3-9f0e-26a75a9f710b None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:45.877607 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a3eaa-d3a6-4de3-9f0e-26a75a9f710b None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:45.886120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51cdd5-6648-4c8f-a001-51ffd1a95202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:45.887180 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51cdd5-6648-4c8f-a001-51ffd1a95202 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:45.887558 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51cdd5-6648-4c8f-a001-51ffd1a95202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:45.888031 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51cdd5-6648-4c8f-a001-51ffd1a95202 admin admin] PATH_INFO: `/v3/domains` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:45.889301 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51cdd5-6648-4c8f-a001-51ffd1a95202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:33:45.889821 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51cdd5-6648-4c8f-a001-51ffd1a95202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:45.892674 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51cdd5-6648-4c8f-a001-51ffd1a95202 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:45.913002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1447/2858] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:33:45.920470 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51cdd5-6648-4c8f-a001-51ffd1a95202 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:45.937772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51cdd5-6648-4c8f-a001-51ffd1a95202 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:45.948732 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8691ea-dfba-4dd5-b550-e494711bb9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:45.949787 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8691ea-dfba-4dd5-b550-e494711bb9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:45.950272 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8691ea-dfba-4dd5-b550-e494711bb9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:45.950775 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8691ea-dfba-4dd5-b550-e494711bb9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:45.951981 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8691ea-dfba-4dd5-b550-e494711bb9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:45.954832 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8691ea-dfba-4dd5-b550-e494711bb9b5 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:45.968501 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:45.972368 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32f550fa-fe56-4d20-a125-47f67cc09a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c26b8ca16a4a8aaf2cc55131fc6a59'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:45.973091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32f550fa-fe56-4d20-a125-47f67cc09a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c26b8ca16a4a8aaf2cc55131fc6a59'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:45.992679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32f550fa-fe56-4d20-a125-47f67cc09a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c26b8ca16a4a8aaf2cc55131fc6a59'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:45.993648 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32f550fa-fe56-4d20-a125-47f67cc09a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c26b8ca16a4a8aaf2cc55131fc6a59'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:46.191720 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32f550fa-fe56-4d20-a125-47f67cc09a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c26b8ca16a4a8aaf2cc55131fc6a59'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:46.199335 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1448/2859] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:33:45 2022] POST /identity/v3/projects => generated 409 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:33:46.204545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8691ea-dfba-4dd5-b550-e494711bb9b5 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:46.207601 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8e8691ea-dfba-4dd5-b550-e494711bb9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:46.217010 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1412/2860] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:33:45 2022] DELETE /identity/v3/users/25c26b8ca16a4a8aaf2cc55131fc6a59 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:33:46.224984 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb9052-28e5-458d-86a2-3cadfd955bd3 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:46.225507 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb9052-28e5-458d-86a2-3cadfd955bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:46.226194 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb9052-28e5-458d-86a2-3cadfd955bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:46.253945 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f2cb9052-28e5-458d-86a2-3cadfd955bd3 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:46.255614 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f2cb9052-28e5-458d-86a2-3cadfd955bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:46.325063 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8691ea-dfba-4dd5-b550-e494711bb9b5 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:46.377039 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1413/2861] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:33:46.392356 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb9052-28e5-458d-86a2-3cadfd955bd3 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:46.396114 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f2cb9052-28e5-458d-86a2-3cadfd955bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:46.419143 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0587555-da1f-416c-82d5-6404ae068dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:46.424804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0587555-da1f-416c-82d5-6404ae068dee admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:46.424804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0587555-da1f-416c-82d5-6404ae068dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:46.424804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0587555-da1f-416c-82d5-6404ae068dee admin admin] PATH_INFO: `/v3/users` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:46.424804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0587555-da1f-416c-82d5-6404ae068dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:46.424804 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0587555-da1f-416c-82d5-6404ae068dee admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:46.436730 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:46.508587 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb9052-28e5-458d-86a2-3cadfd955bd3 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:46.513091 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32335c-bd9d-4c77-bccc-ed7af5c6c772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:46.513771 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32335c-bd9d-4c77-bccc-ed7af5c6c772 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:46.516859 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32335c-bd9d-4c77-bccc-ed7af5c6c772 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:46.516859 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32335c-bd9d-4c77-bccc-ed7af5c6c772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:46.532638 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32335c-bd9d-4c77-bccc-ed7af5c6c772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:46.534262 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32335c-bd9d-4c77-bccc-ed7af5c6c772 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:46.549344 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1414/2862] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:33:46.618462 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1449/2863] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:33:46 2022] POST /identity/v3/users => generated 305 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:33:46.623716 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32335c-bd9d-4c77-bccc-ed7af5c6c772 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:46.636425 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32335c-bd9d-4c77-bccc-ed7af5c6c772 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:46.641674 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703cd7d-e1ff-49cc-abf9-4577c5920397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:46.642404 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703cd7d-e1ff-49cc-abf9-4577c5920397 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:46.642755 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703cd7d-e1ff-49cc-abf9-4577c5920397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:46.643130 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703cd7d-e1ff-49cc-abf9-4577c5920397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:46.644070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703cd7d-e1ff-49cc-abf9-4577c5920397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:46.645743 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703cd7d-e1ff-49cc-abf9-4577c5920397 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:46.659647 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1415/2864] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:33:46.664801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0587555-da1f-416c-82d5-6404ae068dee admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:46.676913 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0587555-da1f-416c-82d5-6404ae068dee admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:46.682136 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3deaf8-ba4b-4c3d-b0c6-333085b84246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:46.685738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3deaf8-ba4b-4c3d-b0c6-333085b84246 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:46.685738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3deaf8-ba4b-4c3d-b0c6-333085b84246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:46.685738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3deaf8-ba4b-4c3d-b0c6-333085b84246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:46.685738 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3deaf8-ba4b-4c3d-b0c6-333085b84246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:46.686942 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3deaf8-ba4b-4c3d-b0c6-333085b84246 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:46.697678 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1450/2865] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:33:46.702055 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703cd7d-e1ff-49cc-abf9-4577c5920397 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:46.721976 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703cd7d-e1ff-49cc-abf9-4577c5920397 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:46.730747 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b9ca5-ce5f-4e24-962e-3040f9f4759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:46.731786 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b9ca5-ce5f-4e24-962e-3040f9f4759e admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:46.732235 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b9ca5-ce5f-4e24-962e-3040f9f4759e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:46.732703 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b9ca5-ce5f-4e24-962e-3040f9f4759e admin admin] PATH_INFO: `/v3/projects/c870d50ac5944032a712fd1f9c0c2564/users/a117c4b2e1e64c599503fce64c4ee3c3/roles/7555aed6a21441208a17dedef685336f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:46.765098 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b9ca5-ce5f-4e24-962e-3040f9f4759e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c870d50ac5944032a712fd1f9c0c2564, user_id=a117c4b2e1e64c599503fce64c4ee3c3, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:46.768725 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b9ca5-ce5f-4e24-962e-3040f9f4759e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:46.909615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1416/2866] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:33:46 2022] PUT /identity/v3/projects/c870d50ac5944032a712fd1f9c0c2564/users/a117c4b2e1e64c599503fce64c4ee3c3/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:46.932392 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b49f55-63ca-4475-83a5-97d24299916e None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:46.932998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b49f55-63ca-4475-83a5-97d24299916e None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:46.933781 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b49f55-63ca-4475-83a5-97d24299916e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:46.978819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-68b49f55-63ca-4475-83a5-97d24299916e None None] MFA Rules not processed for user `a117c4b2e1e64c599503fce64c4ee3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:46.980268 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-68b49f55-63ca-4475-83a5-97d24299916e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:47.107000 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1451/2867] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:33:47.113879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b9ca5-ce5f-4e24-962e-3040f9f4759e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:47.168845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:47.220185 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b9ca5-ce5f-4e24-962e-3040f9f4759e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:47.227963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61ae88-cb4e-4c96-8e2d-d0f578ef7559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:47.228985 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61ae88-cb4e-4c96-8e2d-d0f578ef7559 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:47.229437 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61ae88-cb4e-4c96-8e2d-d0f578ef7559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:47.229883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61ae88-cb4e-4c96-8e2d-d0f578ef7559 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:47.231036 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61ae88-cb4e-4c96-8e2d-d0f578ef7559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:47.234481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61ae88-cb4e-4c96-8e2d-d0f578ef7559 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:47.250624 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b49f55-63ca-4475-83a5-97d24299916e None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:47.253772 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-68b49f55-63ca-4475-83a5-97d24299916e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:47.277244 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b49f55-63ca-4475-83a5-97d24299916e None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:47.285896 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dc015-fb53-48f1-bef1-d48dca906b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:47.286312 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dc015-fb53-48f1-bef1-d48dca906b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:47.286312 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dc015-fb53-48f1-bef1-d48dca906b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:47.287228 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dc015-fb53-48f1-bef1-d48dca906b71 admin admin] PATH_INFO: `/v3/projects/d0999d9d70044ad8a89fa76f96537f89` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:47.289373 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dc015-fb53-48f1-bef1-d48dca906b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0999d9d70044ad8a89fa76f96537f89)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:47.294695 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dc015-fb53-48f1-bef1-d48dca906b71 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:47.438028 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1417/2868] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:33:47 2022] POST /identity/v3/projects => generated 409 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:33:47.446350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61ae88-cb4e-4c96-8e2d-d0f578ef7559 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:47.536129 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-770dc015-fb53-48f1-bef1-d48dca906b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0999d9d70044ad8a89fa76f96537f89', 'request_id': 'req-770dc015-fb53-48f1-bef1-d48dca906b71'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:47.563280 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61ae88-cb4e-4c96-8e2d-d0f578ef7559 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:47.651908 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e91e1a-01be-4560-986b-7dd43605ec79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:47.652288 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e91e1a-01be-4560-986b-7dd43605ec79 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:47.652470 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e91e1a-01be-4560-986b-7dd43605ec79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:47.652629 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e91e1a-01be-4560-986b-7dd43605ec79 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:47.653411 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e91e1a-01be-4560-986b-7dd43605ec79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:47.655679 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e91e1a-01be-4560-986b-7dd43605ec79 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:47.843515 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-770dc015-fb53-48f1-bef1-d48dca906b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0999d9d70044ad8a89fa76f96537f89', 'request_id': 'req-770dc015-fb53-48f1-bef1-d48dca906b71'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:47.853793 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-770dc015-fb53-48f1-bef1-d48dca906b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0999d9d70044ad8a89fa76f96537f89', 'request_id': 'req-770dc015-fb53-48f1-bef1-d48dca906b71'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:47.872200 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-770dc015-fb53-48f1-bef1-d48dca906b71 admin admin] The token cache is being invalidate because project d0999d9d70044ad8a89fa76f96537f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:33:47.872774 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-770dc015-fb53-48f1-bef1-d48dca906b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:47.873974 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-770dc015-fb53-48f1-bef1-d48dca906b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:47.876913 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1452/2869] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:33:47 2022] DELETE /identity/v3/projects/d0999d9d70044ad8a89fa76f96537f89 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:47.908520 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1418/2870] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:33:47 2022] POST /identity/v3/users => generated 311 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:33:47.913713 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dc015-fb53-48f1-bef1-d48dca906b71 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:47.916237 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-770dc015-fb53-48f1-bef1-d48dca906b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:47.937806 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dc015-fb53-48f1-bef1-d48dca906b71 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:47.944139 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094a92e-f6d3-46c7-9fe2-4c962284ffb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:47.944916 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094a92e-f6d3-46c7-9fe2-4c962284ffb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:47.945283 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094a92e-f6d3-46c7-9fe2-4c962284ffb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:47.945759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094a92e-f6d3-46c7-9fe2-4c962284ffb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:47.946809 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094a92e-f6d3-46c7-9fe2-4c962284ffb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:47.952448 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094a92e-f6d3-46c7-9fe2-4c962284ffb4 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:47.964933 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1453/2871] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:33:47.971481 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e91e1a-01be-4560-986b-7dd43605ec79 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:47.984478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e91e1a-01be-4560-986b-7dd43605ec79 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:47.990448 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673e682-139c-45b3-9277-c83179141ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:47.993553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673e682-139c-45b3-9277-c83179141ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:47.993553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673e682-139c-45b3-9277-c83179141ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:47.993553 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673e682-139c-45b3-9277-c83179141ad1 admin admin] PATH_INFO: `/v3/projects/b61d797fd6c84d929833541a39c3096b/users/13c7d9ee71ba4081963175e9da10cce7/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:48.017962 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673e682-139c-45b3-9277-c83179141ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61d797fd6c84d929833541a39c3096b, user_id=13c7d9ee71ba4081963175e9da10cce7, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:48.021070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673e682-139c-45b3-9277-c83179141ad1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:48.128463 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1419/2872] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:33:47 2022] PUT /identity/v3/projects/b61d797fd6c84d929833541a39c3096b/users/13c7d9ee71ba4081963175e9da10cce7/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:48.136807 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094a92e-f6d3-46c7-9fe2-4c962284ffb4 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:48.156189 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094a92e-f6d3-46c7-9fe2-4c962284ffb4 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:48.235908 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:48.256573 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e5f6c-b1b0-4514-a7b2-9087b4828902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:48.257351 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e5f6c-b1b0-4514-a7b2-9087b4828902 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:48.258226 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e5f6c-b1b0-4514-a7b2-9087b4828902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:48.258545 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e5f6c-b1b0-4514-a7b2-9087b4828902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:48.259311 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e5f6c-b1b0-4514-a7b2-9087b4828902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:48.261002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e5f6c-b1b0-4514-a7b2-9087b4828902 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:48.272843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1454/2873] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:33:48.277729 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673e682-139c-45b3-9277-c83179141ad1 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:48.299483 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673e682-139c-45b3-9277-c83179141ad1 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:48.310301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbd95d-c52c-463e-b67a-a7aab9895b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:48.311526 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbd95d-c52c-463e-b67a-a7aab9895b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:48.312012 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbd95d-c52c-463e-b67a-a7aab9895b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:48.312512 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbd95d-c52c-463e-b67a-a7aab9895b35 admin admin] PATH_INFO: `/v3/projects/b61d797fd6c84d929833541a39c3096b/users/13c7d9ee71ba4081963175e9da10cce7/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:48.316168 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbd95d-c52c-463e-b67a-a7aab9895b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61d797fd6c84d929833541a39c3096b, user_id=13c7d9ee71ba4081963175e9da10cce7, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:48.321259 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbd95d-c52c-463e-b67a-a7aab9895b35 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:48.336329 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1420/2874] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:33:48 2022] PUT /identity/v3/projects/b61d797fd6c84d929833541a39c3096b/users/13c7d9ee71ba4081963175e9da10cce7/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:33:48.348335 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9becd-de8e-46b6-bb2e-255ee61588b2 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:48.351056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9becd-de8e-46b6-bb2e-255ee61588b2 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:48.351056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9becd-de8e-46b6-bb2e-255ee61588b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:48.388289 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-20f9becd-de8e-46b6-bb2e-255ee61588b2 None None] MFA Rules not processed for user `13c7d9ee71ba4081963175e9da10cce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:48.390204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-20f9becd-de8e-46b6-bb2e-255ee61588b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:48.500973 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1455/2875] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:48 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:33:48.515151 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbd95d-c52c-463e-b67a-a7aab9895b35 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:48.517848 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-43dbd95d-c52c-463e-b67a-a7aab9895b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:48.540807 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:48.611817 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbd95d-c52c-463e-b67a-a7aab9895b35 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:48.619996 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea015d9-cc47-495a-834c-128200ae4fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:48.621333 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea015d9-cc47-495a-834c-128200ae4fcc service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:48.621825 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea015d9-cc47-495a-834c-128200ae4fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:48.622312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea015d9-cc47-495a-834c-128200ae4fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:48.642466 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea015d9-cc47-495a-834c-128200ae4fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:48.644615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea015d9-cc47-495a-834c-128200ae4fcc service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:48.664957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1421/2876] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:33:48 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:33:49.158394 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9becd-de8e-46b6-bb2e-255ee61588b2 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:49.169519 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9becd-de8e-46b6-bb2e-255ee61588b2 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:49.174102 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671bb98-61fa-4644-b8f9-0c4bb1c10909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:49.174825 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671bb98-61fa-4644-b8f9-0c4bb1c10909 service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:49.175329 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671bb98-61fa-4644-b8f9-0c4bb1c10909 service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:49.175613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671bb98-61fa-4644-b8f9-0c4bb1c10909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:49.178340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-e671bb98-61fa-4644-b8f9-0c4bb1c10909 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:49.253543 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671bb98-61fa-4644-b8f9-0c4bb1c10909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:49.256736 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671bb98-61fa-4644-b8f9-0c4bb1c10909 service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:49.275399 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1456/2877] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:33:49 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:33:58.657408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=20 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:58.843698 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea015d9-cc47-495a-834c-128200ae4fcc service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:58.918137 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea015d9-cc47-495a-834c-128200ae4fcc service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:58.924930 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb732994-3741-4665-9258-5629a9be3f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:58.925615 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb732994-3741-4665-9258-5629a9be3f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:58.925923 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb732994-3741-4665-9258-5629a9be3f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:58.926198 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb732994-3741-4665-9258-5629a9be3f9c admin admin] PATH_INFO: `/v3/users/a117c4b2e1e64c599503fce64c4ee3c3` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:58.927999 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb732994-3741-4665-9258-5629a9be3f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a117c4b2e1e64c599503fce64c4ee3c3)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:58.929937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb732994-3741-4665-9258-5629a9be3f9c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:59.209605 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-fb732994-3741-4665-9258-5629a9be3f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a117c4b2e1e64c599503fce64c4ee3c3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:59.210269 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-fb732994-3741-4665-9258-5629a9be3f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a117c4b2e1e64c599503fce64c4ee3c3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:59.223184 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-fb732994-3741-4665-9258-5629a9be3f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a117c4b2e1e64c599503fce64c4ee3c3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:59.224583 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-fb732994-3741-4665-9258-5629a9be3f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a117c4b2e1e64c599503fce64c4ee3c3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:59.266691 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=70 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:59.362145 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-fb732994-3741-4665-9258-5629a9be3f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a117c4b2e1e64c599503fce64c4ee3c3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:33:59.377432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1422/2878] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:33:58 2022] DELETE /identity/v3/users/a117c4b2e1e64c599503fce64c4ee3c3 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:33:59.390756 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99adcb-0de5-410d-acdf-95efa3179af3 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:59.391041 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99adcb-0de5-410d-acdf-95efa3179af3 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:59.391309 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99adcb-0de5-410d-acdf-95efa3179af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:59.412348 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-cb99adcb-0de5-410d-acdf-95efa3179af3 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:59.413566 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-cb99adcb-0de5-410d-acdf-95efa3179af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:59.473025 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1457/2879] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:33:59.483879 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb732994-3741-4665-9258-5629a9be3f9c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:33:59.485896 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-fb732994-3741-4665-9258-5629a9be3f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:59.552195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb732994-3741-4665-9258-5629a9be3f9c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:33:59.559048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edc905-10de-4266-97fc-d4f5f51ba7f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:33:59.559683 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edc905-10de-4266-97fc-d4f5f51ba7f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:59.559967 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edc905-10de-4266-97fc-d4f5f51ba7f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:59.560244 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edc905-10de-4266-97fc-d4f5f51ba7f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:59.571372 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edc905-10de-4266-97fc-d4f5f51ba7f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:33:59.572845 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edc905-10de-4266-97fc-d4f5f51ba7f5 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:33:59.584842 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1423/2880] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:34:00.187009 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99adcb-0de5-410d-acdf-95efa3179af3 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:00.188567 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-cb99adcb-0de5-410d-acdf-95efa3179af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:00.202101 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99adcb-0de5-410d-acdf-95efa3179af3 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:00.207204 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6242b-5ab7-4263-96b9-cf0611014e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:00.208156 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6242b-5ab7-4263-96b9-cf0611014e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:00.208367 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6242b-5ab7-4263-96b9-cf0611014e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:00.208476 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6242b-5ab7-4263-96b9-cf0611014e61 admin admin] PATH_INFO: `/v3/projects/c870d50ac5944032a712fd1f9c0c2564` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:00.209961 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6242b-5ab7-4263-96b9-cf0611014e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c870d50ac5944032a712fd1f9c0c2564)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:00.211956 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6242b-5ab7-4263-96b9-cf0611014e61 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:00.373614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-07d6242b-5ab7-4263-96b9-cf0611014e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c870d50ac5944032a712fd1f9c0c2564', 'request_id': 'req-07d6242b-5ab7-4263-96b9-cf0611014e61'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:00.478709 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-07d6242b-5ab7-4263-96b9-cf0611014e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c870d50ac5944032a712fd1f9c0c2564', 'request_id': 'req-07d6242b-5ab7-4263-96b9-cf0611014e61'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:00.486927 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-07d6242b-5ab7-4263-96b9-cf0611014e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c870d50ac5944032a712fd1f9c0c2564', 'request_id': 'req-07d6242b-5ab7-4263-96b9-cf0611014e61'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:00.503023 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-07d6242b-5ab7-4263-96b9-cf0611014e61 admin admin] The token cache is being invalidate because project c870d50ac5944032a712fd1f9c0c2564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:34:00.503321 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-07d6242b-5ab7-4263-96b9-cf0611014e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:00.503998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-07d6242b-5ab7-4263-96b9-cf0611014e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:00.506157 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1458/2881] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:34:00 2022] DELETE /identity/v3/projects/c870d50ac5944032a712fd1f9c0c2564 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:34:00.511806 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edc905-10de-4266-97fc-d4f5f51ba7f5 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:00.522309 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edc905-10de-4266-97fc-d4f5f51ba7f5 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:00.550181 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:34:00.606905 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b371f6-f986-4ace-8690-a0c73c253be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:00.607669 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b371f6-f986-4ace-8690-a0c73c253be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:00.607957 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b371f6-f986-4ace-8690-a0c73c253be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:00.608243 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b371f6-f986-4ace-8690-a0c73c253be4 admin admin] PATH_INFO: `/v3/users/13c7d9ee71ba4081963175e9da10cce7` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:00.609990 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b371f6-f986-4ace-8690-a0c73c253be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c7d9ee71ba4081963175e9da10cce7)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:00.612256 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b371f6-f986-4ace-8690-a0c73c253be4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:00.878434 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-51b371f6-f986-4ace-8690-a0c73c253be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c7d9ee71ba4081963175e9da10cce7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:00.879274 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-51b371f6-f986-4ace-8690-a0c73c253be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c7d9ee71ba4081963175e9da10cce7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:00.893445 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-51b371f6-f986-4ace-8690-a0c73c253be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c7d9ee71ba4081963175e9da10cce7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:00.894287 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-51b371f6-f986-4ace-8690-a0c73c253be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c7d9ee71ba4081963175e9da10cce7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:01.008088 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-51b371f6-f986-4ace-8690-a0c73c253be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c7d9ee71ba4081963175e9da10cce7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:01.026766 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1424/2882] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:34:00 2022] DELETE /identity/v3/users/13c7d9ee71ba4081963175e9da10cce7 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:34:01.606259 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6242b-5ab7-4263-96b9-cf0611014e61 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:01.614786 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-07d6242b-5ab7-4263-96b9-cf0611014e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:01.623814 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6242b-5ab7-4263-96b9-cf0611014e61 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:01.696567 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab71bdd-cb60-4d29-8980-bd1df2676287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:01.697132 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab71bdd-cb60-4d29-8980-bd1df2676287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:01.697413 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab71bdd-cb60-4d29-8980-bd1df2676287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:01.697716 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab71bdd-cb60-4d29-8980-bd1df2676287 admin admin] PATH_INFO: `/v3/projects/b61d797fd6c84d929833541a39c3096b` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:01.699045 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab71bdd-cb60-4d29-8980-bd1df2676287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b61d797fd6c84d929833541a39c3096b)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:01.700943 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab71bdd-cb60-4d29-8980-bd1df2676287 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:01.780635 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:34:01.799534 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bab71bdd-cb60-4d29-8980-bd1df2676287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b61d797fd6c84d929833541a39c3096b', 'request_id': 'req-bab71bdd-cb60-4d29-8980-bd1df2676287'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:01.916141 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bab71bdd-cb60-4d29-8980-bd1df2676287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b61d797fd6c84d929833541a39c3096b', 'request_id': 'req-bab71bdd-cb60-4d29-8980-bd1df2676287'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:01.923144 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bab71bdd-cb60-4d29-8980-bd1df2676287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b61d797fd6c84d929833541a39c3096b', 'request_id': 'req-bab71bdd-cb60-4d29-8980-bd1df2676287'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:01.936071 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bab71bdd-cb60-4d29-8980-bd1df2676287 admin admin] The token cache is being invalidate because project b61d797fd6c84d929833541a39c3096b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:34:01.936364 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bab71bdd-cb60-4d29-8980-bd1df2676287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:01.937264 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-bab71bdd-cb60-4d29-8980-bd1df2676287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:01.939230 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1459/2883] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:34:01 2022] DELETE /identity/v3/projects/b61d797fd6c84d929833541a39c3096b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:34:01.946410 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbadaf-f278-40c0-a558-8b7964e600ee None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:01.947053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbadaf-f278-40c0-a558-8b7964e600ee None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:01.947053 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbadaf-f278-40c0-a558-8b7964e600ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:01.967560 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f5fbadaf-f278-40c0-a558-8b7964e600ee None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:34:01.968794 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f5fbadaf-f278-40c0-a558-8b7964e600ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:02.037054 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1425/2884] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:34:02.046333 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b449c-df33-4c49-ae7b-b6acf360bbe8 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:02.046683 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b449c-df33-4c49-ae7b-b6acf360bbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:02.049821 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b449c-df33-4c49-ae7b-b6acf360bbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:02.069819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-861b449c-df33-4c49-ae7b-b6acf360bbe8 None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:34:02.070969 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-861b449c-df33-4c49-ae7b-b6acf360bbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:02.079513 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1460/2885] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:34:02.085361 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbadaf-f278-40c0-a558-8b7964e600ee None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:02.096987 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbadaf-f278-40c0-a558-8b7964e600ee None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:02.102646 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8187-b474-4b67-b593-3d1f92cce198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:02.103313 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8187-b474-4b67-b593-3d1f92cce198 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:02.103594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8187-b474-4b67-b593-3d1f92cce198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:02.103868 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8187-b474-4b67-b593-3d1f92cce198 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:02.104570 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e8187-b474-4b67-b593-3d1f92cce198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:34:02.104878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e8187-b474-4b67-b593-3d1f92cce198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:02.106495 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e8187-b474-4b67-b593-3d1f92cce198 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:02.120121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1426/2886] 10.222.0.98 () {58 vars in 1153 bytes} [Tue Jul 26 15:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:34:02.125401 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b449c-df33-4c49-ae7b-b6acf360bbe8 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:02.137714 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b449c-df33-4c49-ae7b-b6acf360bbe8 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:02.143392 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba29f8-2524-487a-8f96-8d89e1b495fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:02.144030 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba29f8-2524-487a-8f96-8d89e1b495fc admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:02.144311 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba29f8-2524-487a-8f96-8d89e1b495fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:02.144585 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba29f8-2524-487a-8f96-8d89e1b495fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:02.145299 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba29f8-2524-487a-8f96-8d89e1b495fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:02.147991 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba29f8-2524-487a-8f96-8d89e1b495fc admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:02.290658 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1461/2887] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:34:02 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:34:02.295225 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8187-b474-4b67-b593-3d1f92cce198 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:02.306963 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8187-b474-4b67-b593-3d1f92cce198 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:02.339434 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:34:02.375013 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacd2c4-2f5e-4fcd-ac78-cb508ddd16ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:02.375652 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd2c4-2f5e-4fcd-ac78-cb508ddd16ce admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:02.375940 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd2c4-2f5e-4fcd-ac78-cb508ddd16ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:02.376217 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd2c4-2f5e-4fcd-ac78-cb508ddd16ce admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:02.376898 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacd2c4-2f5e-4fcd-ac78-cb508ddd16ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:02.378865 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacd2c4-2f5e-4fcd-ac78-cb508ddd16ce admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:02.540611 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1427/2888] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:34:02 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:34:02.548577 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba29f8-2524-487a-8f96-8d89e1b495fc admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:02.556595 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba29f8-2524-487a-8f96-8d89e1b495fc admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:02.561192 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb01a87-93a6-4e3b-9661-b3d52ccb006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:02.561801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb01a87-93a6-4e3b-9661-b3d52ccb006b admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:02.562096 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb01a87-93a6-4e3b-9661-b3d52ccb006b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:02.562404 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb01a87-93a6-4e3b-9661-b3d52ccb006b admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:02.563105 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb01a87-93a6-4e3b-9661-b3d52ccb006b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:02.564721 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb01a87-93a6-4e3b-9661-b3d52ccb006b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:02.575420 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1462/2889] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:34:02.579820 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacd2c4-2f5e-4fcd-ac78-cb508ddd16ce admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:02.590564 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacd2c4-2f5e-4fcd-ac78-cb508ddd16ce admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:02.596157 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9220f-51a5-4387-9201-2c917e85ca4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:02.596764 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9220f-51a5-4387-9201-2c917e85ca4e admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:02.597043 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9220f-51a5-4387-9201-2c917e85ca4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:02.597316 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9220f-51a5-4387-9201-2c917e85ca4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:02.598003 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9220f-51a5-4387-9201-2c917e85ca4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:02.600252 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9220f-51a5-4387-9201-2c917e85ca4e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:02.611024 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1428/2890] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:34:02.618568 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb01a87-93a6-4e3b-9661-b3d52ccb006b admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:02.629770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb01a87-93a6-4e3b-9661-b3d52ccb006b admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:02.635628 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4029778-ac01-4fb9-8302-0f022a86ad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:02.636317 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4029778-ac01-4fb9-8302-0f022a86ad6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:02.636598 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4029778-ac01-4fb9-8302-0f022a86ad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:02.636869 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4029778-ac01-4fb9-8302-0f022a86ad6b admin admin] PATH_INFO: `/v3/projects/db4b5e0f77444d0397ebe11dd1de2137/users/78b73ef081f74416b3731fcb1bb4a0a0/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:02.653759 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4029778-ac01-4fb9-8302-0f022a86ad6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=db4b5e0f77444d0397ebe11dd1de2137, user_id=78b73ef081f74416b3731fcb1bb4a0a0, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:02.656424 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4029778-ac01-4fb9-8302-0f022a86ad6b admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:02.740255 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1463/2891] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:34:02 2022] PUT /identity/v3/projects/db4b5e0f77444d0397ebe11dd1de2137/users/78b73ef081f74416b3731fcb1bb4a0a0/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:34:02.751045 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09347725-7374-484a-a3b8-af2375d19cc5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:02.751332 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09347725-7374-484a-a3b8-af2375d19cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:02.751617 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09347725-7374-484a-a3b8-af2375d19cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:02.782432 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-09347725-7374-484a-a3b8-af2375d19cc5 None None] MFA Rules not processed for user `78b73ef081f74416b3731fcb1bb4a0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:34:02.783816 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-09347725-7374-484a-a3b8-af2375d19cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:02.865552 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1429/2892] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:34:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:34:02.873143 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4029778-ac01-4fb9-8302-0f022a86ad6b admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:02.957300 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4029778-ac01-4fb9-8302-0f022a86ad6b admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:02.963412 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01130125-c6c4-4e17-9294-a1b2a9078340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:02.964120 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01130125-c6c4-4e17-9294-a1b2a9078340 admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:02.964336 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01130125-c6c4-4e17-9294-a1b2a9078340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:02.964614 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01130125-c6c4-4e17-9294-a1b2a9078340 admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:02.965297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01130125-c6c4-4e17-9294-a1b2a9078340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:02.967275 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01130125-c6c4-4e17-9294-a1b2a9078340 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:03.076885 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1464/2893] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:34:02 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:34:03.082576 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09347725-7374-484a-a3b8-af2375d19cc5 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:03.095535 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09347725-7374-484a-a3b8-af2375d19cc5 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:03.167723 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7092b73-6352-4bc9-ba5d-4258b2625e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:03.168408 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7092b73-6352-4bc9-ba5d-4258b2625e42 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:03.168700 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7092b73-6352-4bc9-ba5d-4258b2625e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:03.169121 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7092b73-6352-4bc9-ba5d-4258b2625e42 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:03.170330 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7092b73-6352-4bc9-ba5d-4258b2625e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:03.171877 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7092b73-6352-4bc9-ba5d-4258b2625e42 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:03.288347 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1430/2894] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:34:03 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:34:03.292541 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01130125-c6c4-4e17-9294-a1b2a9078340 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:03.303935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01130125-c6c4-4e17-9294-a1b2a9078340 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:03.308660 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd937912-0d22-4d02-8770-1c2a4f949475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:03.309295 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd937912-0d22-4d02-8770-1c2a4f949475 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:03.309611 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd937912-0d22-4d02-8770-1c2a4f949475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:03.309855 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd937912-0d22-4d02-8770-1c2a4f949475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:03.310589 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd937912-0d22-4d02-8770-1c2a4f949475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:03.312202 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd937912-0d22-4d02-8770-1c2a4f949475 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:03.324786 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1465/2895] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:34:03.328928 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7092b73-6352-4bc9-ba5d-4258b2625e42 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:03.340231 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7092b73-6352-4bc9-ba5d-4258b2625e42 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:03.345819 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425e775-abc4-4267-811b-c608daa3af7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:03.346898 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425e775-abc4-4267-811b-c608daa3af7c admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:03.347186 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425e775-abc4-4267-811b-c608daa3af7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:03.347467 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425e775-abc4-4267-811b-c608daa3af7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:03.348195 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425e775-abc4-4267-811b-c608daa3af7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:03.350282 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425e775-abc4-4267-811b-c608daa3af7c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:03.361632 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1431/2896] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:34:03.366886 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd937912-0d22-4d02-8770-1c2a4f949475 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:03.379354 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd937912-0d22-4d02-8770-1c2a4f949475 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:03.385326 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4743be-c4c5-4e1b-930b-ae8f2fa6b51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:03.386019 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4743be-c4c5-4e1b-930b-ae8f2fa6b51c admin admin] REQUEST_METHOD: `PUT` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:03.386663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4743be-c4c5-4e1b-930b-ae8f2fa6b51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:03.386663 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4743be-c4c5-4e1b-930b-ae8f2fa6b51c admin admin] PATH_INFO: `/v3/projects/0dc277c3edc34585a5756a28b3583994/users/98e1cc637a7e43bd90efcf5857bb67c2/roles/7555aed6a21441208a17dedef685336f` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:03.404182 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4743be-c4c5-4e1b-930b-ae8f2fa6b51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc277c3edc34585a5756a28b3583994, user_id=98e1cc637a7e43bd90efcf5857bb67c2, role_id=7555aed6a21441208a17dedef685336f)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:03.407340 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4743be-c4c5-4e1b-930b-ae8f2fa6b51c admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:03.529327 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:34:03.534617 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1466/2897] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:34:03 2022] PUT /identity/v3/projects/0dc277c3edc34585a5756a28b3583994/users/98e1cc637a7e43bd90efcf5857bb67c2/roles/7555aed6a21441208a17dedef685336f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:34:03.547517 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb4122-714c-494c-96f7-cfe110e5eb43 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:03.548017 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb4122-714c-494c-96f7-cfe110e5eb43 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:03.548515 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb4122-714c-494c-96f7-cfe110e5eb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:03.581064 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-20bb4122-714c-494c-96f7-cfe110e5eb43 None None] MFA Rules not processed for user `98e1cc637a7e43bd90efcf5857bb67c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:34:03.582301 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-20bb4122-714c-494c-96f7-cfe110e5eb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:03.586981 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:34:03.659529 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1432/2898] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:34:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:34:03.664728 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4743be-c4c5-4e1b-930b-ae8f2fa6b51c admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:03.728460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4743be-c4c5-4e1b-930b-ae8f2fa6b51c admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:03.733207 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56a10b-be22-4e6e-8381-1f20af74e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:03.733838 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56a10b-be22-4e6e-8381-1f20af74e35d admin admin] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:03.734123 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56a10b-be22-4e6e-8381-1f20af74e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:03.734423 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56a10b-be22-4e6e-8381-1f20af74e35d admin admin] PATH_INFO: `/v3/projects` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:03.735099 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56a10b-be22-4e6e-8381-1f20af74e35d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:03.737056 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56a10b-be22-4e6e-8381-1f20af74e35d admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:03.871175 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1467/2899] 10.222.0.98 () {60 vars in 1153 bytes} [Tue Jul 26 15:34:03 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:34:03.875233 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb4122-714c-494c-96f7-cfe110e5eb43 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:03.886326 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb4122-714c-494c-96f7-cfe110e5eb43 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:03.947258 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba85bec-5615-4a15-a1a7-43515978d965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:03.947878 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba85bec-5615-4a15-a1a7-43515978d965 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:03.948514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba85bec-5615-4a15-a1a7-43515978d965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:03.948514 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba85bec-5615-4a15-a1a7-43515978d965 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:03.949531 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba85bec-5615-4a15-a1a7-43515978d965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:03.951566 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba85bec-5615-4a15-a1a7-43515978d965 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:04.127937 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1433/2900] 10.222.0.98 () {60 vars in 1144 bytes} [Tue Jul 26 15:34:03 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:34:04.133280 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56a10b-be22-4e6e-8381-1f20af74e35d admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:04.145002 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56a10b-be22-4e6e-8381-1f20af74e35d admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:04.151042 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ca451-010f-44f8-8ece-ec99078c6c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:04.151684 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ca451-010f-44f8-8ece-ec99078c6c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:04.151959 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ca451-010f-44f8-8ece-ec99078c6c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:04.152236 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ca451-010f-44f8-8ece-ec99078c6c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:04.152967 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ca451-010f-44f8-8ece-ec99078c6c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:04.154814 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ca451-010f-44f8-8ece-ec99078c6c54 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:04.168788 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1468/2901] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:34:04.173097 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba85bec-5615-4a15-a1a7-43515978d965 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:04.184004 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba85bec-5615-4a15-a1a7-43515978d965 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:04.189307 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c485db1-30e2-46b0-982b-c24d3d6949ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:04.189982 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c485db1-30e2-46b0-982b-c24d3d6949ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:04.190260 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c485db1-30e2-46b0-982b-c24d3d6949ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:04.190563 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c485db1-30e2-46b0-982b-c24d3d6949ab admin admin] PATH_INFO: `/v3/projects/bce2cb2794ea49db87b60eea63068e40/users/2933b56244ca40d6ad8512264fbe4cd0/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:04.207423 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c485db1-30e2-46b0-982b-c24d3d6949ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce2cb2794ea49db87b60eea63068e40, user_id=2933b56244ca40d6ad8512264fbe4cd0, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:04.210857 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c485db1-30e2-46b0-982b-c24d3d6949ab admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:04.360350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1434/2902] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:34:04 2022] PUT /identity/v3/projects/bce2cb2794ea49db87b60eea63068e40/users/2933b56244ca40d6ad8512264fbe4cd0/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:34:04.364690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ca451-010f-44f8-8ece-ec99078c6c54 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:04.376744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ca451-010f-44f8-8ece-ec99078c6c54 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:04.437113 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb68778-17a4-4e44-8f4f-d3edce43cb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:04.437907 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb68778-17a4-4e44-8f4f-d3edce43cb20 admin admin] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:04.438174 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb68778-17a4-4e44-8f4f-d3edce43cb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:04.438480 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb68778-17a4-4e44-8f4f-d3edce43cb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:04.439184 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb68778-17a4-4e44-8f4f-d3edce43cb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:04.440770 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb68778-17a4-4e44-8f4f-d3edce43cb20 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:04.451965 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1469/2903] 10.222.0.98 () {58 vars in 1122 bytes} [Tue Jul 26 15:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:34:04.456586 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c485db1-30e2-46b0-982b-c24d3d6949ab admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:04.468858 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c485db1-30e2-46b0-982b-c24d3d6949ab admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:04.476167 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbc348-538b-49f9-b112-23dfa3e9c4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:04.476866 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbc348-538b-49f9-b112-23dfa3e9c4b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:04.477150 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbc348-538b-49f9-b112-23dfa3e9c4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:04.477428 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbc348-538b-49f9-b112-23dfa3e9c4b7 admin admin] PATH_INFO: `/v3/projects/bce2cb2794ea49db87b60eea63068e40/users/2933b56244ca40d6ad8512264fbe4cd0/roles/17054492864541709fda49dbf677a7a2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:04.479565 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbc348-538b-49f9-b112-23dfa3e9c4b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce2cb2794ea49db87b60eea63068e40, user_id=2933b56244ca40d6ad8512264fbe4cd0, role_id=17054492864541709fda49dbf677a7a2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:04.482325 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbc348-538b-49f9-b112-23dfa3e9c4b7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:04.495772 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1435/2904] 10.222.0.98 () {60 vars in 1483 bytes} [Tue Jul 26 15:34:04 2022] PUT /identity/v3/projects/bce2cb2794ea49db87b60eea63068e40/users/2933b56244ca40d6ad8512264fbe4cd0/roles/17054492864541709fda49dbf677a7a2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:34:04.508223 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13b570-581c-4eb2-84bd-4dea6396cee8 None None] REQUEST_METHOD: `POST` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:04.508505 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13b570-581c-4eb2-84bd-4dea6396cee8 None None] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:04.508780 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13b570-581c-4eb2-84bd-4dea6396cee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:04.542081 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.auth.core [None req-9b13b570-581c-4eb2-84bd-4dea6396cee8 None None] MFA Rules not processed for user `2933b56244ca40d6ad8512264fbe4cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:34:04.543613 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-9b13b570-581c-4eb2-84bd-4dea6396cee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:04.623297 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:34:04.634800 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1470/2905] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:34:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:34:04.649261 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbc348-538b-49f9-b112-23dfa3e9c4b7 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:04.651135 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5bbbc348-538b-49f9-b112-23dfa3e9c4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:04.723594 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbc348-538b-49f9-b112-23dfa3e9c4b7 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:04.728218 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbda217-0153-4465-9517-1e91918fccae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:04.728851 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbda217-0153-4465-9517-1e91918fccae service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:04.729138 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbda217-0153-4465-9517-1e91918fccae service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:04.729414 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbda217-0153-4465-9517-1e91918fccae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:04.742478 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:34:04.795042 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbda217-0153-4465-9517-1e91918fccae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:04.796502 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbda217-0153-4465-9517-1e91918fccae service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:04.807272 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1436/2906] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:34:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:34:06.999304 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13b570-581c-4eb2-84bd-4dea6396cee8 None None] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:07.001553 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-9b13b570-581c-4eb2-84bd-4dea6396cee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:07.018507 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13b570-581c-4eb2-84bd-4dea6396cee8 None None] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:07.023820 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe427bbc-a4ac-4d26-9ff6-5072cf6f359c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:07.024460 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe427bbc-a4ac-4d26-9ff6-5072cf6f359c service cinder] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:07.024741 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe427bbc-a4ac-4d26-9ff6-5072cf6f359c service cinder] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:07.025024 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe427bbc-a4ac-4d26-9ff6-5072cf6f359c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:07.090720 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe427bbc-a4ac-4d26-9ff6-5072cf6f359c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:07.095610 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe427bbc-a4ac-4d26-9ff6-5072cf6f359c service cinder] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:07.103324 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1471/2907] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:34:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:34:08.949141 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbda217-0153-4465-9517-1e91918fccae service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:08.960579 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbda217-0153-4465-9517-1e91918fccae service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:08.964854 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738709c-20f8-4947-84e5-4e5c62a94460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d09fca7f864129ab0dcb90fb5d24e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:08.965498 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738709c-20f8-4947-84e5-4e5c62a94460 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:08.965775 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738709c-20f8-4947-84e5-4e5c62a94460 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:08.966048 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738709c-20f8-4947-84e5-4e5c62a94460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:08.980607 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738709c-20f8-4947-84e5-4e5c62a94460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:08.982057 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738709c-20f8-4947-84e5-4e5c62a94460 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:08.993830 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1437/2908] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:34:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:34:15.061449 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe427bbc-a4ac-4d26-9ff6-5072cf6f359c service cinder] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:15.130918 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe427bbc-a4ac-4d26-9ff6-5072cf6f359c service cinder] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:15.135627 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997b544-cd8f-435b-b84d-d69dffb63569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:15.136188 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997b544-cd8f-435b-b84d-d69dffb63569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:15.136467 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997b544-cd8f-435b-b84d-d69dffb63569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:15.136737 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997b544-cd8f-435b-b84d-d69dffb63569 admin admin] PATH_INFO: `/v3/users/78b73ef081f74416b3731fcb1bb4a0a0` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:15.137924 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997b544-cd8f-435b-b84d-d69dffb63569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b73ef081f74416b3731fcb1bb4a0a0)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:15.139870 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997b544-cd8f-435b-b84d-d69dffb63569 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:15.471842 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1997b544-cd8f-435b-b84d-d69dffb63569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b73ef081f74416b3731fcb1bb4a0a0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:15.472549 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1997b544-cd8f-435b-b84d-d69dffb63569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b73ef081f74416b3731fcb1bb4a0a0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:15.486550 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1997b544-cd8f-435b-b84d-d69dffb63569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b73ef081f74416b3731fcb1bb4a0a0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:15.556369 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1997b544-cd8f-435b-b84d-d69dffb63569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b73ef081f74416b3731fcb1bb4a0a0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:15.556935 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-1997b544-cd8f-435b-b84d-d69dffb63569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b73ef081f74416b3731fcb1bb4a0a0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:15.573129 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1472/2909] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:34:15 2022] DELETE /identity/v3/users/78b73ef081f74416b3731fcb1bb4a0a0 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:34:15.577789 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03900e41-b6f9-4c3b-8ac2-3e7a7f9c22ab None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:15.578312 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03900e41-b6f9-4c3b-8ac2-3e7a7f9c22ab None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:15.578484 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03900e41-b6f9-4c3b-8ac2-3e7a7f9c22ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:15.599752 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-03900e41-b6f9-4c3b-8ac2-3e7a7f9c22ab None None] MFA Rules not processed for user `ab0ce7c38c274718a8fd45c535922c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:34:15.600954 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-03900e41-b6f9-4c3b-8ac2-3e7a7f9c22ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:15.661701 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1438/2910] 10.222.0.98 () {58 vars in 958 bytes} [Tue Jul 26 15:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:34:15.672704 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997b544-cd8f-435b-b84d-d69dffb63569 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:15.674166 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-1997b544-cd8f-435b-b84d-d69dffb63569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:15.688960 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:34:15.736560 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997b544-cd8f-435b-b84d-d69dffb63569 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:15.740710 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2540861-6d6d-4bc8-83e0-362c888c7acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44d2d2b50484fb89b0688ff28615d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:15.746801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2540861-6d6d-4bc8-83e0-362c888c7acd service neutron] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:15.746801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2540861-6d6d-4bc8-83e0-362c888c7acd service neutron] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:15.746801 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2540861-6d6d-4bc8-83e0-362c888c7acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:15.752012 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2540861-6d6d-4bc8-83e0-362c888c7acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:15.753537 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2540861-6d6d-4bc8-83e0-362c888c7acd service neutron] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:15.764286 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1473/2911] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:34:16.218997 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03900e41-b6f9-4c3b-8ac2-3e7a7f9c22ab None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:16.226385 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-03900e41-b6f9-4c3b-8ac2-3e7a7f9c22ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:16.232956 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03900e41-b6f9-4c3b-8ac2-3e7a7f9c22ab None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:16.238139 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97626068-98a8-49ff-9527-58a39ff34a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:16.239330 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97626068-98a8-49ff-9527-58a39ff34a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:16.239613 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97626068-98a8-49ff-9527-58a39ff34a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:16.239888 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97626068-98a8-49ff-9527-58a39ff34a51 admin admin] PATH_INFO: `/v3/projects/db4b5e0f77444d0397ebe11dd1de2137` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:16.241192 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97626068-98a8-49ff-9527-58a39ff34a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db4b5e0f77444d0397ebe11dd1de2137)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:16.243153 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97626068-98a8-49ff-9527-58a39ff34a51 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:16.357892 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-97626068-98a8-49ff-9527-58a39ff34a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db4b5e0f77444d0397ebe11dd1de2137', 'request_id': 'req-97626068-98a8-49ff-9527-58a39ff34a51'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:16.365547 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-97626068-98a8-49ff-9527-58a39ff34a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db4b5e0f77444d0397ebe11dd1de2137', 'request_id': 'req-97626068-98a8-49ff-9527-58a39ff34a51'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:16.375841 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-97626068-98a8-49ff-9527-58a39ff34a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db4b5e0f77444d0397ebe11dd1de2137', 'request_id': 'req-97626068-98a8-49ff-9527-58a39ff34a51'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:16.468468 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-97626068-98a8-49ff-9527-58a39ff34a51 admin admin] The token cache is being invalidate because project db4b5e0f77444d0397ebe11dd1de2137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:34:16.468692 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-97626068-98a8-49ff-9527-58a39ff34a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:16.469286 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-97626068-98a8-49ff-9527-58a39ff34a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:16.470838 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1439/2912] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:34:16 2022] DELETE /identity/v3/projects/db4b5e0f77444d0397ebe11dd1de2137 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:34:16.475514 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2540861-6d6d-4bc8-83e0-362c888c7acd service neutron] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:16.485839 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2540861-6d6d-4bc8-83e0-362c888c7acd service neutron] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:16.548364 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf76f1-8524-49cf-9bc4-52c5b3e9d395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:16.549026 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf76f1-8524-49cf-9bc4-52c5b3e9d395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:16.549314 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf76f1-8524-49cf-9bc4-52c5b3e9d395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:16.549593 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf76f1-8524-49cf-9bc4-52c5b3e9d395 admin admin] PATH_INFO: `/v3/users/98e1cc637a7e43bd90efcf5857bb67c2` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:16.550836 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf76f1-8524-49cf-9bc4-52c5b3e9d395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e1cc637a7e43bd90efcf5857bb67c2)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:16.553808 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf76f1-8524-49cf-9bc4-52c5b3e9d395 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:16.798578 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0dcf76f1-8524-49cf-9bc4-52c5b3e9d395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e1cc637a7e43bd90efcf5857bb67c2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:16.799228 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0dcf76f1-8524-49cf-9bc4-52c5b3e9d395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e1cc637a7e43bd90efcf5857bb67c2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:16.813612 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0dcf76f1-8524-49cf-9bc4-52c5b3e9d395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e1cc637a7e43bd90efcf5857bb67c2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:16.999690 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0dcf76f1-8524-49cf-9bc4-52c5b3e9d395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e1cc637a7e43bd90efcf5857bb67c2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:17.000322 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-0dcf76f1-8524-49cf-9bc4-52c5b3e9d395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e1cc637a7e43bd90efcf5857bb67c2'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:17.014675 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1474/2913] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:34:16 2022] DELETE /identity/v3/users/98e1cc637a7e43bd90efcf5857bb67c2 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:34:17.563568 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97626068-98a8-49ff-9527-58a39ff34a51 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:17.565162 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-97626068-98a8-49ff-9527-58a39ff34a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:17.581849 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97626068-98a8-49ff-9527-58a39ff34a51 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:17.600986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:34:17.644007 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b2765-a325-4fc0-a5f2-94e81d6ee238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:17.644667 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b2765-a325-4fc0-a5f2-94e81d6ee238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:17.644971 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b2765-a325-4fc0-a5f2-94e81d6ee238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:17.645350 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b2765-a325-4fc0-a5f2-94e81d6ee238 admin admin] PATH_INFO: `/v3/projects/0dc277c3edc34585a5756a28b3583994` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:17.646882 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b2765-a325-4fc0-a5f2-94e81d6ee238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dc277c3edc34585a5756a28b3583994)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:17.648827 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b2765-a325-4fc0-a5f2-94e81d6ee238 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:17.780666 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-655b2765-a325-4fc0-a5f2-94e81d6ee238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dc277c3edc34585a5756a28b3583994', 'request_id': 'req-655b2765-a325-4fc0-a5f2-94e81d6ee238'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:17.787893 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-655b2765-a325-4fc0-a5f2-94e81d6ee238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dc277c3edc34585a5756a28b3583994', 'request_id': 'req-655b2765-a325-4fc0-a5f2-94e81d6ee238'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:17.794128 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-655b2765-a325-4fc0-a5f2-94e81d6ee238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dc277c3edc34585a5756a28b3583994', 'request_id': 'req-655b2765-a325-4fc0-a5f2-94e81d6ee238'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:17.898986 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-655b2765-a325-4fc0-a5f2-94e81d6ee238 admin admin] The token cache is being invalidate because project 0dc277c3edc34585a5756a28b3583994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:34:17.899279 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-655b2765-a325-4fc0-a5f2-94e81d6ee238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:17.899947 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-655b2765-a325-4fc0-a5f2-94e81d6ee238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:17.901495 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1440/2914] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:34:17 2022] DELETE /identity/v3/projects/0dc277c3edc34585a5756a28b3583994 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:34:17.905794 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf76f1-8524-49cf-9bc4-52c5b3e9d395 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:17.907231 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-0dcf76f1-8524-49cf-9bc4-52c5b3e9d395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:17.920998 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf76f1-8524-49cf-9bc4-52c5b3e9d395 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:17.955916 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:34:17.981185 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c529a-0d8f-445b-9255-b663a13188d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:17.985792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c529a-0d8f-445b-9255-b663a13188d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:17.985792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c529a-0d8f-445b-9255-b663a13188d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:17.985792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c529a-0d8f-445b-9255-b663a13188d6 admin admin] PATH_INFO: `/v3/users/2933b56244ca40d6ad8512264fbe4cd0` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:17.985792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c529a-0d8f-445b-9255-b663a13188d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2933b56244ca40d6ad8512264fbe4cd0)` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:17.985792 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c529a-0d8f-445b-9255-b663a13188d6 admin admin] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:18.242274 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-8a1c529a-0d8f-445b-9255-b663a13188d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2933b56244ca40d6ad8512264fbe4cd0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:18.242972 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-8a1c529a-0d8f-445b-9255-b663a13188d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2933b56244ca40d6ad8512264fbe4cd0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:18.255744 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-8a1c529a-0d8f-445b-9255-b663a13188d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2933b56244ca40d6ad8512264fbe4cd0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:18.373061 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-8a1c529a-0d8f-445b-9255-b663a13188d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2933b56244ca40d6ad8512264fbe4cd0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:18.373692 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.notifications [None req-8a1c529a-0d8f-445b-9255-b663a13188d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2933b56244ca40d6ad8512264fbe4cd0'} {{(pid=80489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:18.387210 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1475/2915] 10.222.0.98 () {58 vars in 1224 bytes} [Tue Jul 26 15:34:17 2022] DELETE /identity/v3/users/2933b56244ca40d6ad8512264fbe4cd0 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:34:18.858287 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b2765-a325-4fc0-a5f2-94e81d6ee238 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:18.859883 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-655b2765-a325-4fc0-a5f2-94e81d6ee238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:18.873359 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b2765-a325-4fc0-a5f2-94e81d6ee238 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:18.934419 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cb3b6-75c4-4c23-b157-6cfc1e6bd459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0ce7c38c274718a8fd45c535922c16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae5d7650fd54c5a8c95f42eefe32a57', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:18.935070 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cb3b6-75c4-4c23-b157-6cfc1e6bd459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:18.935353 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cb3b6-75c4-4c23-b157-6cfc1e6bd459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:18.935628 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cb3b6-75c4-4c23-b157-6cfc1e6bd459 admin admin] PATH_INFO: `/v3/projects/bce2cb2794ea49db87b60eea63068e40` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:18.936782 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cb3b6-75c4-4c23-b157-6cfc1e6bd459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce2cb2794ea49db87b60eea63068e40)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:18.938880 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cb3b6-75c4-4c23-b157-6cfc1e6bd459 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:19.067439 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-4e7cb3b6-75c4-4c23-b157-6cfc1e6bd459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce2cb2794ea49db87b60eea63068e40', 'request_id': 'req-4e7cb3b6-75c4-4c23-b157-6cfc1e6bd459'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:19.071834 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:34:19.074046 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-4e7cb3b6-75c4-4c23-b157-6cfc1e6bd459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce2cb2794ea49db87b60eea63068e40', 'request_id': 'req-4e7cb3b6-75c4-4c23-b157-6cfc1e6bd459'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:19.080444 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-4e7cb3b6-75c4-4c23-b157-6cfc1e6bd459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce2cb2794ea49db87b60eea63068e40', 'request_id': 'req-4e7cb3b6-75c4-4c23-b157-6cfc1e6bd459'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:19.179746 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-4e7cb3b6-75c4-4c23-b157-6cfc1e6bd459 admin admin] The token cache is being invalidate because project bce2cb2794ea49db87b60eea63068e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:34:19.180043 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-4e7cb3b6-75c4-4c23-b157-6cfc1e6bd459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:19.180676 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-4e7cb3b6-75c4-4c23-b157-6cfc1e6bd459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:34:19.182343 dv-cinder-851032-1-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1441/2916] 10.222.0.98 () {58 vars in 1233 bytes} [Tue Jul 26 15:34:18 2022] DELETE /identity/v3/projects/bce2cb2794ea49db87b60eea63068e40 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:34:28.383581 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=37,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:34:29.275765 dv-cinder-851032-1-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=2,keystone:SELECT=5,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:23.604760 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c529a-0d8f-445b-9255-b663a13188d6 admin admin] Authenticating user token {{(pid=80489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:23.606216 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-8a1c529a-0d8f-445b-9255-b663a13188d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:23.772372 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c529a-0d8f-445b-9255-b663a13188d6 admin admin] Validating token access rules against request {{(pid=80489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:23.834891 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab110362-b8e7-41bb-8484-e91d340f8e9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448161cd39dc4a6786c8813faa79376a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f750777b75f49a19a5019c4fc2c00f5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:23.835531 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab110362-b8e7-41bb-8484-e91d340f8e9d service placement] REQUEST_METHOD: `GET` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:23.835819 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab110362-b8e7-41bb-8484-e91d340f8e9d service placement] SCRIPT_NAME: `/identity` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:23.836086 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab110362-b8e7-41bb-8484-e91d340f8e9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:23.838159 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.fernet_utils [None req-ab110362-b8e7-41bb-8484-e91d340f8e9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:23.852051 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab110362-b8e7-41bb-8484-e91d340f8e9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:23.854317 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab110362-b8e7-41bb-8484-e91d340f8e9d service placement] RBAC: Authorization granted {{(pid=80489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:23.865843 dv-cinder-851032-1-smb devstack@keystone.service[80489]: [pid: 80489|app: 0|req: 1476/2917] 10.222.0.98 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:33.860721 dv-cinder-851032-1-smb devstack@keystone.service[80489]: DEBUG dbcounter [-] [80489] Writing DB stats keystone:SELECT=89 {{(pid=80489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}